SEARCH · Engineering Papers

Results for “Distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Matrix Completion for Improved Observability in Low-Voltage Distribution Grids

This paper considers the problem of recovering missing entries in a partially observed matrix from relatively few measurements (i.e., the so-called matrix completion problem) with the aim of increasing the presently limited observability of low-voltage distribution grids. To this end, the partially observed matrix is formed using scarce voltage magnitude measurements while accounting for their spatial information. Voltage readings are assumed to be collected from distribution utility sensors and/or geographically-distributed cable television network sensors located in immediate proximity to distribution grid nodes. A matrix completion approach built on the parameter-less singular value shrinkage technique is used to estimate voltage magnitudes at otherwise non-observable low-voltage nodes using a small number of single- or multiple-snapshot data. The effectiveness of the proposed approach is demonstrated using a U.S.-style distribution test system from the synthetic SMART- DS data set under very low- to moderate-observability conditions.

low-rank matrix completion↗

DOE OSTI2025

Personalized and uncertainty-aware coronary hemodynamics simulations: From Bayesian estimation to improved multi-fidelity uncertainty quantification

Non-invasive simulations of coronary hemodynamics have improved clinical risk stratification and treatment outcomes for coronary artery disease, compared to relying on anatomical imaging alone. However, simulations typically use empirical approaches to distribute total coronary flow amongst the arteries in the coronary tree, which ignores patient variability, the presence of disease, and other clinical factors. Further, uncertainty in the clinical data often remains unaccounted for in the modeling pipeline. We present an end-to-end uncertainty-aware pipeline to (1) personalize coronary flow simulations by incorporating vessel-specific coronary flows as well as cardiac function; and (2) predict clinical and biomechanical quantities of interest with improved precision, while accounting for uncertainty in the clinical data. We assimilate patient-specific measurements of myocardial blood flow from clinical CT myocardial perfusion imaging to estimate branch-specific coronary artery flows. Simulated noise in the clinical data is used to estimate the joint posterior distributions of the model parameters using adaptive Markov Chain Monte Carlo sampling. Additionally, the posterior predictive distribution for the relevant quantities of interest is determined using a new approach combining multi-fidelity Monte Carlo estimation with non-linear, data-driven dimensionality reduction. This leads to improved correlations between high- and low-fidelity model outputs. Our framework accurately recapitulates clinically measured cardiac function as well as branch-specific coronary flows under measurement noise uncertainty. We observe substantial reductions in confidence intervals for estimated quantities of interest compared to single-fidelity Monte Carlo estimation and state-of-the-art multi-fidelity Monte Carlo methods. This holds especially true for quantities of interest that showed limited correlation between the low- and high-fidelity model predictions. In addition, the proposed multi-fidelity Monte Carlo estimators are significantly cheaper to compute than traditional estimators, under a specified confidence level or variance. The proposed pipeline for personalized and uncertainty-aware predictions of coronary hemodynamics is based on routine clinical measurements and recently developed techniques for CT myocardial perfusion imaging. The proposed pipeline offers significant improvements in precision and reduction in computational cost.

Bayesian parameter estimation↗

DOE OSTI2024

Commercialization of Distribution System Load Modeling Tool for Improved DER Interconnection Studies

Residential and commercial buildings have huge potential to contribute value to improve grid resilience by participating grid services. To reveal the significant value, it is critical to estimate the grid service capability from these buildings. Unlike the large-scale distributed energy resources such as wind and solar farms, those buildings need to participate grid services in aggregation, not by individual. Therefore, it is important to appropriately group buildings for aggregation. The load profiles in the same group will have similar characteristics at the same time step, so grid operators can send the grid service signal to the customer group with a higher chance to respond at that time step. In this paper, we develop a load profile clustering method to classify the building-level load profiles for grid service capability estimation. In our two-step clustering approach, we first calculate the total load consumption for each building, clustering the load profiles based on energy consumption level. Then, we further cluster the load profiles in each energy cluster based on the load shape. The parameter selection for each clustering step is discussed. The proposed method is applied on actual building-level load profiles, and the results have proved the effectiveness of this method.

14 SOLAR ENERGY↗

DOE OSTI2022

Automating Component-Level Stress Measurements for Inverter Reliability Estimation

In the near future, grid operators are expected to regularly use advanced distributed energy resource (DER) functions, defined in IEEE 1547-2018, to perform a range of grid-support operations. Many of these functions adjust the active and reactive power of the device through commanded or autonomous operating modes which induce new stresses on the power electronics components. In this work, an experimental and theoretical framework is introduced which couples laboratory-measured component stress with advanced inverter functionality and derives a reduction in useful lifetime based on an applicable reliability model. Multiple DER devices were instrumented to calculate the additional component stress under multiple reactive power setpoints to estimate associated DER lifetime reductions. A clear increase in switch loss was demonstrated as a function of irradiance level and power factor. This is replicated in the system-level efficiency measurements, although magnitudes were different—suggesting other loss mechanisms exist. Using an approximate Arrhenius thermal model for the switches, the experimental data indicate a lifetime reduction of 1.5% when operating the inverter at 0.85 PF—compared to unity PF—assuming the DER failure mechanism thermally driven within the H-bridge. If other failure mechanisms are discovered for a set of power electronics devices, this testing and calculation framework can easily be tailored to those failure mechanisms.

Flicker, Jack (ORCID:0000000212232154)↗

DOE OSTI2021

The efficacy of event isotropy as an event shape observable

Event isotropy $\mathcal{I}$ sph , an event shape observable that measures the distance of a final state from a spherically symmetric state, is designed for new physics signals that are far from QCD-like. Using a new technique for producing a wide variety of signals that can range from near-spherical to jetty, we compare event isotropy to other observables. We show that thrust T and the C parameter (and λ max , the largest eigenvalue of the sphericity matrix) are strongly correlated and thus redundant, to a good approximation. By contrast, event isotropy adds considerable information, often serving to break degeneracies between signals that would have almost identical T and C distributions. Signals with broad distributions in T (or λ max ) and in $\mathcal{I}$ sph separately often have much narrower distributions, and are more easily distinguished, in the ($\mathcal{I}$ sph , λ max ) plane. An intuitive, semi-analytic estimation technique clarifies why this is the case and assists with the interpretation of the distributions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Bias-hardened estimators of patchy screening profiles

Detecting anisotropic screening of the cosmic microwave background (CMB) holds the promise of revealing the distribution of gas in the Universe, characterizing the complex processes of galaxy formation and feedback, and studying the epoch of reionization. Estimators for inhomogeneous screening, including some recently proposed small-scale (stacked) estimators, are quadratic or higher order in the CMB temperature or polarization fields and are therefore subject to contamination from CMB lensing. We review the origin of this lensing bias and show that, when stacking on unWISE galaxies, the expected lensing bias dominates the signal if left unmitigated. Hardening techniques that null the lensing bias have been proposed for standard quadratic estimators, whereas only approximate methods have been proposed for stacked estimators. In conclusion, we review these techniques and apply the former to stacked estimators, presenting several strategies (including the optimal strategy) to null lensing contamination when stacking on any large-scale structure tracer.

Cosmic microwave background↗

DOE OSTI2025

Regional Inertia Estimation Using Actual Event Measurements: Florida Case

As inverter-based resources’ integration in power grids increases, their uneven distribution across the electrical network leads to the formation of local regions that are weakly coupled to the larger interconnection. This signifies the necessity of regional frequency dynamics investigation and analyzing various inertia metrics. This paper presents a practical methodology for estimating regional rate-of-change of frequency (RoCoF) using actual event recordings, which is then used to evaluate regional inertia. Florida (FL) is selected as the region of interest due to its distinct regional frequency dynamics and the rising levels of solar generation. We identify and analyze confirmed events from 2017 to 2024 that occurred in FL. The results indicate that FL contributes about 14% to the total inertia of the US Eastern Interconnection, which approximately matches its share of generation capacity. Results also highlight seasonal fluctuations in energy generation, which play a significant role in influencing inertia and thus the RoCoF levels. This emphasizes the importance of estimating regional inertia to enhance grid operations for a future that focuses on distributed generation.

Dulal, Saurav [University of Tennessee, Knoxville ↗

DOE OSTI2022

Retrieval of the sea spray aerosol mode from submicron particle size distributions and supermicron scattering during LASIC

Abstract. Improved quantification of sea spray aerosol concentration and size is important for determining aerosol effects on clouds and the climate, though attempts to accurately capture the size distribution of the sea spray mode remain limited by the availability of supermicron size distributions. In this work, we introduce a new approach to retrieving lognormal mode fit parameters for a sea spray aerosol mode by combining submicron size distributions with supermicron scattering measurements using a Mie inversion. Submicron size distributions were measured by an ultra-high-sensitivity aerosol spectrometer (UHSAS), and supermicron scattering was taken as the difference between <10 µm and <1 µm three-wavelength integrating nephelometer measurements (NEPH). This UHSAS-NEPH method was applied during background marine periods of the Department of Energy Atmospheric Radiation Measurement Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign on Ascension Island (November 2016–May 2017), when the contribution of sea spray aerosol was expected to represent a large fraction of the aerosol mass and total scattering. Lognormal sea spray modal parameters were retrieved from comparisons between nephelometer measurements and a lookup table of Mie theory-simulated scattering coefficients for low-error solutions that minimized the 0.4–1 µm residual in the UHSAS size distribution. We evaluated the UHSAS-NEPH method with a set of clean marine measurements in the North Atlantic that included supermicron size and chemical measurements, showing that measured supermicron size distributions are needed to constrain the sea spray number concentration but that mass concentration was reasonably characterized using supermicron scattering. For LASIC, the UHSAS-NEPH method retrieved sea spray mode properties for approximately 88 % of the background marine times when the scattering variability and total particle concentration were low (<± 5 Mm−1 and <400 cm−3, respectively), with mass mean diameter ranging from 0.6 to 1.9 µm (1.47 ± 0.17 µm), modal width ranging from 1.1 to 3.97 (2.4±0.3), and mass concentration ranging from 0.18 to 23.0 µg m−3 (8.37. ± 4.1 µg m−3). The measured nephelometer scattering at three wavelengths was found to constrain the mode width marginally at the largest particle sizes in the absence of additional size and chemical measurements for defining parameters for the Mie solutions. Comparing UHSAS-NEPH retrievals to those of a fitting algorithm applied only to the submicron UHSAS number size distribution showed that correlations between retrieved mass concentration and the available mass-based sea spray tracers (coarse scattering, wind speed, and chloride) are low when supermicron measurements are not considered. This work demonstrates the added value of supermicron scattering measurements for retrieving reasonable sea spray mass concentrations, providing the best-available observationally constrained estimate of the sea spray mode properties when supermicron size distribution measurements are not available.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

A Data-Driven Method for Estimating Behind-the-Meter Photovoltaic Generation in Hawaii

Due to the increasing penetration of distributed behind-the-meter photovoltaic (PV) systems and the installed utility revenue metering limited to monitoring only the net power import/export of the household, it is increasingly challenging for utilities to effectively plan and operate the grid. This paper proposes a methodology that estimates behind-the-meter PV generation using a selected subset of monitored PV systems. It is a data-driven approach, and the PV output is estimated utilizing a statistic regression model. A Minimum Redundancy Maximum Relevance (MRMR) algorithm is applied to preselect the optimal subset of the monitored PV systems. The performance of this approach is compared with a spatial interpolation method and a model-based approach. The proposed method is validated using high-resolution meter data recorded from 18 residential rooftop PV systems located on the island of Maui, Hawaii.

Data-driven modeling↗

DOE OSTI2023

Parameter estimation with maximal updated densities

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of “true” parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs “selective regularization” only in the parameter directions not informed by data. Further, the solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters. The first problem utilizes spatial data from a stationary partial differential equation to produce a MUD estimate of an uncertain boundary condition. The second problem utilizes temporal data obtained from the state-of-the-art ADvanced CIRCulation (ADCIRC) model to obtain a MUD estimate of uncertain wind drag coefficients for a simulated extreme weather event near the Shinnecock Inlet located in the Outer Barrier of Long Island, NY, USA.

42 ENGINEERING↗

DOE OSTI2020

Frequency Event Categorization in Power Distribution Systems Using Micro PMU Measurements

Frequency is an important metric for power stability. To enhance the situational awareness in power distribution systems, this article proposes a data-driven approach that utilizes the data from micro phasor measurement units (μPMU) to categorize frequency events observed in distribution feeders. The proposed approach has three layers, each of which analyzes if a frequency event is propagated from the transmission system, formed inside a distribution feeder or falsely produced by instantaneous frequency (IF) estimation algorithms, respectively. In the first layer, the Granger causality is utilized to compare the causal relations from measurements across different locations to decide if an event is propagated from the transmission side. In the second layer, a trained sparse coding dictionary is utilized to unmix the physical causes of a frequency event. In the third layer, a moving z-score based event-pair detector is applied to identify if a frequency event is algorithm-induced. The proposed approach is tested using the μPMU measurements collected from Lawrence Berkeley National Laboratory (LBNL) and Riverside Public Utility (RPU).

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

The Power of DESI for Photometric Redshift Calibration: A Case Study with KiDS-1000

Accurate redshift estimates are a critical requirement for weak lensing surveys and one of the main uncertainties in constraints on dark energy and large-scale cosmic structure. In this paper, we study the potential to calibrate photometric redshift (photo-z) distributions for gravitational lensing using the Dark Energy Spectroscopic Instrument (DESI). Since beginning its science operations in 2021, DESI has collected more than 50 million redshifts, adding about one million monthly. In addition to its large-scale structure samples, DESI has also acquired over 256k high-quality spectroscopic redshifts (spec-zs) in the COSMOS and XMM and VVDS fields. This is already a factor of 3 larger than previous spec-z calibration compilations in these two regions. Here, we explore calibrating photo-zs for the subset of KiDS-1000 galaxies that fall into joint self-organizing map (SOM) cells overlapping the DESI COSMOS footprint using the DESI COSMOS observations. Estimating the redshift distribution in KiDS-1000 with the new DESI data, we find broad consistency with previously published results while also detecting differences in the mean redshift in some tomographic bins with an average shifts of Delta Mean(z) = -0.028 in the mean and Delta Median(z) = +0.011 in the median across tomographic bins. However, we also find that incompleteness per SOM cell, i.e., groups of galaxies with similar colors and magnitudes, can modify n(z) distributions. Finally, we comment on the fact that larger photometric catalogs, aligned with the DESI COSMOS and DESI XMM and VVDS footprints, would be needed to fully exploit the DESI dataset and would extend the coverage to nearly eight times the area of existing 9-band photometry.

Blanco, Diana [UC, Santa Cruz; UC, Santa Cruz, Ins↗

DOE OSTI2020

Lyα Observations of Comet C/2013 A1 (Siding Spring) Using MAVEN IUVS Echelle

The close approach of comet C/2013 A1 (Siding Spring) to Mars in 2014 October provided a unique opportunity to observe a dynamically new Oort cloud comet with potential for interaction with a planet’s atmosphere. The water-originating hydrogen coma of the comet extended to over 20 million km from the nucleus. Determining the properties of this coma contributes to characterizing the comet’s water content and production rate. The present study analyzes a unique data set of high spectral resolution UV observations of comet C/2013 A1 Siding Spring measured by the Mars Atmosphere and Volatile Evolution spacecraft. The Siding Spring observations capture Lyα emissions from the Martian corona, the interplanetary medium, as well as the cometary H and D reservoirs. The isolated cometary spectra are analyzed to reveal a velocity distribution of H atoms that are consistent with model estimates of H{sub 2}O photodissociated H emissions and of OH photodissociated H emissions, Doppler shifted from the main comet H emission line center by 18 km s{sup −1} and 8 km s{sup −1}, respectively. The variations in comet H brightness with distance from the nucleus are used to constrain cometary water production to a rate of 0.5 × 10{sup 28} molecules s{sup −1} at a time when Siding Spring was at 1.5 au, pre-perihelion.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Federated Learning with Frequency Estimation for Smart Meter Systems

Federated learning (FL) is a powerful framework that enables multiple distributed clients to collaborate without the need to transfer their data to a central server. However, FL does not inherently guarantee the level of privacy that clients often require. In our review of recent studies on privacy-enhancing techniques in FL, we found that frequency estimation (FE) methods remain underexplored. To address this gap, we developed and integrated FE techniques on the client side, further examining the effects of incorporating an adaptive range and a shuffled model. We also analyzed the impact of varying hyper-parameters on privacy preservation. Our results provide clear guidance on the algorithms and configurations that are most effective for enhancing privacy in FL, particularly when using long short-term memory (LSTM) architectures.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

DOE OSTI2025

Bayesian Inference for the Seismic Moment Tensor Using Regional Waveforms and Teleseismic- P Polarities with a Data-Derived Distribution of Velocity Models and Source Locations

The largest source of uncertainty in any source inversion is the velocity model used in the transfer function that relates observed ground motion to the seismic moment tensor. However, standard inverse procedure often does not quantify uncertainty in the seismic moment tensor due to error in the Green’s functions from uncertain event location and Earth structure. Here, we incorporate this uncertainty into an estimation of the seismic moment tensor using a data-derived distribution of velocity models based on complementary geophysical data sets, including thickness constraints, velocity profiles, gravity data, surface-wave group velocities, and regional body-wave travel times. The data-derived distribution of velocity models is then used as a prior distribution of Green’s functions for use in Bayesian inference of an unknown seismic moment tensor using regional and teleseismic-P waveforms. The use of multiple data sets is important for gaining resolution to different components of the moment tensor. The combined likelihood is estimated using data-specific error models and the posterior of the seismic moment tensor is estimated and interpreted in terms of the most probable source type.

58 GEOSCIENCES↗

DOE OSTI2024

Entanglement Capacity Estimates and Throughput Measurements of Quantum Channels

The throughput is an important performance metric of entangled qubit distribution quantum networks, and may be characterized by the number of distributed entangled qubit pairs per second (ebps). It is measured over physical quantum network connections using specialized instruments, including photonic entanglement sources and single photon detectors. Extensive theory has been developed to estimate the entangled qubit capacity of quantum channels using abstractions of physical connections. These two quantities both characterize the throughput performance but in different ways, and typically have been hard to relate to each other in concrete terms, in part due to the lack of precise measurements with matching analytical models and derivations. We describe measurements on a physical testbed with fiber connections of lengths 0-75 kilometers. We obtain the normalized analytic capacity estimates using the transmissivity approximations derived using single photon coincidence measurements, and convert them to bounds on throughput (measured in ebps) using a multiplier derived from co-located detector measurements. The results indicate consistent throughput measurements upper-bounded by their analytical capacity estimates across all connections. We show that previous capacity estimates using light measurements are below ebps measurements for some connections, due to the inclusion of non-representative decrease of light levels outside C-band with distance.

Rao, Nageswara↗

DOE OSTI2023

Model-Free Probabilistic Forecasting of Nodal Voltages in Distribution Systems

As the penetration of distributed energy resources (DERs) into distribution systems increases, so does the interest in forecasting relevant system variables to help mitigate the associated challenges. One such challenge is the more frequent occurrence of excessive voltages in distribution systems with higher shares of DERs. Accurate and reliable estimates together with forecasts of system states (i.e., nodal voltages) will therefore play a key role in improving the utilization of these variable and uncertain sources while mitigating potential operational risks. Whilst recent literature has explored machine learning (ML) methods for voltage estimation and their extrapolation for a short-time period into the future, few have taken uncertainty quantification into account, and these methods have not yet been translated into operations. This paper discusses the advantages offered by probabilistic voltage forecasts and proposes a non-parametric Bayesian method suitable for forecasting nodal voltages at short-term time horizons while accounting for uncertainties in load and distributed photovoltaic (PV) generation. We demonstrate the value of the proposed Gaussian process (GP) model for a case study using historical forecasts and observation data.

distribution system↗