Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Scalable Meter Placement Method for Distribution System State Estimation

This paper studies the optimal meter placement problem for distribution system state estimation given limited measurement resources. We formulate the problem as a mixed integer semi-definite programming that minimizes the worst case estimation errors over a set of operating points. To solve the problem, we first relax the problem as a convex optimization problem. Motivated by the lack of scalability of existing solvers, we next leverage the special structure of the cost function and propose an algorithm based on barrier method that solves the problem with significantly better numerical performance. The proposed method has been validated on the IEEE 13-bus, IEEE 123-bus, and IEEE 8,500-bus feeders.

barrier method↗
NASA NTRS2026

Global Model Estimates of Atmospheric Al, Ca, Fe, Si, and Ti from Dust and Non-Dust Aerosols Informed by EMIT Surface Mineralogy and Evaluated Against Observations

Atmospheric deposition of micro-nutrients like Fe has been shown to be important for ocean biogeochemistry. The largest source of atmospheric Fe and other elements (e.g., Ca, Al, Si, and Ti) is desert dust, although there are significant non-dust sources in some regions. However, past estimates of these elements have been substantially uncertain due to limited information about the composition of the desert source regions. Here we use elemental distributions estimated from new Earth Surface Mineral Dust Source Investigation (EMIT) observations, which provide mineralogical composition at the surface of the Earth based on imaging spectroscopy measurements from the International Space Station. We add in other sources of these elements (anthropogenic and natural) and compare to a compilation of available surface concentration data from stations over land and from shipborne observations. Our results suggest that the modeled distribution is similar to available observations, but discrepancies still exist in both natural desert dust regions as well as regions dominated by anthropogenic sources. Global budgets for the elements Ca, Al, Fe, Si, and Ti suggest that desert dust remains the dominant source for these elements but anthropogenic or volcanic sources are also important for these elements. Changes in elemental distributions since preindustrial times were also estimated.

aerosols↗
DOE OSTI2021

Decentralized Low-Rank State Estimation for Power Distribution Systems

This article considers the low-observability state estimation problem in power distribution networks and develops a decentralized state estimation algorithm leveraging the matrix completion methodology. Matrix completion has been shown to be an effective technique in state estimation that exploits the low dimensionality of the power system measurements to recover missing information. This technique can utilize an approximate (linear) load flow model, or it can be used with no physical models in a network where no information about the topology or line admittance is available. The direct application of matrix completion algorithms requires solving a semi-definite programming (SDP) problem, which becomes computationally challenging for large networks. We therefore develop a decentralized algorithm that capitalizes on the popular proximal alternating direction method of multipliers (proximal ADMM). The method allows us to distribute the computation among different areas of the network, leading to a scalable algorithm. By doing all computations at individual control areas and only communicating with neighboring areas, the algorithm eliminates the need for data to be sent to a central processing unit and thus increases efficiency and contributes to the goal of autonomous control of distribution networks. We illustrate the advantages of the proposed algorithm numerically using standard IEEE test cases.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

Statistical Behavior of Low-Amplitude Power System Point-on-Wave Measurements

The power grid is undergoing massive changes to ensure resiliency and reliability in a more decentralized world. Distributed energy resources are becoming a prominent source of generation, potentially leading to a lack of centralized generation sources. Due to these new behaviors and system topologies, it is important to install measurement devices that are 1) accurate and 2) self-aware of their measurement quality. In this paper, a residential-scale microgrid is used to generate voltage and current waveforms, captured by Verivolt and National Instruments measurement equipment. A least-squares approach is used to separate the “clean” signals from the noise. Finally, Gaussian mixture modeling is used to approximate noise distributions, and it is shown these higher-order distribution estimates are a better fit to voltage and current noise profiles than single-mode Gaussian estimates.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2001

Estimating Bias Error Distributions

This paper formulates the general methodology for estimating the bias error distribution of a device in a measuring domain from less accurate measurements when a minimal number of standard values (typically two values) are available. A new perspective is that the bias error distribution can be found as a solution of an intrinsic functional equation in a domain. Based on this theory, the scaling- and translation-based methods for determining the bias error distribution arc developed. These methods are virtually applicable to any device as long as the bias error distribution of the device can be sufficiently described by a power series (a polynomial) or a Fourier series in a domain. These methods have been validated through computational simulations and laboratory calibration experiments for a number of different devices.

Liu, Tian-Shu↗
DOE OSTI2021

Joint Topology Identification and State Estimation in Unobservable Distribution Grids

Many distribution system operations (e.g., state estimation, control, fault detection/localization) rely on the assumption that the underlying topology is accurately defined. In general, topology identification is a challenging problem in distribution systems as these systems are unobservable with a very limited number of available measurements. In this paper, we tackle this problem by designing a compressive sensing framework that jointly estimates the systems states and network topology via an integrated mixed integer nonlinear program (MINLP) formulation. Here, two reformulations of the original MINLP problems are investigated. Firstly, in order to remove the nonlinearity in the MINLP formulation, a mixed integer linear programming (MILP) problem that employs auxiliary variables is derived. Furthermore, to achieve a faster solution, convex relaxation of the original formulation is derived. Finally, using a Markovian model for topology changes, prior information about system topology is used to improve topology identification particularly when a limited amount of measurements is available. Simulation results on IEEE 37-bus test feeder and IEEE 123-bus test feeder illustrate the efficiency and scalability of the proposed approaches from both state estimation and topology identification point of view (even with 30% of available data).

42 ENGINEERING↗
DOE OSTI2021

Multi-Area Distribution System State Estimation Using Decentralized Physics-Aware Neural Networks

The development of active distribution grids requires more accurate and lower computational cost state estimation. In this paper, the authors investigate a decentralized learning-based distribution system state estimation (DSSE) approach for large distribution grids. The proposed approach decomposes the feeder-level DSSE into subarea-level estimation problems that can be solved independently. The proposed method is decentralized pruned physics-aware neural network (D-P2N2). The physical grid topology is used to parsimoniously design the connections between different hidden layers of the D-P2N2. Monte Carlo simulations based on one-year of load consumption data collected from smart meters for a three-phase distribution system power flow are developed to generate the measurement and voltage state data. The IEEE 123-node system is selected as the test network to benchmark the proposed algorithm against the classic weighted least squares and state-of-the-art learning-based DSSE approaches. Numerical results show that the D-P2N2 outperforms the state-of-the-art methods in terms of estimation accuracy and computational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

On the Solution of ℓ 0 -Constrained Sparse Inverse Covariance Estimation Problems

The sparse inverse covariance matrix is used to model conditional dependencies between variables in a graphical model to fit a multivariate Gaussian distribution. Estimating the matrix from data are well known to be computationally expensive for large-scale problems. Sparsity is employed to handle noise in the data and to promote interpretability of a learning model. Although the use of a convex ℓ 1 regularizer to encourage sparsity is common practice, the combinatorial ℓ 0 penalty often has more favorable statistical properties. In this paper, we directly constrain sparsity by specifying a maximally allowable number of nonzeros, in other words, by imposing an ℓ 0 constraint. Here, we introduce an efficient approximate Newton algorithm using warm starts for solving the nonconvex ℓ 0 -constrained inverse covariance learning problem. Numerical experiments on standard data sets show that the performance of the proposed algorithm is competitive with state-of-the-art methods.

$\ell_0$-Constrained↗
DOE OSTI2023

CACTI: Best Estimate Aerosol Size Distribution by airborne measurements

These data were collected during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI; https://www.arm.gov/research/campaigns/amf2018cacti ) field campaign in the Sierras de Córdoba mountain range of north-central Argentina as part of ARM Aerial Facility (AAF) deployment. The ARM Aerial Facility Gulfstream-1 was operated from Las Higueras Airport (IATA: RCU, ICAO: SAOC), Río Cuarto, Córdoba, Argentina, for the Intensive Observation Period (IOP) from Nov. 1 through Dec. 15, 2018. The G-1 aircraft performed 22 research flights over the first ARM Mobile Facility (AMF1) location in the Sierras de Córdoba mountain range to measure atmospheric state and turbulence, cloud water content and droplet size distributions, aerosol precursor gases, aerosol chemical composition and size distributions. The current data set presents Best Estimate Aerosol Size Distribution: a merged aerosol size distribution composed of the data from 5 sensors; three aerosol spectrometers: Scanning Mobility Particle Sizer (SMPS), Ultra-High Sensitivity Aerosol Spectrometer (UHSAS), and Passive Cavity Aerosol Spectrometer (PCASP); and two cloud probes: Cloud Aerosol Spectrometer (CAS) and Fast Cloud Droplet Probe (FCDP). The SMPS data were interpolated to 1 second from “native” time resolution of about 64 second to match all other probes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

NPFTURBULENCE: Best Estimate Aerosol Size Distribution by airborne measurements

The original data were collected during the field campaign of “Turbulent layers promoting New Particle Formation” experiment (NPFTURBULENCE; https://www.arm.gov/research/campaigns/aaf2024npfturbulence) over the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) Atmospheric Observatory (https://www.arm.gov/capabilities/observatories/sgp ) in north-central Oklahoma. The ARM Aerial Facility ArcticShark uncrewed aerial system (UAS) was based at Blackwell–Tonkawa Municipal Airport (IATA: BWL, ICAO: KBKN, FAA LID: BKN, 36.74475° N, 97.34918° W, 313.9 m MSL), for the field campaign from May 5 through May 29, 2024. The ArcticShark UAS performed 11 flights, including 10 research flights over the Central Facility of the ARM SGP to measure atmospheric state, turbulence, surface IT temperature and imagery, aerosol number concentration and size distribution. The current data set presents Best Estimate Aerosol Size Distribution: a merged aerosol size distribution composed of the data from 2 sensors: miniaturized Scanning Electrical Mobility Sizer (mSEMS) and Portable Optical Particle Spectrometer (POPS). The mSEMS data were interpolated to 1 second from “native” time resolution of about 15 second to match the other probe. The POPS data were converted from equivalent optical size into geometric size using value of aerosol refractive index of 1.477 from the HISCALE field campaign (same geographical area, altitudes, and time of year; http://www.arm.gov/campaigns/aaf2016hiscale ).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1988

Rainfall index over oceans derived from SSM/I data

Ths Special Sensor Microwave/Imager radiometer on board the DMSP satellite measured microwave radiation at 19.35, 22.235, 37.0, and 85.5 GHz with a swath width of 1400 km, providing an opportunity to study global precipitation distributions. A monthly averaged rainfall index was derived using only the 19.35 GHz data. It covers the + or - 50 deg portion of the world with a 5 deg x 5 deg grid. The brightness temperature histogram is analyzed to derive the rainfall distribution. Estimates of the freezing level heights and the water vapor contents are utilized to understand the rainfall distribution better. Log normal and gamma distribution functions are fitted to the data and the derived monthly rainfall index compares favorably with historical precipitation patterns.

Chang, A. T. C.↗
DOE OSTI2023

Evaluating Retention Index Score Assumptions to Refine GC–MS Metabolite Identification

As metabolomics grows into a high-throughput and high demand research field, current metrics for the identification of small molecules in gas chromatography–mass spectrometry (GC–MS) still require manual verification. Though steps have been taken to improve scoring metrics by combining spectral similarity (SS) and retention index (RI), the problem persists. A large body of literature has analyzed and refined SS scores, but few studies have explicitly studied improvements to RI scores. Here, in this study, we examined whether uninvestigated assumptions of the RI score are valid and propose ways to improve them. Query RIs were matched to library RI with a generous window of ±35 to avoid unintentional removal of valid compound identifications. Each match was manually verified as a true positive (TP), true negative, or unknown. Metabolites with at least 30 TP identifications were included in downstream analyses, resulting in a total of 87 metabolites from samples of varying complexity and type (e.g., amino acid mixtures, human urine, fungal species, and so on.). Our results showed that the RI score assumptions of normality, consistent variance across metabolites, and a mean error centered at 0 are often violated. We demonstrated through a cross-validation analysis that modifying these underlying assumptions according to empirical metabolite-specific distributions improved the TP and negative rankings. Further, we statistically determined the minimum number of samples required to estimate distributional parameters for scoring metrics. Overall, this work proposes a robust statistical pipeline to reduce the time bottleneck of metabolite identification by improving RI scores and thus minimize the effort to complete manual verification.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

An Online Joint Optimization–Estimation Architecture for Distribution Networks

Here in this article, we propose an optimal joint optimization-estimation architecture for distribution networks, which jointly solves the optimal power flow (OPF) problem and static state estimation (SE) problem through an online gradient-based feedback algorithm. The main objective is to enable a fast and timely interaction between the OPF decisions and state estimators with limited sensor measurements. First, convergence and optimality of the proposed algorithm are analytically established. Then, the proposed gradient-based algorithm is modified by introducing statistical information of the inherent estimation and linearization errors for an improved and robust performance of the online OPF decisions. Overall, the proposed method eliminates the traditional separation of operation and monitoring, where optimization and estimation usually operate at distinct layers and different time scales. Hence, it enables a computationally affordable, efficient, and robust online operational framework for distribution networks under time-varying settings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2022

Development of a “Nature Run” for Observing System Simulation Experiments (OSSEs) for Snow Mission Development

Snow is a fundamental component of global and regional water budgets, particularly in mountainous areas and regions downstream that rely on snowmelt for water resources. Land surface models (LSMs) are commonly used to develop spatially distributed estimates of snow water equivalent (SWE) and runoff. However, LSMs are limited by uncertainties in model physics and parameters, among other factors. In this study, we describe the use of model calibration tools to improve snow simulations within the Noah-MP LSM as the first step in an observing system simulation experiment (OSSE). Noah-MP is calibrated against the University of Arizona (UA) SWE product over a western Colorado domain. With spatially varying calibrated parameters, we run calibrated and default Noah-MP simulations for water years 2010–20. By evaluating both simulations against the UA dataset, we show that calibration decreases domain averaged temporal RMSE and bias for snow depth from 0.15 to 0.13 m and from −0.036 to −0.0023 m, respectively, and improves the timing of snow ablation. Increased snow simulation performance also improves estimates of model-simulated runoff in four of six study basins, though only one has statistically significant improvement. Spatially distributed Noah-MP snow parameters perform better than default uniform values. We demonstrate that calibrating variables related to snow albedo calculations and rain–snow partitioning, among other processes, is a necessary step for creating a nature run that reasonably approximates true snow conditions for the OSSEs. Additionally, the inclusion of a snowfall scaling term can address biases in precipitation from meteorological forcing datasets, further improving the utility of LSMs for generating reliable spatiotemporal estimates of snow.

Melissa L. Wrzesien↗
NASA NTRS2005

Tools for Basic Statistical Analysis

Statistical Analysis Toolset is a collection of eight Microsoft Excel spreadsheet programs, each of which performs calculations pertaining to an aspect of statistical analysis. These programs present input and output data in user-friendly, menu-driven formats, with automatic execution. The following types of calculations are performed: Descriptive statistics are computed for a set of data x(i) (i = 1, 2, 3 . . . ) entered by the user. Normal Distribution Estimates will calculate the statistical value that corresponds to cumulative probability values, given a sample mean and standard deviation of the normal distribution. Normal Distribution from two Data Points will extend and generate a cumulative normal distribution for the user, given two data points and their associated probability values. Two programs perform two-way analysis of variance (ANOVA) with no replication or generalized ANOVA for two factors with four levels and three repetitions. Linear Regression-ANOVA will curvefit data to the linear equation y=f(x) and will do an ANOVA to check its significance.

Luz, Paul L.↗