Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Phase Identification in Real Distribution Networks with High PV Penetration Using Advanced Metering Infrastructure Data: Preprint

Many distribution network monitoring and control applications - including state estimation, volt/VAR optimization, and network reconfiguration - rely on accurate network models; however, the network models maintained by utilities can become outdated because of restoration activities, network reconfiguration, and missing data. With the widespread deployment of advanced metering infrastructure (AMI), abundant measurement data from low-voltage secondary networks are available. The AMI measurement data can be used for phase identification to improve the network models. Although the existing phase identification techniques work well in passive distribution feeders that do not have photovoltaic (PV) generation, they can fail to accurately identify the phases in the presence of PV. This paper proposes a robust phase identification algorithm based on supervised machine learning that accurately identifies the AMI meter phase connectivity in the presence of significant PV generation. The proposed algorithm does not require network topology information or feeder head measurement data. The algorithm is validated using the AMI measurement data collected in the field and the field-validated phase connectivity database on two real distribution feeders from San Diego Gas & Electric Company that have significant PV generation.

advanced metering infrastructure↗
DOE OSTI2022

Phase Identification in Real Distribution Networks with High PV Penetration Using Advanced Metering Infrastructure Data

Many distribution network monitoring and control applications - including state estimation, Volt/VAr optimization, and network reconfiguration - rely on accurate network models; however, the network models maintained by utilities can become outdated because of restoration activities, network reconfiguration, and missing data. With the widespread deployment of advanced metering infrastructure (AMI), abundant measurement data from low-voltage secondary networks are available. The AMI measurement data can be used for phase identification to improve the network models. Although the existing phase identification techniques work well in passive distribution feeders that do not have photovoltaic (PV) generation, they can fail to accurately identify the phases in the presence of PV. This paper proposes a robust phase identification algorithm based on supervised machine learning that accurately identifies the AMI meter phase connectivity in the presence of significant PV generation. The proposed algorithm does not require network topology information or feeder-head measurement data. The algorithm is validated using the AMI measurement data collected in the field and the field-validated phase connectivity database on two real distribution feeders from San Diego Gas & Electric Company that have significant PV generation.

advanced metering infrastructure (AMI)↗
DOE OSTI2023

nautilus : boosting Bayesian importance nested sampling with deep learning

ABSTRACT We introduce a novel approach to boost the efficiency of the importance nested sampling (INS) technique for Bayesian posterior and evidence estimation using deep learning. Unlike rejection-based sampling methods such as vanilla nested sampling (NS) or Markov chain Monte Carlo (MCMC) algorithms, importance sampling techniques can use all likelihood evaluations for posterior and evidence estimation. However, for efficient importance sampling, one needs proposal distributions that closely mimic the posterior distributions. We show how to combine INS with deep learning via neural network regression to accomplish this task. We also introduce nautilus, a reference open-source python implementation of this technique for Bayesian posterior and evidence estimation. We compare nautilus against popular NS and MCMC packages, including emcee, dynesty, ultranest, and pocomc, on a variety of challenging synthetic problems and real-world applications in exoplanet detection, galaxy SED fitting and cosmology. In all applications, the sampling efficiency of nautilus is substantially higher than that of all other samplers, often by more than an order of magnitude. Simultaneously, nautilus delivers highly accurate results and needs fewer likelihood evaluations than all other samplers tested. We also show that nautilus has good scaling with the dimensionality of the likelihood and is easily parallelizable to many CPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Hydropower potential derived from streamflow extremes for Alaska, USA

Alaska is an expansive region known for its abundant natural resources, including thousands of miles of streams and rivers. These rivers represent potential opportunities for future hydropower development that could provide reliable energy supply for local communities. There is limited long-term high temporal resolution streamflow data available for the region, making data-driven estimates of potential hydropower and its variability across the state challenging. This study provides a novel data-driven approach for hydropower capacity estimation across Alaska. We use supervised machine learning to develop a relationship between the daily and peak flow duration curves in order to augment the size of our dataset from 44 sites to 67 sites. We perform a stochastic hydropower estimation across the 67 sites and identify approximately 1000 MW of total potential hydropower capacity distributed across these sites. Our study provides the first step towards more comprehensive hydropower estimation for this critical region, highlighting the need for future work integrating high-resolution spatial data, community needs, and economic constraints in estimates of potential hydropower development in Alaska.

Hydropower↗
DOE OSTI2021

Bayesian Optimal Sensor Augmentation Via Estimated Mutual Information

We consider the problem of designing a sensor network to most efficiently locate the source of a seismic event. The left panel of Figure 1 shows 982 possible sensor locations in a region of interest. The objective is to infer the unknown location of an earthquake, indicated by the gold dot for illustration purposes. Assume that three sensors have already been placed for data collection. Travel times of the P-wave from the source to the three sensors are observed and used to infer the unknown source location via a Bayesian statistical model described subsequently. The right panel of Figure 1 shows samples from the resulting posterior distribution for source location along with a posterior estimate of this location.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Robust Real-Time Modeling of Distribution Systems with Data-Driven Grid-Wise Observability (Final Technical Report)

The overall objective of this project is to leverage existing and emerging sensor measurements to develop data-driven observability enhancement algorithms as well as robust state estimation and parameter identification techniques to enable real-time grid-wise monitoring and modeling of loads and distributed energy resources (DERs). The project resulted in a holistic framework with the following key components: 1) data-driven and machine learning-based grid-edge visibility enhancement, 2) robust branch-current-based state estimation (BCSE), and 3) robust real-time steady-state and dynamic-state modeling of loads and DERs. The research outcomes have provided utility companies better network visibility, higher-fidelity load/DER models, and more accurate assessment of DERs’ impacts, thus, facilitating the integration of renewable energy sources. The synergistic collaborative project among Iowa State University (ISU), Argonne National Laboratory (ANL), Electric Power Research Center (EPRC), SIEMENS Industry, Alliant Energy, Cedar Falls Utilities (CFU), and Maquoketa Valley Electric Cooperative (MVEC) to leverage the team’s extensive expertise and experience in power distribution systems, state estimation, online modeling and identification, and DER integrations. The proposed frameworks have been verified with industry adopted software and attempted integrated with existing tool wherever possible

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Performance Evaluation of an Advanced Distributed Energy Resource Management Algorithm

This paper presents performance evaluation of a new distributed energy resource management system (DERMS) algorithm via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of sub-transmission and distribution networks, the DERMS software controller, and 84 power hardware solar photovoltaic (PV) inverters, standard communication protocols, and a capacitor bank controller. The DERMS algorithm is also called, Grid-Optimization of Solar (GO-Solar) platform which includes predictive state estimation (PSE) and online multiple objective optimization (OMOO) to dispatch the legacy devices and distributed energy resources (e.g., PV). The voltage regulation performance is evaluated under three scenarios, volt-var smart inverter (baseline), and DERMS control for 100% and 30% of PV. The results show that controlling 30% of PV systems with the GO-Solar platform may provide the best balance of control performance and implementation cost.

distributed energy resource management system (DER↗
DOE OSTI2020

Misclassification of primary liver cancer in the Life Span Study of atomic bomb survivors

Primary liver cancer is difficult to diagnose accurately at death, due to metastases from nearby organs and to concomitant diseases, such as chronic hepatitis and cirrhosis. Trends in diagnostic accuracy could affect radiation risk estimates for incident liver cancer by altering background rates or by impacting risk modification by sex and age. We quantified the potential impact of death‐certificate inaccuracies on radiation risk estimates for liver cancer in the Life Span Study of atomic bomb survivors. True‐positive and false‐negative rates were obtained from a previous study that compared death‐certificate causes of death with those based on pathological review, from 1958 to 1987. We assumed various scenarios for misclassification rates after 1987. We obtained estimated true positives and estimated false negatives by stratified sampling from binomial distributions with probabilities given by the true‐positive and false‐negative rates, respectively. Poisson regression methods were applied to highly stratified person‐year tables of corrected case counts and accrued person years. During the study period (1958–2009), there were 1,885 cases of liver cancer, which included 383 death‐certificate‐only (DCO) cases; 1,283 cases with chronic liver disease as the underlying cause of death; and 150 DCO cases of pancreatic cancer among 105,444 study participants. Across the range of scenarios considered, radiation risk estimates based on corrected case counts were attenuated, on average, by 13–30%. Our results indicated that radiation risk estimates for liver cancer were potentially sensitive to death‐certificate inaccuracies. Additional data are needed to inform misclassification rates in recent years.

French, Benjamin↗
DOE OSTI2023

Bayesian Parameter Estimation of the k-ω Shear Stress Transport Model for Accurate Simulations of Impinging-Jet Heat Transfer

Given the lack of fusion-relevant component test facilities, current estimates of the thermo-fluid performance of plasma-facing components are based for the most part on numerical simulations. A major source of uncertainty in these simulations is the semiempirical turbulence (closure) models for the Reynolds stresses appearing in the governing Reynolds-averaged Navier-Stokes equations, which involve a set of constants that depend upon the flow. The objective of this study is to evaluate Bayesian parameter estimation of turbulence closure constants in ANSYS Fluent to model heat transfer in impinging jets. The Bayesian statistical calibration produces a probability distribution for these constants from experimental data; the maximum a posteriori estimates are then taken to be the calibrated constants, or parameters. The turbulence model constants are calibrated using an experimental study of a submerged jet of air impinging on a flat heated surface at Reynolds numbers Re = O(10 4 ) and impingement distance in jet diameters H/d = 2. Numerical predictions using the calibrated model parameters are then compared with those generated using the default constants. Predictions obtained with model parameters calibrated on datasets of two different sizes are compared to evaluate the effect of the number of calibration samples. Lastly, the extrapolative ability of the calibrated model is examined by predictions at a Re beyond the calibration values.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

A semi-supervised learning method to produce explainable radioisotope proportion estimates for NaI-based synthetic and measured gamma spectra

Quantifying the radioactive sources present in gamma spectra is an ever-present and growing national security mission and a time-consuming process for human analysts. While machine learning models exist that are trained to estimate radioisotope proportions in gamma spectra, few address the eventual need to provide explanatory outputs beyond the estimation task. In this work, we develop two machine learning models for a NaI detector measurements: one to perform the estimation task, and the other to characterize the first model’s ability to provide reasonable estimates. To ensure the first model exhibits a behavior that can be characterized by the second model, the first model is trained using a custom, semi-supervised loss function which constrains proportion estimates to be explainable in terms of a spectral reconstruction. The second auxiliary model is an out-of-distribution detection function (a type of meta-model) leveraging the proportion estimates of the first model to identify when a spectrum is sufficiently unique from the training domain and thus is out-of-scope for the model. In demonstrating the efficacy of this approach, we encourage the use of meta-models to better explain ML outputs used in radiation detection and increase trust.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Joint state-parameter estimation for the reduced fracture model via the united filter

Here, in this paper, we introduce an effective United Filter method for jointly estimating the solution state and physical parameters in flow and transport problems within fractured porous media. Fluid flow and transport in fractured porous media are critical in subsurface hydrology, geophysics, and reservoir geomechanics. Reduced fracture models, which represent fractures as lower-dimensional interfaces, enable efficient multi-scale simulations. However, reduced fracture models also face accuracy challenges due to modeling errors and uncertainties in physical parameters such as permeability and fracture geometry. To address these challenges, we propose a United Filter method, which integrates the Ensemble Score Filter (EnSF) for state estimation with the Direct Filter for parameter estimation. EnSF, based on a score-based diffusion model framework, produces ensemble representations of the state distribution without deep learning. Meanwhile, the Direct Filter, a recursive Bayesian inference method, estimates parameters directly from state observations. The United Filter combines these methods iteratively: EnSF estimates are used to refine parameter values, which are then fed back to improve state estimation. Numerical experiments demonstrate that the United Filter method surpasses the state-of-the-art Augmented Ensemble Kalman Filter, delivering more accurate state and parameter estimation for reduced fracture models. This framework also provides a robust and efficient solution for PDE-constrained inverse problems with uncertainties and sparse observations.

Bayesian inference↗
DOE OSTI2021

Improved Convective Ice Microphysics Parameterization in the NCAR CAM Model

Partitioning deep convective cloud condensates into components that sediment and detrain, known to be a challenge for global climate models, is important for cloud vertical distribution and anvil cloud formation. In this study, we address this issue by improving the convective microphysics scheme in the National Center for Atmospheric Research Community Atmosphere Model version 5.3 (CAM5.3). The improvements include: (1) considering sedimentation for cloud ice crystals that do not fall in the original scheme, (2) applying a new terminal velocity parameterization that depends on the environmental conditions for convective snow, (3) adding a new hydrometeor category, “rimed ice,” to the original four-class (cloud liquid, cloud ice, rain, and snow) scheme, and (4) allowing convective clouds to detrain snow particles into stratiform clouds. Results from the default and modified CAM5.3 models were evaluated against observations from the U.S. Department of Energy Tropical Warm Pool-International Cloud Experiment (TWP-ICE) field campaign. The default model overestimates ice amount, which is largely attributed to the underestimation of convective ice particle sedimentation. By considering cloud ice sedimentation and rimed ice particles and applying a new convective snow terminal velocity parameterization, the vertical distribution of ice amount is much improved in the midtroposphere and upper troposphere when compared to observations. The vertical distribution of ice condensate also agrees well with observational best estimates upon considering snow detrainment. Further, comparison with observed convective updrafts reveals that current bulk model fails to reproduce the observed updraft magnitude and occurrence frequency, suggesting spectral distributions be required to simulate the subgrid updraft heterogeneity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Field Measurement and Analysis of Frequency and RoCoF for Low-Inertia Power Systems

The frequency measurement and rate of change of frequency (RoCoF) calculations are important for active power, frequency control, and frequency-related protection in power system operations. With the rapid decrease in inertia under modern power systems, however, multiple power variations introduced by variable renewable energy bring large RoCoF and introduce oscillations in frequency measurements. To shed light on this issue, this article proposes a frequency measurement and RoCoF analysis technology, as well as the sensitivity analysis for the real low-inertia power grid. First, a real-world event in an island power grid is analyzed as an example, and an event numerical model is estimated considering four uncertainties, including event RoCoF, oscillation magnitude, oscillation frequency, and underfrequency load-shedding threshold. Then, a sensitivity analysis is performed using the Sobol indices method and quasi-Monte Carlo simulations to identify the dominant uncertainties based on the event model. Here, the dominant uncertainties are compared to provide a guideline for the frequency estimation algorithm selection under different event cases. This algorithm is compared with an enhanced zero-crossing algorithm and gives a 3.41% better RoCoF error rate. Finally, an experiment is conducted using universal grid analyzers to validate the simulation results and the theoretical analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

PV Hosting Capacity Estimation: Experiences with Scalable Framework

Hosting capacity is an indication of the amount of solar photovoltaics (PV) that can be hosted in a distribution system without additional changes to infrastructure or oper-ations. This paper presents a framework for estimating the PV hosting capacity at scale. First, we analyze computational, modeling and other key challenges of performing relevant, large-scale simulations, provided along with the experiences and lessons learned. Then, we develop two open-source Python-based software tools to conduct repeatable distribution analyses: the Distribution Integration Solution Cost Options (DISCO) for configuring and analyzing simulations and the Job Automation and Deployment Engine (JADE) for parallelizing jobs on high-performance computing clusters. A case study of hosting capacity estimation for the SMART-DS San Francisco (SFO) 2000+ synthetic feeders, is used to demonstrate the capability of the developed DISCO+JADE framework and tools. The framework and tools can help utilities assess the overall hosting capacity of their service territory, which can help them better plan for the overall upgrade costs to integrate more PV in the future. The experiences are shared to aid the tool users and researchers to conduct relevant studies and research.

distributed energy resources↗
DOE OSTI2021

Distributed Maneuver Planning With Connected and Automated Vehicles for Boosting Traffic Efficiency

Connected and automated vehicles (CAVs) have the potential to improve traffic throughput and achieve a more efficient utilization of the available roadway infrastructure. They also have the potential to reduce energy consumption through traffic motion harmonization, even when operating in mixed traffic with other human-driven vehicles. The key to realizing these potentials are coordinated control schemes that can be implemented in a distributed manner with the CAVs. In this paper, we propose a distributed predictive control framework that features a two-dimensional maneuver planner incorporating explicit coordination constraints between connected vehicles operating in mixed traffic at various penetration levels. Here, the framework includes a distributed implementation of a reference speed assigner that estimates local traffic speed from on-board measurements and communicated information. We present an extensive evaluation of the proposed framework in traffic micro-simulations at various CAV penetrations from traffic flow, energy use, and lane utilization points of view. Results are compared to a baseline scenario with no CAVs, as well as, a benchmark one-dimensional planner.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Multilevel Monte Carlo Predictions of First Passage Times in Three-Dimensional Discrete Fracture Networks: A Graph-Based Approach

In this paper, we present a method combining multilevel Monte Carlo (MLMC) and a graph-based primary subnetwork identification algorithm to provide estimates of the mean and variance of the distribution of first passage times in fracture media at significantly lower computational cost than standard Monte Carlo (MC) methods. Simulations of solute transport are performed using a discrete fracture network (DFN), and instead of using various grid resolutions for levels in the MLMC, which is standard practice in MLMC, we identify a hierarchy of subnetworks in the DFN based on the shortest topological paths through the network using a graph-based method. While the mean of these ensembles is of critical importance, the variance is also essential in fractured media where uncertainty is an overarching theme, and understanding variability across an ensemble is a requirement for safety assessments. The method provides good estimates of the mean and variance at two orders of magnitude lower computational cost than MC.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Insights into the year-round vertical distribution of chlorophyll concentration in high-latitude Arctic Ocean: implications for primary production

Climate-induced rapid changes in the Arctic Ocean, such as decreasing sea ice extent and increasing water temperature, are altering nutrient and light availability, profoundly impacting primary producer growth. However, access to the high-latitude Arctic Ocean is limited, and satellite data are primarily available only during summer, making continuous in-situ data collection challenging. We collected year-round chlorophyll-a (Chl-a) concentration data in high-latitude regions using a mooring system and performed a comparative analysis with reanalysis data. Unlike previous satellite-based studies, which typically rely on surface measurements, we used the annual vertical distribution of Chl-a. These data were applied to the vertically generalized production model to accurately estimate annual primary production. The moored Chl-a concentration data showed that phytoplankton exhibited a typical subsurface chlorophyll maximum (SCM) layer as sea ice retreated in June. Contrary to the gradually deepening SCM distribution predicted by model-based reanalysis data, the SCM layer persisted for approximately 4 months. This indicates that light and nutrient conditions within the SCM layer remained stable, sustaining continuous phytoplankton growth. Annual primary production, reflecting this vertical distribution of Chl-a concentration, was 6.85 gC m −2 yr −1 . This exceeded satellite-based estimates by at least two-fold, highlighting the significant underestimation of primary production by satellite approaches. Estimating primary production while accounting for the vertical distribution of phytoplankton and light is essential for improving ecological models to better understand carbon cycle and food web changes in the Arctic Ocean, with important implications for climate change predictions.

Arctic Ocean↗
DOE OSTI2025

Different methods of estimating riverbed sediment grain size diverge at the basin scale

Introduction: The distribution of sediment grain size in streams and rivers is often quantified by the median grain size (D50), a key metric for understanding and predicting hydrologic and biogeochemical function of streams and rivers. Manual D50 measurements are time-consuming and ignore larger grains, while approaches to model D50 based on catchment characteristics may over-generalize and miss site-scale heterogeneity. Machine learning-enabled object detection methods like You Only Look Once (YOLO) provides an alternative that enables estimation of D50 that is faster than manual measurements and more site-specific than predictions based on catchment characteristics. Methods: To understand the potential role of object detection methods for improving understanding of D50, we compared D50 estimates made manually, predicted from catchment characteristics, and using a YOLO-enabled approach across the Yakima River Basin. Results: We found distinct differences between methods for D50 averages and variability, and relationships between D50 estimates and basin characteristics. Discussion: We discuss the advantages and limitations of object detection methods versus current methods, and explore potential future directions to combine D50 methods to better estimate spatiotemporal variation of D50, and improve incorporation into basin-scale models.

grain size distribution↗