Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Hybrid Data-Driven and Model-Based Anomaly Detection Scheme for DER Operation: Preprint

This paper proposes a hybrid data and model-based anomaly detection for securing the operation of distributed energy resources (DERs) in distribution grids. Data-driven autoencoders (AE) are set up at the edge level by taking local DER data and detect anomalous operations by leveraging the reconstruction ability. In parallel, model-based state estimation (SE) is running at the system level by taking system models and measurements, the anomalies are identified by analyzing the measurements residual. The hybrid scheme preserves the benefits of both data-driven and model-based analysis and thus improves the robustness and accuracy of anomaly detection. It can be established by getting full use of the existing infrastructures in distribution grids. Numerical tests on a realistic distribution feeder in Southern California highlight the effectiveness as well as benefits of the proposed scheme.

anomaly detection↗
DOE OSTI2025

pyTCR: A tropical cyclone rainfall model for python

pyTCR is a climatology software package developed in the Python programming language. It integrates the capabilities of several legacy physical models and increases computational efficiency to allow rapid estimation of tropical cyclone (TC) rainfall consistent with the large-scale environment. Specifically, pyTCR implements a horizontally distributed and vertically integrated model [Zhu et al., 2013] for simulating rainfall driven by TCs. Along storm tracks, rainfall is estimated by computing the cross-boundary-layer, upward water vapor transport caused by different mechanisms including frictional convergence, vortex stretching, large-scale baroclinic effect (i.e., wind shear), topographic forcing, and radiative cooling [Lu et al., 2018]. The package provides essential functionalities for modeling and interpreting spatio-temporal TC rainfall data. pyTCR requires a limited number of model input parameters, making it a convenient and useful tool for analyzing rainfall mechanisms driven by TCs. To sample rare (most intense) rainfall events that are often of great societal interest, pyTCR adapts and leverages outputs from a statistical-dynamical TC downscaling model [Lin et al., 2023] capable of rapidly generating a large number of synthetic TCs given a certain climate. As a result, pyTCR significantly reduces computational effort and improves the efficiency in capturing extreme TC rainfall events at the tail of the distributions from limited datasets. Furthermore, the TC downscaling model is forced entirely by large-scale environmental conditions from reanalysis data or coupled General Circulation Models (GCMs), simplifying the projection of TC-induced rainfall and wind speed under future climate using pyTCR. Finally, pyTCR can be coupled with hydrological and wind models to assess risks associated with independent and compound events (e.g., storm surges and freshwater flooding).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Bayesian characterization of uncertainties surrounding fluvial flood hazard estimates

Fluvial floods drive severe risk to riverine communities. There is strong evidence of increasing flood hazards in many regions around the world. The choice of methods and assumptions used in flood hazard estimates can impact the design of risk management strategies. In this study, we characterize the expected flood hazards conditioned on the uncertain model structures, model parameters, and prior distributions of the parameters. We construct a Bayesian framework for river stage return level estimation using a nonstationary statistical model that relies exclusively on the Indian Ocean Dipole Index. We show that ignoring uncertainties can lead to biased estimation of expected flood hazards. We find that the considered model parametric uncertainty is more influential than model structures and model priors. Our results highlight the importance of incorporating uncertainty in extreme flood stage estimates, and are of practical use for informing water infrastructure designs in a changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Microstructure Validation of Graph Theory Model-Derived Cooling Rates in the Wire Arc Additive Manufacturing of ER70S-6 Steel

Wire arc additive manufacturing (WAAM) enables high-rate fabrication of large metallic components, but spatial variations in thermal history can lead to microstructural heterogeneity that requires efficient process models to evaluate. This study evaluates whether cooling rates extracted from a graph theory model (GTM)-based thermal simulation are consistent with the microstructural evolution observed in an ER70S-6 WAAM wall. Thermal histories from the model were analyzed at selected build heights, and cooling rates were extracted from the final thermal excursion through the austenite phase field. Microstructures at corresponding locations were characterized using electron backscatter diffraction (EBSD) to quantify grain size distributions, and pearlite interlamellar spacing was used as an additional indicator of cooling behavior. The modeled cooling rates were highest near the substrate and generally decreased with build height, consistent with the observed reduction in the fine grain fraction and the progressive shift in the grain size distribution as build height increased. Pearlite spacing trends also supported the modeled cooling rate variation. These results indicate that GTM-derived thermal histories can be post-processed into metallurgically meaningful cooling rate estimates for WAAM steel builds and linked to dataset specific empirical grain size distribution relationships for process–thermal history–microstructure assessment.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Hybrid Data-Driven and Model-Based Anomaly Detection Scheme for DER Operation

This paper proposes a hybrid data and model-based anomaly detection scheme to secure the operation of distributed energy resources (DERs) in distribution grids. Data-driven autoencoders are set up at the edge device level and they use local DER operational data as inputs. The abnormal statuses are detected by analyzing reconstruction errors. In parallel, modelbased state estimation (SE) is set up at the central level and it uses system-wide models and measurements as data inputs. The anomalies are identified by analyzing measurement residuals. The hybrid scheme preserves the benefits of both data-driven and model-based analyses and thus improves the robustness and the accuracy of anomaly detection. Numerical tests based on the model of a real distribution feeder in Southern California highlight the proposed scheme's effectiveness and benefits.

anomaly detection↗
DOE OSTI2023

A General Method for Estimating Zonal Transmission Interface Limits from Nodal Network Data: Preprint

Capacity expansion models for the electric power system often employ zonal (rather than nodal) resolution, necessitating estimates of aggregate power transfer limits across the interfaces between model zones. Interface limits between planning areas are sometimes published, but they are not generalizable to arbitrary zone shapes. There is thus a need for a reproducible method for estimating interface transfer limits (ITLs) between user-defined zones directly from nodal transmission system data. Here, we present a simple method for estimating ITLs using a DC power flow approximation via the power transfer distribution factor (PTDF) matrix. Linear optimization is performed to identify the distribution of power flows that maximizes the total flow on interface-crossing lines, subject to individual line ratings, limits on bus injection/withdrawal, and the relationships among flows, injections, and withdrawals imposed by the PTDF matrix. We demonstrate the application of the method on a 134-zone ~65000-bus system, and we explore the influence of flow direction, contingency level, and zone size on the estimated ITLs. There is significant heterogeneity in the ratio of the ITL to the sum of interface-crossing line ratings, which highlights the importance of accounting for the physical constraints on power flows imposed by Kirchhoff's laws when estimating zonal ITLs.

17 WIND ENERGY↗
DOE OSTI2022

Online State Estimation for Time-Varying Systems

The paper investigates the problem of estimating the state of a time-varying system with a linear measurement model; in particular, the paper considers the case where the number of measurements available can be smaller than the number of states. In lieu of a batch linear least-squares (LS) approach well-suited for static networks, where a sufficient number of measurements could be collected to obtain a full-rank design matrix the paper proposes an online algorithm to estimate the possibly time-varying state by processing measurements as and when available. The design of the algorithm hinges on a generalized LS cost augmented with a proximal-point-type regularization. With the solution of the regularized LS problem available in closed-form, the online algorithm is written as a linear dynamical system where the state is updated based on the previous estimate and based on the new available measurements. Conditions under which the algorithmic steps are in fact a contractive mapping are shown, and bounds on the estimation error are derived for different noise models. Numerical simulations are provided to corroborate the analytical findings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

SOSAT: Geohazard Risk Assessment in Carbon Sequestration Operations

Like all operations in which fluids are injected into the subsurface, geologic carbon storage (GCS) presents inherit risks that must be assessed and mitigated to successfully deploy such technology in the field. For example, alterations to pore pressure and the stress state due to fluid injection may trigger certain geohazards, such as potential fault activation and induced seismicity or unintentional hydraulic fracturing. Here we present capabilities for assessing these potential risks using the State of Stress Analysis Tool (SOSAT): a Python library and web-based application capable of probabilistically estimating the subsurface state of stress informed by various field observations. Using posterior distributions of principal stress components, SOSAT can assess the risk of fault activation within the injection formation for either a critically oriented fault or a fault with a user-prescribed orientation. Additionally, SOSAT can estimate the probability of unintentional hydraulic fracturing of the intact reservoir rock. Here, we demonstrate these SOSAT capabilities using a hypothetical GCS site. This type of risk assessment can assist with the effective deployment of GCS technology in the field by informing safe design and management practices.

Haagenson, Ryan J.↗
DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

bayesian structural time series↗
DOE OSTI2025

Estimating Soil Thermal Inertia Profiles From the Passive Equilibration of a Temperature Probe

Knowledge of the distribution of soil thermal properties is important for understanding subsurface hydrological and biogeochemical processes. This study describes and evaluates quick thermal profiling (QTP), a new measurement technique aimed at providing rapid, depth-resolved measurements of soil thermal inertia at numerous locations across the landscape. A cylindrical probe with temperature sensors at multiple depths is quickly inserted into the ground, and soil thermal inertia is estimated from how quickly the probe temperature equilibrates with the soil. To this end, a finite volume heat transfer model is used to generate temperature equilibration time series across combinations of controlling factors, and a gridded search inversion approach is applied to infer soil thermal inertia. Field tests in the Arctic indicate that QTP measurements have a minimum uncertainty of 0.14 J m −2 K −1 s −1/2 and covary with dual-probe heat pulse thermal analyzer measurements (concordance correlation coefficient = 0.56) with a root-mean-square error of 0.40 J m −2 K −1 s −1/2 . Besides demonstrating the value of QTP for estimating thermal inertia, this study identifies various sources of measurement uncertainty, particularly probe-soil contact resistance and frictional heating. Further, analysis of soil samples indicates that thermal inertia can be used to estimate thermal conductivity and dry bulk density in the studied area, although such inferences are highly site-specific. Overall, the QTP method holds promise to generate thermal inertia data products and to complement other characterization approaches for advancing understanding of soil properties across far more locations than is currently possible.

Lamb, J. R. [Lawrence Berkeley National Laboratory↗
DOE OSTI2020

Constraining magnetic fields in the circumgalactic medium

ABSTRACT We study the properties of magnetic fields in the circumgalactic medium (CGM) of z < 1 galaxies by correlating Faraday rotation measures (RMs) of ∼1000 high-redshift radio sources with the foreground galaxy number density estimated from the DESI Legacy Imaging Surveys. This method enables us to extract signals of RMs contributed by intervening gas around multiple galaxies. Our results show that there is no detectable correlation between the distribution of RMs and the number of foreground galaxies, contrary to several previous results. Utilizing the non-detection signals, we estimate 3σ upper limits to the RMs from the CGM of $\sim \!20 \rm \ rad\, m^{-2}$ within 50 kpc and $\sim \!10 \rm \ rad \, m^{-2}$ at separations of 100 kpc. By adopting a column density distribution of ionized gas obtained from absorption-line measurements, we further estimate the strengths of coherent magnetic fields parallel to the line of sight of $\lt \rm 2 \ \mu G$ in the CGM. We show that the estimated upper limits of RMs and magnetic field strengths are sufficient to constrain outputs of recent galaxy magnetohydrodynamic simulations. Finally, we discuss possible causes for the inconsistency between our results and previous works.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

A probability density function model describing height estimation uncertainty due to image pixel intensity noise in digital fringe projection measurements

Digital fringe projection is a surface-profiling technique used for highly accurate non-contact measurements. As with any measurement technique, a variety of sources degrade to the measurement accuracy of the method. Here, this paper presents an analytically-derived probability density function that explicitly models the surface height measurement error due to inevitable phase measurement error, and it includes the specific case of pixel noise inducing the phase measurement error that ultimately leads to the height estimation error. The accuracy of the model was validated through Monte-Carlo simulations of resultant height distributions subject to arbitrarily correlated pixel intensity noise and experimental digital fringe projection measurements where the pixel-by-pixel height uncertainty estimations were compared to the predictions of the derived model.

42 ENGINEERING↗
DOE OSTI2023

Extending the predictive power of perturbative QCD using the principle of maximum conformality and the Bayesian analysis

In addition to the evaluation of high-order loop contributions, the precision and predictive power of perturbative QCD (pQCD) predictions depends on two important issues: (1) how to achieve a reliable, convergent fixed-order series, and (2) how to reliably estimate the contributions of unknown higher-order terms. The recursive use of renormalization group equation, together with the Principle of Maximum Conformality (PMC), eliminates the renormalization scheme-and-scale ambiguities of the conventional pQCD series. The result is a conformal, scale-invariant series of finite order which also satisfies all of the principles of the renormalization group. In this paper we propose a novel Bayesian-based approach to estimate the size of the unknown higher order contributions based on an optimized analysis of probability distributions. We show that by using the PMC conformal series, in combination with the Bayesian analysis, one can consistently achieve high degree of reliability estimates for the unknown high order terms. Thus the predictive power of pQCD can be greatly improved. We illustrate this procedure for two pQCD observables: R e+e– and R τ , which are each known up to four loops in pQCD. Numerical analyses confirm that by using the scale-independent and more convergent PMC conformal series, one can achieve reliable Bayesian probability estimates for the unknown higher-order contributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

The star formation properties of the observed and simulated AGN Universe: BAT versus EAGLE

ABSTRACT In this paper, we present data from 72 low-redshift, hard X-ray selected active galactic nucleus (AGN) taken from the Swift–BAT 58 month catalogue. We utilize spectral energy distribution fitting to the optical to infrared photometry in order to estimate host galaxy properties. We compare this observational sample to a volume- and flux-matched sample of AGN from the Evolution and Assembly of GaLaxies and their Environments (EAGLE) hydrodynamical simulations in order to verify how accurately the simulations can reproduce observed AGN host galaxy properties. After correcting for the known +0.2 dex offset in the SFRs between EAGLE and previous observations, we find agreement in the star formation rate (SFR) and X-ray luminosity distributions; however, we find that the stellar masses in EAGLE are 0.2–0.4 dex greater than the observational sample, which consequently leads to lower specific star formation rates (sSFRs). We compare these results to our previous study at high redshift, finding agreement in both the observations and simulations, whereby the widths of sSFR distributions are similar (∼0.4–0.6 dex) and the median of the SFR distributions lie below the star-forming main sequence by ∼0.3–0.5 dex across all samples. We also use EAGLE to select a sample of AGN host galaxies at high and low redshift and follow their characteristic evolution from z = 8 to z = 0. We find similar behaviour between these two samples, whereby star formation is quenched when the black hole goes through its phase of most rapid growth. Utilizing EAGLE we find that 23 per cent of AGN selected at z ∼ 0 are also AGN at high redshift, and that their host galaxies are among the most massive objects in the simulation. Overall, we find EAGLE reproduces the observations well, with some minor inconsistencies (∼0.2 dex in stellar masses and ∼0.4 dex in sSFRs).

Jackson, Thomas M.↗
DOE OSTI2023

Exploration of a Potential Desirability of Outcome Ranking Endpoint for Complicated Intra-Abdominal Infections Using 9 Registrational Trials for Antibacterial Drugs

Abstract Background Desirability of outcome ranking (DOOR) is a novel approach to clinical trial design that incorporates safety and efficacy assessments into an ordinal ranking system to evaluate overall outcomes of clinical trial participants. Here, we derived and applied a disease-specific DOOR endpoint to registrational trials for complicated intra-abdominal infection (cIAI). Methods Initially, we applied an a priori DOOR prototype to electronic patient-level data from 9 phase 3 noninferiority trials for cIAI submitted to the US Food and Drug Administration between 2005 and 2019. We derived a cIAI-specific DOOR endpoint based on clinically meaningful events that trial participants experienced. Next, we applied the cIAI-specific DOOR endpoint to the same datasets and, for each trial, estimated the probability that a participant assigned to the study treatment would have a more desirable DOOR or component outcome than if assigned to the comparator. Results Three key findings informed the cIAI-specific DOOR endpoint: (1) a significant proportion of participants underwent additional surgical procedures related to their baseline infection; (2) infectious complications of cIAI were diverse; and (3) participants with worse outcomes experienced more infectious complications, more serious adverse events, and underwent more procedures. DOOR distributions between treatment arms were similar in all trials. DOOR probability estimates ranged from 47.4% to 50.3% and were not significantly different. Component analyses depicted risk-benefit assessments of study treatment versus comparator. Conclusions We designed and evaluated a potential DOOR endpoint for cIAI trials to further characterize overall clinical experiences of participants. Similar data-driven approaches can be utilized to create other infectious disease–specific DOOR endpoints.

Immunology↗
DOE OSTI2020

Probability Density Function Control for Stochastic Nonlinear Systems using Monte Carlo Simulation

This paper presents a fast implementation framework of output probability density function (PDF) control for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. The statistical properties of the system outputs can be adjusted by shaping the dynamic output probability density function to track the reference stochastic distribution. However, the dynamic probability density function evolution is very difficult to obtain analytically even if the system model and the stochastic distributions of the noises are known. Motivated by Monte Carlo simulation, the dynamic probability density function can be estimated by sampling data which forms the contribution of this paper. In particular, the sampling points are generated following the stochastic distribution of the noise for each instant. These points go through the system would generate the histogram for system outputs, then the dynamic model can be established based on the dynamic histogram which reflects the randomness and the nonlinear dynamics of the investigated system. Based on the established model, the output probability density function tracking can be achieved and the simulation results and discussions show the effectiveness and benefits of the presented framework.

Zhang, Qichun↗
DOE OSTI2025

A segmented approach to modeling building height: Delineating high-rise and low-rise buildings for enhanced height estimation

Understanding building height is imperative to the overall study of energy efficiency, population distribution, urban morphologies, emergency response, among others. Currently, existing approaches for modeling building height at scale are hindered by two pervasive issues. First, there is no consistent approach to quantify what a high-rise building is at a macro scale, leaving researchers unable to accurately compare results across geographies and domains. Second, high-rise buildings represent a small fraction of the built environment, implying data imbalance challenges that negatively affect current approaches. This is a problem of practical relevance since information on high-rise buildings is important for studies on urban heat islands, population dynamics, and pollution dispersion. Here, we introduce a novel approach to map building height which first identifies two distinct distributions within the built environment, with one being composed of low-rise buildings and one composed of high-rise buildings. We then develop an ensemble scheme where discrete specialist models are trained for each subset of low-rise buildings and high-rise buildings to infer building height from morphology features. For experiments mapping heights of 4.85 million buildings in Japan, we show an increase of 34 % in accuracy within 3m error when compared to the current state-of-the-art when modeling high-rise buildings, which based on KNN experimentation we define as any building > 12m . Our findings show that such an ensemble framework outperforms the current state-of-the-art approaches, which is especially relevant in relation to inferring height for high-rise buildings, a prominent issue of existing approaches for mapping the built environment.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Development of an ERT‐Based Framework for Bentonite Buffers Monitoring From Laboratory Tests: 2. Quantitative Moisture Dynamics Estimation Model

Abstract The long‐term containment of high‐level radioactive waste in geological disposal repositories relies on Engineered Barrier Systems (EBS), with bentonite clay emerging as a candidate material due to its unique properties. Understanding moisture dynamics within bentonite buffers is crucial for EBS performance, as it directly influences the material's swelling capacity, thermal and hydraulic conductivity, mechanical properties, and long‐term evolution under complex thermal‐hydrological‐mechanical (THM) processes. This study develops an advanced Electrical Resistivity Tomography (ERT)‐based framework to quantitatively monitor moisture dynamics under THM conditions. Our framework extends the Waxman‐Smits model to incorporate the coupled effects of temperature, water content, fluid chemistry, and mechanical changes on bentonite's electrical properties. Utilizing HotBENT‐Lab data from our companion paper, which includes electrical conductivity, CT density, and thermocouple measurements, this study offers a novel methodological framework bridging different scales of the model. Our results show that the extended model can estimate water content from ERT data, capturing spatial and temporal variations in moisture distribution within bentonite columns. However, the model tends to overestimate water content compared to CT density‐derived measurements. We address this discrepancy by incorporating a simplified swelling effect model, which improves agreement between ERT and CT density‐based water content estimates. We also discuss model limitations, including simplified treatment of swelling and micropore effects, and propose a conceptual framework for transitioning from laboratory to field applications, addressing challenges such as parameter scalability, field validation methods, and integration of diverse data sources. This ERT‐based framework can potentially advance real‐world moisture monitoring of bentonite‐based EBS in nuclear waste repositories. Plain Language Summary Safely containing high‐level radioactive waste depends on barriers made from materials like bentonite clay, which is effective because it swells and seals in the waste. To ensure these barriers work well over time, it's important to understand how moisture moves through the clay. Our study developed a new method using ERT to monitor moisture levels in bentonite under conditions that mimic those in actual storage sites, including changes in temperature, water content, and mechanical stress. This study improved an existing model to better account for how these factors affect the clay, allowing us to create more accurate moisture maps. Initially, the proposed model overestimated the amount of water in the clay, but its accuracy was improved by factoring in how the clay swells when wet. This study also identified some limitations of the model and suggested ways to adapt it for use in real‐world waste storage sites. This new approach could lead to better monitoring and safety checks for nuclear waste storage systems, helping to ensure long‐term containment. Key Points This work develops an ERT‐based framework extending the Waxman‐Smits model to monitor bentonite moisture dynamics during coupled THM processes The extended model accurately estimates water content from Electrical Resistivity Tomography data, incorporating swelling effects to improve precision This work proposes a conceptual framework for transitioning from laboratory to field applications, advancing EBS monitoring in nuclear waste repositories

Chen, Hang↗