Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distribution system state estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Shedding light on U.S. small and midsize data centers: Exploring insights from the CBECS survey

As demand for digital services accelerates, the energy and environmental footprint of data centers faces increasing scrutiny. While hyperscale cloud facilities have driven efficiency gains, small and midsize U.S. data centers remain a critical yet underexamined segment with significant untapped potential for energy savings. This study leverages data from the Commercial Buildings Energy Consumption Survey (CBECS) to analyze trends in server stocks, computing customers, cooling system adoption and efficiency, and geospatial distribution from 2012 to 2018. Findings reveal a sharp decline in small and midsize data centers, from 1.764 million to 1.398 million, with server counts dropping from 5.177 million to 4.262 million—aligning with the broader shift toward cloud computing. More than 40 % of servers in small data centers and 55 % in midsize data centers are housed in office buildings, and over half of all servers are concentrated in climate zones 5A (cold), 3A (mixed-humid), and 4A (mixed-humid), with the highest densities in metropolitan hubs. While direct expansion units remain the dominant cooling system, a clear transition toward more energy-efficient solutions, particularly air economizers, is evident. By integrating server and cooling system distributions, we estimate Power Usage Effectiveness (PUE) and Water Usage Effectiveness (WUE) for U.S. data centers by size and year. Results show that midsize data centers are more energy-efficient but more water-intensive due to the widespread use of water-cooled chillers. These findings highlight the trade-offs in cooling system selection and provide a critical foundation for policies aimed at enhancing efficiency in an evolving data center landscape.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

System and method for modeling and forecasting cyclical demand systems with dynamic controls and dynamic incentives

Systems and methods for modeling and forecasting cyclical demand systems in the presence of dynamic control or dynamic incentives. A method for modeling a cyclical demand system comprises obtaining historical data on one or more demand measurements over a plurality of demand cycles, obtaining historical data on incentive signals over the plurality of demand cycles, constructing a model using the obtained historical data on the one or more demand measurements and the incentive signals, wherein constructing the model comprises specifying a state-space model, specifying variance parameters in the model, and estimating unknown variance parameters.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Exceedance Probabilities and Recurrence Intervals for Extended Power Outages in the United States

Power outages cause significant economic and societal impacts. An increasing likelihood of extreme weather coupled with aging grid infrastructure is leading to a higher prevalence of extended power outages, which can leave customers without power for multiple days or even weeks. Planners at the facility, local, state, and federal levels are interested in resilience solutions to reduce the impacts of extended power outages. Resilience solutions—such as installing backup systems, integrating microgrid solutions, weatherizing buildings, and hardening distribution and transmission components—can reduce the consequences of extended power outages, but these solutions come with increased capital costs. Conducting cost-benefit analyses is important for determining which steps to take to mitigate the impact of power outages without investing in ineffective and cost-prohibitive resilience solutions. The expected benefits of resilience investments depend on the frequency of power outages of various durations, particularly extended outages lasting several hours, days, or weeks. A significant barrier to resilience planning is the lack of publicly available data on the frequency and duration of extended power outages. The absence of outage duration information severely limits the ability to conduct quantitative cost-benefit analyses of resilience investments. This report provides estimates of recurrence intervals and conditional exceedance probabilities for major power outages by U.S. region between 2015 and 2021. Additionally, we provide estimates for grid management, particularly outages caused by California’s public safety power shutoffs (PSPS), and for natural outages caused by major hurricanes. Outage recurrence intervals are the average number of years between outage events, and conditional exceedance probabilities are the likelihoods that a customer who experiences a major power outage will experience an outage exceeding a given duration. Major outage events are those that affect 10,000 or more customers, as defined by the U.S. Department of Energy’s (DOE’s) Electric Emergency Incident and Disturbance Report, called OE-417 (DOE 2020). These results can be applied to determine the likelihood of experiencing long-duration outages, which can be integrated into cost-benefit analyses of resilience solutions and broader energy resilience studies. We developed a methodology to estimate customer outage durations for extended outage events using publicly available data on customer outages. Shorter-duration power outages are relatively common, with customers experiencing on average more than one power outage each year lasting fewer than 12 hours. An outage event lasting between 1 day and 1 week is expected to occur between once every 16 years and once every 42 years, depending on the region, with an average recurrence rate of once every 32 years across the contiguous United States.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Out-of-distribution detection with non-parametric density estimation for models predicting processing history of uranium ore concentrates

The rapid advancement in machine learning (ML) and computer vision (CV) coincides with the growth of interest in deploying these ML/CV models in numerous fields from medicine to social science. Similar to those areas, we have witnessed a great number of works in materials science employing ML/CV models – neural networks in particular – in their studies in recent years. These models have proven to obtain accurate performance in various tasks. However, these models struggle to attain a similar performance when encountering test samples coming from a distribution that is different from the training set. More importantly, they fail without providing any warning to the users. Therefore, we propose a framework for detecting out-of-distribution (OOD) samples to alert users when a human intervention might be necessary in this work. Specifically, we explore the use of a non-parametric density estimation method to detect OOD samples. Here, we assess OOD detection capability of the proposed framework on ML models developed for categorizing precipitation routes of U 3 O 8 when encountering OOD datasets that contain samples (1) undergone different imaging acquisition process, (2) undergone different material synthesis process, and (3) different materials than ID set. Through those experiments, we achieve an average area under the receiver operating characteristic (AUROC) of at least 91% on average in detecting OOD samples. With minimal overhead cost and superior performance, the proposed framework enables a reliable and safe system when deploying in real-world scenarios.

Convolutional neural networks↗
DOE OSTI2025

Reduced Order Modeling conditioned on monitored features for response and error bounds estimation in engineered systems

Reduced Order Models (ROMs) form essential tools across engineering domains by virtue of their function as surrogates for computationally intensive digital twinning simulators. Although purely data-driven methods are available for ROM construction, schemes that allow to retain a portion of the physics tend to enhance the interpretability and generalization of ROMs. However, physics-based techniques can adversely scale when dealing with nonlinear systems that feature parametric dependencies. This study introduces a generative physics-based ROM that is suited for nonlinear systems with parametric dependencies and is additionally able to provide numerical error bounds associated with the respective estimates. A main contribution of this work is the conditioning of these parametric ROMs to features that can be derived from monitoring measurements, feasibly in an online fashion. This is contrary to most existing ROM schemes, which remain restricted to the prescription of the physics-based, and usually a priori unknown, system parameters. Our work utilizes conditional Variational Autoencoders to continuously map the required reduction bases to a feature vector extracted from limited output measurements, while additionally allowing for a probabilistic assessment of the ROM-estimated Quantities of Interest. An auxiliary task using a neural network-based parametrization of suitable probability distributions is introduced to re-establish the link with physical model parameters. We verify the proposed scheme on a series of simulated case studies incorporating effects of geometric and material nonlinearity under parametric dependencies related to system properties and input load characteristics.

Conditional VAEs↗
DOE OSTI2020

Koopman–von Neumann approach to quantum simulation of nonlinear classical dynamics

Quantum computers can be used to simulate nonlinear non-Hamiltonian classical dynamics on phase space by using the generalized Koopman–von Neumann formulation of classical mechanics. The Koopman–von Neumann formulation implies that the conservation of the probability distribution function on phase space, as expressed by the Liouville equation, can be recast as an equivalent Schrödinger equation on Hilbert space with a Hermitian Hamiltonian operator and a unitary propagator. This Schrödinger equation is linear in the momenta because it derives from a constrained Hamiltonian system with twice the classical phase-space dimension. A quantum computer with finite resources can be used to simulate a finite-dimensional approximation of this unitary evolution operator. Quantum simulation of classical dynamics is exponentially more efficient than a deterministic Eulerian discretization of the Liouville equation if the Koopman–von Neumann Hamiltonian is sparse. Utilizing quantum walk techniques for state preparation and amplitude estimation for the calculation of observables leads to a quadratic improvement over classical probabilistic Monte Carlo algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Distributed Optimization for Nonrigid Nano-Tomography

Resolution level and reconstruction quality in nano-computed tomography (nano-CT) are in part limited by the stability of microscopes, because the magnitude of mechanical vibrations during scanning becomes comparable to the imaging resolution, and the ability of the samples to resist radiation induced deformations during data acquisition. In such cases, there is no incentive in recovering the sample state at different time steps like in time-resolved reconstruction methods, but instead the goal is to retrieve a single reconstruction at the highest possible spatial resolution and without any imaging artifacts. Here we propose a distributed optimization solver for tomographic imaging of samples at the nanoscale. Our approach solves the tomography problem jointly with projection data alignment, nonrigid sample deformation correction, and regularization. Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts. Synthetic data tests show robustness of the method to Poisson and low-frequency background noise. We accelerated the solver on multi-GPU systems and validated the method on three nano-imaging experimental data sets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Electric Water Heaters for Transactive Systems: Model Evaluations and Performance Quantification

Electric water heaters (EWHs) are opportune appliances for implementing demand-side control. EWH models serve as a fundamental step toward accurately estimating EWH flexibility potential and designing proper control strategies. Existing studies have adapted numerous modeling approaches in evaluating the potential of EWHs for a variety of grid applications. This paper presents an analytical study that evaluates the performance of state-of-art EWH models in terms of accuracy and computational complexity for adaptation in evaluation studies for the transactive system. The work proposes a transactive control strategy that optimally utilizes the thermal inertia of EWHs for providing grid services. Here, the performance of the control strategy and the impact of modeling accuracy is evaluated for device-level and feeder-level use cases using the IEEE 123 node test distribution system appropriately populated with EWHs. The simulation results illustrate the effectiveness of the control strategy in reducing the feeder demand during peak period by 13% and also quantities the impact of using simplified modeling approaches for determining the potential of EWHs for providing grid services.

42 ENGINEERING↗
DOE OSTI2021

Modeling and Impact of Hyperloop Technology on the Electricity Grid

This paper provides an overview of hyperloop technologies, including a brief discussion of key components of a hyperloop system that determine the electric power requirements as a function of time. At-scale hyperloop systems do not yet exist, so a model was used to generate a set of load profiles for conceptual hyperloop realizations at four locations in the United States: two systems in California and one each in Colorado and Ohio. In all four cases, the modeled hyperloop load profiles included pulses in both active and reactive power. Grid modeling was performed to estimate the grid impacts and for dis-cussing grid integration challenges. The paper discusses how energy storage systems might be used to eliminate the pulsating load characteristics or significantly reduce it to accommodate current grid planning guidelines

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Continuum radiated power density $(P^{\textrm{C}}_{\textrm{rad}})$ and effective charge $(Z_{\textrm{eff}})$ estimates from multi-energy photon-counting measurements

Multi-energy soft x-ray pinhole cameras have been designed, built, calibrated, and operated at Madison symmetric Torus, Alcator C-Mod, and more recently at Tokamak a configuration variable and Tungsten Environment in Steady-State Tokamak (WEST), to measure plasma emission across multiple energy ranges. Here we describe a new methodology to estimate the local continuum radiated power density and the plasma effective charge (Z eff ) directly from photon-counting measurements of the line-free continuum emission (Bremsstrahlung and Radiative Recombination) in several energy bands between 11 and 18 keV. This capability is particularly valuable for confinement systems using metal plasma-facing components, where x-ray losses from interactions with the sputtered wall can represent a significant fraction of the total radiated power (P rad ). The approach leverages a well-characterized detector responsivity, modeled by a complementary error function, and interprets the differential multi-energy measurements between adjacent energy levels through the probability density function of a Gaussian distribution. The implementation of this diagnostic technique is currently under development on the WEST tokamak, aiming at the goal of providing real-time P rad and Z eff measurements during long-pulse operation (up to 1000 s) in the 2026 campaign.

WEST↗
DOE OSTI2020

Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control

As occupancy sensing technologies become mature, various occupancy sensors are increasingly deployed in commercial buildings for pervasive occupancy monitoring. These sensors provide occupant-count data, which contains rich spatiotemporal information about occupancy patterns. With long-term occupant-count data collected from a commercial building, we design three different predictive models that capture the occupancy dynamics and examine how a model predictive control of the HVAC system benefits from actual occupancy count prediction. Our analysis reveals that mispredictions of occupancy states, especially false positives and false negatives, may introduce inefficient control that leads to energy waste or user discomfort. To address this issue, we take a step further to design an adaptive model predictive controller that minimizes inefficient control actions according to misprediction types and distributions. A comprehensive evaluation is performed in OpenBuild and EnergyPlus simulators to study the effectiveness of the proposed end-to-end control strategy. The evaluation shows that the proposed solution reduces energy consumption by 29.5% while improving the average weighted occupants comfort by 86.7% in Predicted Mean Vote (PMV) over the fixed schedule strategy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Transformer Health Monitoring Using Dissolved Gas Analysis

As integral components of any power plant, transformers supply the generated electricity to the grid. However, a transformer’s cellulose-based paper insulation and the mineral oil in which it is immersed break down over time under standard operating conditions—or more rapidly due to potential faults within the system. As the transformer’s mineral oil breaks down, gases are released that can be measured and monitored. This technical brief exhibits a collection of diagnostic and prognostic techniques that utilities can adopt in lieu of labor-intensive periodic preventive maintenance routines. Furthermore, prognostic models have been incorporated using the latest version of the Institute of Electrical and Electronics Engineers (IEEE) standard (IEEE, 2019) for dissolved gas analysis (DGA), thus expanding it to include estimation of the time to maintenance. Overall, four different methodologies are explained, each of which aids in determining a transformer’s state of health. These methodologies include the Chendong model, the IEEE thermal life consumption model (IEEE, 2012), a diagnostic model for DGA, and a prognostic model for DGA that uses an autoregressive integrated moving average (ARIMA) model. An additional improvement for estimating missing system parameters by using monitoring data (i.e., a tool for parameter estimation utilizing Powell’s method) is presented, enabling the IEEE thermal life consumption model to benefit not only the collaborating power plant, but also the power industry at large.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Tracking the Sun: Pricing and Design Trends for Distributed Photovoltaic Systems in the United States (2021 Edition) [Slides]

Berkeley Lab’s annual Tracking the Sun report describes trends among grid-connected, distributed solar photovoltaic (PV) systems in the United States. The latest edition of the report focuses on systems installed through year-end 2020, and is based on data from roughly 2.2 million systems, covering 79% of all distributed PV systems installed nationally through 2020. The report describes trends related to project characteristics, including system size, module efficiencies, prevalence of paired PV with storage, use of module-level power electronics, third-party ownership, mounting configurations, panel orientation, and non-residential customer segmentation ownership. Median installed-price trends, including both long-term and more recent temporal trends at the national and state levels, with comparisons to other recent PV cost and pricing benchmarks as well as to prices reported for other countries. Variability in pricing across individual projects based on system size, state, installer, module efficiency, inverter technology, and non-residential customer type. The report also includes an econometric analysis to estimate the effects of individual drivers on installed prices for host-owned residential systems installed in 2020.

14 SOLAR ENERGY↗
DOE OSTI2022

A machine learning photon detection algorithm for coherent x-ray ultrafast fluctuation analysis

X-ray free electron laser experiments have brought unique capabilities and opened new directions in research, such as creating new states of matter or directly measuring atomic motion. One such area is the ability to use finely spaced sets of coherent x-ray pulses to be compared after scattering from a dynamic system at different times. This enables the study of fluctuations in many-body quantum systems at the level of the ultrafast pulse durations, but this method has been limited to a select number of examples and required complex and advanced analytical tools. By applying a new methodology to this problem, we have made qualitative advances in three separate areas that will likely also find application to new fields. As compared to the “droplet-type” models, which typically are used to estimate the photon distributions on pixelated detectors to obtain the coherent x-ray speckle patterns, our algorithm achieves an order of magnitude speedup on CPU hardware and two orders of magnitude improvement on GPU hardware. We also find that it retains accuracy in low-contrast conditions, which is the typical regime for many experiments in structural dynamics. Finally, it can predict photon distributions in high average-intensity applications, a regime which up until now has not been accessible. Our artificial intelligence-assisted algorithm will enable a wider adoption of x-ray coherence spectroscopies, by both automating previously challenging analyses and enabling new experiments that were not otherwise feasible without the developments described in this work.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Online PMU Missing Value Replacement Via Event-Participation Decomposition

We introduce a new method for online Phasor Measurement Unit (PMU) missing value replacement. Our approach allows us to decompose PMU event responses into a non-dynamic component (denoted the participation factor) that can be inferred directly from the past and a dynamic component that can be inferred directly from all other PMUs (denoted the event strength). When missing values occur, we can use these two components, which do not rely on the missing index, to estimate the correct value. The method is extremely fast and can easily be used for online applications. Furthermore, extensive testing on real power system event data reveals that our approach achieves state-of-the-art performance in terms of Mean Absolute Percent Errors (MAPEs) for PMU data dropped during event periods. Here, the method also yields an interpretable and simplified view of events for further analysis and applications. The method relies only on PMU data and does not take outside information such as network topology.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference↗
DOE OSTI2025

An update to the Sandia method for creating Typical Meteorological Years from a limited pool of calendar years

Typical Meteorological Years (TMYs) are essential for the efficient evaluation of energy system performance. Ideally, 30 years of weather data are required to generate TMYs, but significantly fewer years are typically available due to practical limitations. To address this issue, an update to the Sandia method was developed, referred to as the Argonne method, to create TMYs from a limited number of years. Furthermore, this method enhances candidate diversity by systematically shifting original candidate months forward or backward by specific days, creating an expanded pool of candidates. The effectiveness of the Argonne method was validated through statistical testing, comparison of monthly average weather parameters, and numerical simulations. The results demonstrate a high probability of identifying at least one shifted month whose cumulative distribution functions of weather parameters closely align with long-term distributions. In 67 % of all comparisons, the monthly average weather parameters in TMYs generated using the Argonne method exhibit better agreement with long-term averages than TMY3. Moreover, in 74 % of the 318 building simulation cases, the Argonne method outperforms TMY3 in estimating long-term average building heating and cooling demands. Therefore, the Argonne method effectively diversifies the candidate pool and produces typical years that provide more accurate estimations of long-term averages compared to TMY3 when only a limited pool of calendar years (10 years or fewer) is available.

Building energy modeling↗
DOE OSTI2025

A derecho climatology (2004–2021) in the United States based on machine learning identification of bow echoes

Due to their persistent widespread severe winds, derechos pose significant threats to human safety and property, with impacts comparable to many tornadoes and hurricanes. Yet, automated detection of derechos remains challenging due to the absence of spatiotemporally continuous observations and the complex criteria employed to define the phenomenon. This study presents an objective derecho detection approach capable of automatically identifying derechos through both observations and model results. The approach is grounded in a physically based definition of derechos and integrates three algorithms: (1) the Python Flexible Object Tracker (PyFLEXTRKR) algorithm to track mesoscale convective systems (MCSs), (2) a semantic segmentation convolutional neural network to identify bow echoes, and (3) a comprehensive classification algorithm to detect derechos within MCS life cycles and distinguish derecho-producing from non-derecho-producing MCSs. Using this approach, we developed a novel high-resolution (4 km and hourly) observational dataset of derechos and accompanying derecho-producing MCSs over the United States east of the Rocky Mountains from 2004 to 2021. The dataset consists of two subsets based on different gust speed data sources and is analyzed to document the climatology of derechos in the United States. On average, 12–15 derechos are identified per year, aligning with previous estimations (∼6–21 events annually). The spatial distribution and seasonal variation patterns are consistent with prior studies, showing peak occurrences in the Great Plains and the Midwest during the warm season. Additionally, during the study period, derechos account for approximately 3.1 % of measured damaging gusts (≥25.93 m s−1) over the eastern United States. The dataset is publicly available at https://doi.org/10.5281/zenodo.14835362 (Li et al., 2025).

54 ENVIRONMENTAL SCIENCES↗