SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A Two-Level Model Predictive Control-Based Approach for Building Energy Management including Photovoltaics, Energy Storage, Solar Forecasting and Building Loads

This paper uses a two-level model predictive control-based approach for the coordinated control and energy management of an integrated system that includes photovoltaic (PV) generation, energy storage, and building loads. Novel features of the proposed local controller include (1) the ability to simultaneously manage building loads and energy storage to achieve different operational objectives such as energy efficiency, economic cost efficiency, demand response and grid optimization through the design of specific power trajectory tracking performance functionals, (2) an energy trim function that minimizes the impact of solar forecasting errors on system performance, and (3) the design of a state of charge controller that uses day-ahead forecast of solar power and building loads to intialize energy storage at the start of each day. The local controller is tested in simulation using an exemplary system with PV generation, energy storage and dispatchable building loads. Two sample days with different PV forecasts and multiple case scenarios are considered, and the performance of the algorithm in managing the real and reactive net building load trajectories and the ramp rate of PV injections into the utility network are evaluated. The simulations are based on actual forecasted and measured PV data, and the results show that the local controller meets the tracking requirements for real and reactive power within the operating constraints of the building.

14 SOLAR ENERGY↗

DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗

DOE OSTI2023

Intra-hour Solar Irradiance Forecast in Multiple Locations using Deep Transfer Learning

In recent years, solar power system installation imposes several challenges on the operations of local and regional power grids due to the inherent variability of ground-level solar irradiance. This work proposes a novel real-time solar forecast methodology for intra-hour solar irradiance based on deep transfer learning from ground-based sky imager for time horizons ranging from 5-15 min. There are three unique aspects of the proposed methodology: (1) a Deep Learning based algorithm development which is modeled as a classification approach rather than a traditional regression approach; (2) the use of the Transfer Learning technique to show generalization capability, robustness, and portability of baseline model in the newly deployed location where availability of enough data for training is typically scarce, and (3) redefinition of point-based irradiation forecast error estimation technique with a window-based one that is more intuitive and user-friendly. The system is developed using multiple years of irradiance and sky image recording in New Jersey and one-year data from Colorado, USA. The method is validated against ground telemetry from these two locations of diverse geographic and climatic conditions. Results show that the forecasting method proposed in this work is robust and highly accurate (8% MAPE error) for multiple locations deployment.

Deep Learning, Convolution Neural Networks, transf↗

DOE OSTI2021

Ensemble‐Based Assimilation of Satellite All‐Sky Microwave Radiances Improves Intensity and Rainfall Predictions for Hurricane Harvey (2017)

Abstract Ensemble‐based data assimilation of radar observations across inner‐core regions of tropical cyclones (TCs) in tandem with satellite all‐sky infrared (IR) radiances across the TC domain improves TC track and intensity forecasts. This study further investigates potential enhancements in TC track, intensity, and rainfall forecasts via assimilation of all‐sky microwave (MW) radiances using Hurricane Harvey (2017) as an example. Assimilating Global Precipitation Measurement constellation all‐sky MW radiances in addition to GOES‐16 all‐sky IR radiances reduces the forecast errors in the TC track, rapid intensification (RI), and peak intensity compared to assimilating all‐sky IR radiances alone, including a 24‐hr increase in forecast lead‐time for RI. Assimilating all‐sky MW radiances also improves Harvey's hydrometeor fields, which leads to improved forecasts of rainfall after Harvey's landfall. This study indicates that avenues exist for producing more accurate forecasts for TCs using available yet underutilized data, leading to better warnings of and preparedness for TC‐associated hazards in the future.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Learning to concentrate: multi-tracer forecasts on local primordial non-Gaussianity with machine-learned bias

Local primordial non-Gaussianity (LPNG) is predicted by many non-minimal models of inflation, and creates a scale-dependent contribution to the power spectrum of large-scale structure (LSS) tracers, whose amplitude is characterized by b Φ . Knowledge of b Φ for the observed tracer population is therefore crucial for learning about inflation from LSS. Recently, it has been shown that the relationship between linear bias b 1 and b Φ for simulated halos exhibits significant secondary dependence on halo concentration. We leverage this fact to forecast multi-tracer constraints on ${f}^{loc}_{NL}$. We train a machine learning model on observable properties of simulated IllustrisTNG galaxies to predict b Φ for samples constructed to approximate DESI emission line galaxies (ELGs) and luminous red galaxies (LRGs). We find σ(${f}^{loc}_{NL}$) = 2.3, and σ(${f}^{loc}_{NL}$) = 3.7, respectively. These forecasted errors are roughly factors of 3, and 35% improvements over the single-tracer case for each sample, respectively. When considering both ELGs and LRGs in their overlap region, we forecast σ(${f}^{loc}_{NL}$) = 1.5 is attainable with our learned model, more than a factor of 3 improvement over the single-tracer case, while the ideal split by b Φ could reach σ(${f}^{loc}_{NL}$) < 1. In conclusion, we also perform multi-tracer forecasts for upcoming spectroscopic surveys targeting LPNG (MegaMapper, SPHEREx) and show that splitting tracer samples by b Φ can lead to an order-of-magnitude reduction in projected σ(${f}^{loc}_{NL}$) for these surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Review of Onsite Temperature and Solar Forecasting Models to Enable Better Building Design and Operations

Advanced building controls and energy optimization for new constructions and retrofits rely on accurate weather data. Traditionally, most studies utilize airport weather information as the decision inputs. However, most buildings are in environments that are quite different than those at the airport miles away. Tree cover, adjacent buildings, and micro-climate effects caused by the larger surrounding area can all yield deviations in air temperature, humidity, solar irradiance, and wind that are large enough to influence design and operation decisions. In order to overcome this challenge, there are many prior studies on developing weather forecasting algorithms from micro-to meso-scales. Additionally, this paper reviews and complies knowledge on common weather data resources, data processing methodologies and forecasting techniques of weather information. Commonly used statistical, machine learning and physical-based models are discussed and presented as two major categories: deterministic forecasting and probabilistic forecasting. Finally, evaluation metrics for forecasting errors are listed and discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Assessment of Cloud Mask Forecasts from the WRF-Solar Ensemble Prediction System: Preprint

Numerical weather prediction (NWP) models are important tools used by government agencies and the renewable energy enterprise to forecast solar radiation. Cloud prediction, a key process of NWP models, has the highest impact on the accuracy of solar forecasting. This study uses satellite observations from the National Solar Radiation Data Base (NSRDB) to evaluate the cloud mask forecast by the WRF-Solar Ensemble Prediction System (WRF-Solar EPS). Preliminary analysis of the data in 2018 demonstrates the need of further improvement in predicting thin and low-level clouds. The information obtained from this work will be used to enhance the WRF-Solar EPS in reproducing the cloud field over the contiguous U.S. and reducing solar forecasting errors.

41 EE - Solar Energy Technologies Office (EE-4S)↗

DOE OSTI2023

Day-ahead continuous double auction-based peer-to-peer energy trading platform incorporating trading losses and network utilisation fee

Integration of distributed energy resources, such as photovoltaic solar (PV), introduces new opportunities to establish local energy market frameworks to improve renewable energy utilisation in residential sectors. Such peer-to-peer (P2P) energy trading refers to a local market structure where customers (and prosumers) interact to share excess PV generation to enhance the individual and community social welfare. In this work, a day-ahead continuous double auction (CDA)-based P2P market structure considering network losses and network utilisation fees was designed. Day-ahead PV energy is modelled using fractional integral polynomials and the output is forecasted using an autoregressive integrated moving average model for each market interval. Based on the customer load and excess PV energy, the CDA market is cleared using a bid/ask matching mechanism. The performance of the P2P market was evaluated by computing different welfare metrics while analysing the effect of network constraints. The results show that the designed CDA-based P2P market structure increases the social welfare of all participants by an average of 17.75% compared to the baseline for the presented cases. Moreover, the impact of the forecasting error between the day-ahead and real-time market was also quantified.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

APSO-enhanced algebraic derivative estimation approach for real-time traffic flow prediction on critical road sections during wildfire evacuation

In rapid-onset disaster scenarios such as wildfires, evacuation traffic often significantly deviates from historical patterns, rendering conventional data-driven forecasting methods less effective. To address this challenge, we propose an improved algebraic derivative estimation (ADE) incorporating particle swarm optimization (PSO) for real-time traffic flow prediction. Our approach dynamically adjusts the ADE prediction time window at each step by minimizing a cost function based on the mean and variance of accumulated forecasting errors within the window, thereby balancing bias and variability. We evaluate the method using traffic data from the January 2025 California wildfires, focusing on key road segments critical for large-scale evacuations. The results demonstrate that our approach surpasses established machine learning and deep learning models—XGBoost, LSTM, and GRU—in predictive accuracy and maintains high computational efficiency. Notably, the proposed method eliminates the need for offline model training. Moreover, rapid PSO-based tuning enables real-time deployment, which provides a crucial advantage in scenarios where evacuation timings and road closures change dynamically. In conclusion, these findings highlight the benefits of the PSO-enhanced ADE framework for emergency traffic management, where rapid, data-sparse forecasts are essential for effective evacuation planning.

Algebraic derivative estimation↗

DOE OSTI2022

Estimating the impacts of natural gas power generation growth on solar electricity development: PJM's evolving resource mix and ramping capability

Abstract Expansion of distributed solar photovoltaic (PV) and natural gas‐fired generation capacity in the United States has put a renewed spotlight on methods and tools for power system planning and grid modernization. This article investigates the impact of increasing natural gas‐fired electricity generation assets on installed distributed solar PV systems in the Pennsylvania–New Jersey–Maryland (PJM) Interconnection in the United States over the period 2008–2018. We developed an empirical dynamic panel data model using the system‐generalized method of moments (system‐GMM) estimation approach. The model accounts for the impact of past and current technical, market and policy changes over time, forecasting errors, and business cycles by controlling for PJM jurisdictions‐level effects and year fixed effects. Using an instrumental variable to control for endogeneity, we concluded that natural gas does not crowd out renewables like solar PV in the PJM capacity market; however, we also found considerable heterogeneity. Such heterogeneity was displayed in the relationship between solar PV systems and electricity prices. More interestingly, we found no evidence suggesting any relationship between distributed solar PV development and nuclear, coal, hydro, or electricity consumption. In addition, considering policy effects of state renewable portfolio standards, net energy metering, differences in the PJM market structure, and other demand and cost‐related factors proved important in assessing their impacts on solar PV generation capacity, including energy storage as a non‐wire alternative policy technique. This article is categorized under: Photovoltaics > Economics and Policy Fossil Fuels > Climate and Environment Energy Systems Economics > Economics and Policy

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

A Bayesian modeling framework for crash severity effects of active traffic management systems

Transportation agencies utilize Active traffic management (ATM) systems to dynamically manage recurrent and non-recurrent congestion based on real-time conditions. While these systems have been shown to have some safety benefits, their impact on injury severity outcomes is currently uncertain. In this paper, we used full Bayesian mixed logit models to quantify the impact that ATM deployment had on crash severities. The estimation results revealed lower severities with ATM deployment. Marginal effects for ATM deployments that featured hard shoulder running (HSR) revealed lower likelihoods for severe and moderate injury crashes of 15.9 % and for minor injury crashes of 10.1 %. The likelihood of severe and moderate injury crashes and minor injury crashes reduced by 12.4 % and 8.33 % with ATM without HSR. The models were observed to be temporally transferable and had forecast error of 0.301 and 0.304 for the two models, revealing better performance with validation data. These results have implications for improving freeway crash risk at critical locations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Are better combinations of DERs more profitable?: Combinatorial optimization for aggregation of DERs in wholesale electricity markets

Recently, regulatory changes in various countries have enabled the participation of small-scale distributed energy resources (DERs) aggregated in virtual power plants (VPPs) in wholesale electricity markets. The inherent uncertainty and variability of resources comprising VPPs can lead to imbalances between forecasted and metered outputs, potentially resulting in the deficient settlement of generation under imbalance settlement rules. To address this challenge, it is essential to manage variability in the planning phase and uncertainty in the operation phase. Most current research focuses on managing forecasting errors in the operational phase, with insufficient attention given to the planning phase. Here, to bridge this gap, this paper proposes an optimal combination strategy for DERs to maximize the market participation revenue of VPPs by proactively managing variability in the planning phase. To estimate the expected revenue, we conducted analyses for homogeneous and heterogeneous DERs using Monte Carlo simulations and genetic algorithms. Remarkably, the proposed method demonstrated approximately 8 % higher revenue compared to the neighboring group case when considering diversity in DER set configuration with equal proportions of photovoltaics and wind.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Rolling Optimization of Transmission Network Recovery and Load Restoration Considering Hybrid Wind-Storage System and Cold Load Pickup

A common solution to deal with the stochasticity introduced by fast-ramping wind power integration is to equip wind farms (WFs) with energy storage systems (ESSs) to formulate hybrid WF-ESSs. In addition to leveling off wind power fluctuations during normal operations, a hybrid WF-ESS can be a flexible power source to accumulate the power system restoration. In this paper, we propose a rolling optimization model for transmission network recovery and load restoration considering the contributions of WF-ESSs. The proposed model is formulated as a mixed integer linear programming problem that simultaneously optimizes the amount and location of restorable load blocks as well as the restoration lines. The cold load pickup features of interrupted loads considering the outage duration are modeled in detail. A chance-constrained method is employed to deal with the uncertainty of wind power, and a rolling horizon-based framework is adopted to reduce the influence of forecast error. Case studies are conducted on both New England 39-bus system and part of a provincial power system in China. The results show that the load restoration process can be significantly accelerated by employing the proposed method and contributions of hybrid WF-ESSs to power system restoration are validated.

chance-constrained optimization↗

DOE OSTI2024

Reduced‐Order Modeling for Linearized Representations of Microphysical Process Rates

Abstract Representing cloud microphysical processes in large scale atmospheric models is challenging because many processes depend on the details of the droplet size distribution (DSD, the spectrum of droplets with different sizes in a cloud). While full or partial statistical moments of droplet size distributions are the typical variables used in bulk models, prognostic moments are limited in their ability to represent microphysical processes across the range of conditions experienced in the atmosphere. Microphysical parameterizations employing prognostic moments are known to suffer from structural uncertainty in their representations of inherently higher dimensional cloud processes, which limit model fidelity and lead to forecasting errors. Here we investigate how data‐driven reduced‐order modeling can be used to learn predictors for microphysical process rates in bulk microphysics schemes in an unsupervised manner from higher dimensional bin distributions. Using simulations characteristic of marine stratiform clouds, we simultaneously learn lower dimensional representations of droplet size distributions and predict the evolution of the microphysical state of the system. Droplet collision‐coalescence, the main process for generating warm rain, is estimated to have an intrinsic dimension of three. This intrinsic dimension provides a lower limit on the number of degrees of freedom needed to accurately represent collision‐coalescence in models. We demonstrate how deep learning based reduced‐order modeling can be used to discover intrinsic coordinates describing the microphysical state of the system, where process rates such as collision‐coalescence are globally linearized. These implicitly learned representations of the DSD retain more information about the DSD than typical moment‐based representations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗

DOE OSTI2021

Data assimilation empowered neural network parametrizations for subgrid processes in geophysical flows

In the past couple of years, there has been a proliferation in the use of machine learning approaches to represent subgrid-scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid-scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parametrizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parametrization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parametrization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid-scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parametrizations for future prediction. Moreover, we demonstrate that these data-driven parametrization models can handle the non-Gaussian statistics of subgrid-scale processes, and effectively improve the accuracy of outer data assimilation workflow loops in a modular nonintrusive way.

42 ENGINEERING↗

DOE OSTI2023

Characterizing HVDC Transmission Flexibility under Extreme Operating Conditions

System operators rely on system flexibility, traditionally mainly from generation, to handle unexpected reliability and resilience events, ranging from excessive resource forecast errors to extreme events like heatwaves, earthquakes, and cyberattacks. Flexible transmission, such as controllable high voltage direct current (HVDC) transmission systems present an opportunity to increase overall system flexibility to accommodate operational challenges. This paper provides a methodology to study contributions to system flexibility by controllable, power electronics based transmission. The Western Electricity Coordinating Council (WECC) system is used as an example to study contributions from existing and future HVDC lines. Under extreme system conditions, it is identified that HVDC transmission flexibility can contribute with 24.8 to 28% of avoided unserved energy, and in some areas, the benefits amount to 50 to 70%.

HVDC transmission, PCM, Balancing authorities↗

DOE OSTI2023

Flexibility Requirements for Energy Systems with Renewable Generation under Forecast Uncertainties

Energy systems with high fractions of renewable energy-based resources require adequate assets providing flexibility in electricity usage to maximize the benefits of renewable energy. In this paper, we provide an analytical approach to estimate the flexibility requirements of such energy systems, with forecast uncertainties in both demand and generation. Our analytical results show that even with forecast errors, the expected system operating cost decreases with an increase in the amount of flexibility capacity -- however, there is an inflection point, beyond which addition of further flexibility capacity does not reduce expected system cost any further. Additionally, an enumeration-based approach is presented to estimate the maximum flexibility capacity needed to optimize the operating cost. Numerical experiments conducted on a network-abstracted modified IEEE 30-bus system are used for empirical validation and gaining additional insights on the effect of prosumers' willingness to offer flexibility on the dispatch performance.

Bhattacharya, Saptarshi↗