Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “energy forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗
DOE OSTI2021

Improving the prediction of DNI with physics-based representation of all-sky circumsolar radiation

Direct normal irradiance (DNI) is often interpreted differently in ground measurements and forecasts using numerical weather prediction (NWP) models, leading to substantial bias in DNI forecasting especially under cloudy-sky conditions. To mitigate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to conduct physics-based simulations of solar radiation in the circumsolar region. The DNI is quantified using the sum of the radiation along the sun direction and the scattered radiation within the circumsolar region. FARMS-DNI is coupled with the Weather Research and Forecasting model with solar extensions (WRF-Solar) to predict day-ahead DNI in 9-km pixels over an extended domain covering the contiguous United States. The DNI forecasts for the entire year of 2018 are validated using surface-based observations at the Atmospheric Radiation Measurement (ARM) and Surface Radiation Budget Network (SURFRAD) sites and a satellite-based solar radiation product developed by the procedure of the National Solar Radiation Data Base (NSRDB). The results show that the WRF-Solar coupled with the conventional Beer-Bouguer-Lambert law underestimes the overall DNI forecasts by 30%-60%, which is a joint effect of the uncertainties in computing the circumsolar radiation and forecasting cloud properties. This bias is significantly reduced by using FARMS-DNI.

14 SOLAR ENERGY↗
DOE OSTI2020

A review on the integration of probabilistic solar forecasting in power systems

As one of the fastest growing renewable energy sources, the integration of solar power poses great challenges to power systems due to its variable and uncertain nature. As an effective approach to promote the integration of solar power in power systems, the value of probabilistic forecasts is being increasingly recognized in the recent decade. While the current use of probabilistic forecasts in power systems is limited, enormous amount of research has been conducted to promote the adoption of probabilistic forecasts and many methods have been proposed. This paper gives a comprehensive review on how probabilistic solar forecasts are utilized in power systems to address the challenges. Potential methods to deal with uncertainties in power systems are summarized, such as probabilistic load flow models, stochastic optimization, robust optimization, and chance constraints. Additionally, specific areas where these methods can be applied are discussed and state-of-the-art studies are summarized.

14 SOLAR ENERGY↗
DOE OSTI2025

ASEAN Technical Exchange Workshop for System Operators, Regulators, and Policymakers

This presentation provides an in-depth exploration of power system planning, cross-border electricity trading, and battery energy storage systems (BESS), offering actionable insights for system operators, regulators, and policymakers. The first section delves into power system planning and analysis, focusing on capacity expansion models and resource adequacy studies, including their role in optimizing system efficiency, managing emissions, and addressing system reliability risks. Key considerations, such as integration of transmission into generation planning and the forecasting versus optimization of customer distributed energy resources (DER) technologies, are explored. The session highlights critical trade-offs in spatial granularity and model runtimes, as well as the feasibility of aligning distribution investments with capacity expansion efforts. The second section examines cross-border electricity trading, with an emphasis on resource adequacy concepts such as reliability targets, loss of load expectation (LOLE), and planning reserve margins (PRM). Case studies on reserve market design and coordination across US regions provide insights into improving reserve deliverability and managing interregional power balance and congestion. This section also addresses market-to-market congestion management, including advanced strategies for high-voltage direct current (HVDC) optimization and ancillary service delivery. Finally, the presentation covers the rapid evolution of Battery Energy Storage Systems (BESS), highlighting their operational growth, regulatory frameworks, and use cases in grid flexibility, energy storage, and reliability. The discussion focuses on the benefits of BESS for system stability, resilience, and integration of renewable energy, offering insights into its role as a vital component in the transition toward a more sustainable and flexible grid. Key performance parameters, such as throughput, round-trip efficiency, and state of charge, are also examined.

25 ENERGY STORAGE↗
DOE OSTI2020

Development and Evaluation of Occupancy-Aware Model Predictive Control for Residential Building Energy Efficiency and Occupant Comfort

The residential sector accounts for 25% of global primary energy consumption. Two methods have previously been proposed to reduce residential energy use associated with the provision of occupant thermal comfort: 1. Occupancy-based HVAC control, operating systems only during confirmed occupancy, and 2. model predictive control (MPC), harnessing a mathematical model and forecasts to find optimal operating strategies. Previous studies estimate the average energy savings of the two methods individually in the range of 21% and 16%, respectively. The research presented herein was carried out to evaluate the energy savings potential in residential buildings by combining both approaches across different climates, house vintages, and occupancy patterns. Occupancy and eight different physical modalities (e.g. CO2 and VOC) data were collected from five homes for time periods of 4–9 weeks. Collected data sets were used to train occupancy prediction models suggested by an extensive literature survey of occupancy model types. The trained prediction models were combined with MPC and detailed EnergyPlus building simulation models to evaluate residential building performance in terms of annual energy savings and thermal comfort, along with discomfort exceedance metrics. Multiple home types and regions were analyzed to understand regional and climate-dependent potential. Based on actual field data, the occupancy models had a prediction inaccuracy between 8% and 35% across the investigated homes. Average occupancy for the collected data ranged from 56% to 86%, a typical range reported in the literature. Building simulations were conducted for three control scenarios: conventional thermostatic control, occupancy-based, and occupancy-based MPC. The results indicate that all advanced strategies improve upon the conventional control, with some scenarios cutting energy use in half with only occasional incurrence of discomfort. The findings indicate that occupancy-aware model predictive residential building control has the potential to drastically reduce energy use and associated emissions while maintaining occupant comfort for both new and existing buildings.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2024

Representative Period Selection for Robust Capacity Expansion Planning in Low-carbon Grids

With the increasing urgency to decarbonize power systems, while mitigating extreme events, capacity expansion models can play a vital role in reliably planning the expansion of power systems and facilitating the integration of renewable energy sources. Optimizing capacity expansion generally involves selecting surrogate representative days from forecasts of load and the generation profiles of variable renewable energy resources. To properly select those representative days, we propose a novel input-based approach in combination with the k-means clustering algorithm that utilize three unique operational inputs: load shedding, renewable curtailment, and transmission congestion. The proposed method allows for more robust and cost-effective capacity planning. The method is validated using a capacity expansion model and a production cost model based on California Independent System Operator (CAISO)'s decarbonization goals, and results in reduced costs and drastically lower load shedding.

Anderson, Osten P.↗
DOE OSTI2022

A Review of Behind-the-Meter Solar Generation Modeling and Forecasting

Solar photovoltaic systems largely integrated within the distribution grid are operated 'behind-the-meter' and power generation cannot be directly monitored by most utilities. The increasing penetration of behind-the-meter solar photovoltaic systems can deter efficient network and market operations due to variability and uncertainty in net load, which is exacerbated by limited visibility and the difficulty in analyzing the hosting capacity. Risk introduced by behind-the-meter solar contributions may hinder reliable and secure grid operations due to biased system monitoring and forecasts. Accurate behind-the-meter estimations, together with capacity and specification forecasts, thus play a key role in balancing supply and demand and this article reviews the pertinent literature, identifying key characteristics and predictive methods for efficient behind-the-meter solar photovoltaic generation. Forecasting is central to methods herein. The fundamental characteristics of behind-the-meter solar forecasting, including which methods are applicable for scenario-driven use cases, are driven by the metrics most useful for system-wide performance evaluation. To this aim, the literature is reviewed with a focus on forecasting applications for aggregate, regional behind-the-meter generation useful to bulk system and utility operations. As distinguished from net load forecasting, subtleties in these coincident tasks are explored before concluding with recommendations for current practice and future implementations.

behind-the-meter↗
DOE OSTI2020

Benchmark probabilistic solar forecasts: Characteristics and recommendations

We illustrate and compare commonly used benchmark, or reference, methods for probabilistic solar forecasting that researchers use to measure the performance of their proposed techniques. A thorough review of the literature indicates wide variation in the benchmarks implemented in probabilistic solar forecast studies. To promote consistent and sensible methodological comparisons, we implement and compare ten variants from six common benchmark classes at two temporal scales: intra-hourly forecasts and hourly resolution forecasts. Using open-source Surface Radiation Budget Network (SURFRAD) data from 2018, these benchmark methods are compared using proper probabilistic metrics and common diagnostic tools. Practical implementation issues, such as the impact of missing data and applicability for operational forecasting, are also discussed. Furthermore, we make recommendations for practitioners on the appropriate selection of benchmark methods to properly showcase state-of-the-art improvements in forecast reliability and sharpness. All code and open-source data are available on Github for reproducibility and for other researchers to apply the same benchmark methods to their own data.

14 SOLAR ENERGY↗
DOE OSTI2020

Distributed Generation Market Demand (dGen) model

The Distributed Generation Market Demand (dGen) model simulates customer adoption of distributed energy resources (DERs) for residential, commercial, and industrial entities in the United States or other countries through 2050. The dGen model can be used for identifying the sectors, locations, and customers for whom adopting DERs would have a high economic value, for generating forecasts as an input to estimate distribution hosting capacity analysis, integrated resource planning, and load forecasting, and for understanding the economic or policy conditions in which DER adoption becomes viable, and for illustrating sensitivity to market and policy changes such as retail electricity rate structures, net energy metering, and technology costs.

Array↗
DOE OSTI2023

Anomaly detection for MPC forecast in Fleet of Water Heaters

Among residential devices, water heaters consume 20% of home energy use in the United States. Water heaters possess the capability to store energy within their reservoirs, enabling the ability to decouple energy use from hot water use. This capability can be used to reduce energy usage and costs while also supporting grid services. This requires accurate forecasting of the parameters of the water heater such as upper and lower temperatures. In this study, we analyzed the performance and behavior of a water heater model used in the real-world to predict a control mechanism that is implemented in a smart residential neighborhood. The model forecasts are accurate in most cases but not all. In such scenarios, error correction of the model is necessary to further improve model predictive control accuracy. Anomaly detection is the first step of error correction. This study complements existing research by grouping time series data into two clusters one with anomalies and another without anomalies. To achieve this task, we explored and compared multiple unsupervised machine learning algorithms to perform clustering. Among these algorithms, Ward clustering has the lowest running time and identified the highest number of anomalies for the upper temperature limit. The proposed approach is tested based on the data collected in a neighborhood with 46 townhomes located in Atlanta, GA.

Lebakula, Viswadeep↗
DOE OSTI2023

The winter central Arctic surface energy budget: A model evaluation using observations from the MOSAiC campaign

This study evaluates the simulation of wintertime (15 October, 2019, to 15 March, 2020) statistics of the central Arctic near-surface atmosphere and surface energy budget observed during the MOSAiC campaign with short-term forecasts from 7 state-of-the-art operational and experimental forecast systems. Five of these systems are fully coupled ocean-sea ice-atmosphere models. Forecast systems need to simultaneously simulate the impact of radiative effects, turbulence, and precipitation processes on the surface energy budget and near-surface atmospheric conditions in order to produce useful forecasts of the Arctic system. This study focuses on processes unique to the Arctic, such as, the representation of liquid-bearing clouds at cold temperatures and the representation of a persistent stable boundary layer. It is found that contemporary models still struggle to maintain liquid water in clouds at cold temperatures. Given the simple balance between net longwave radiation, sensible heat flux, and conductive ground flux in the wintertime Arctic surface energy balance, a bias in one of these components manifests as a compensating bias in other terms. This study highlights the different manifestations of model bias and the potential implications on other terms. Three general types of challenges are found within the models evaluated: representing the radiative impact of clouds, representing the interaction of atmospheric heat fluxes with sub-surface fluxes (i.e., snow and ice properties), and representing the relationship between stability and turbulent heat fluxes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The physical origin of dark energy constraints from rubin observatory and CMB-S4 lensing tomography

ABSTRACT We seek to clarify the origin of constraints on the dark energy equation of state parameter from CMB lensing tomography, that is the combination of galaxy clustering and the cross-correlation of galaxies with CMB lensing in a number of redshift bins. We focus on the analytic understanding of the origin of the constraints. Dark energy information in these data arises from the influence of three primary relationships: distance as a function of redshift (geometry), the amplitude of the power spectrum as a function of redshift (growth), and the power spectrum as a function of wavenumber (shape). We find that the effects from geometry and growth play a significant role and partially cancel each other out, while the shape effect is unimportant. We also show that Dark Energy Task Force figure of merit forecasts from the combination of LSST galaxies and CMB-S4 lensing are comparable to the forecasts from cosmic shear in the absence of the CMB lensing map, thus providing an important independent check. Compared to the forecasts with the LSST galaxies alone, combining CMB lensing and LSST clustering information increases the FoM by roughly a factor of 3–4 in the optimistic scenario where systematics are fully under control. We caution that achieving these forecasts will likely require a full analysis of higher-order biasing, photometric redshift uncertainties, and stringent control of other systematic limitations, which are outside the scope of this work, whose primary purpose is to elucidate the physical origin of the constraints.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Considerations for Long-Term Load Forecasting in Morocco

There are many factors that determine how demand for electricity may change over time. These factors include GDP, population size, and technology diffusion and adoption. We employ a simple extrapolation of current trends in Morocco GDP to estimate how the peak demand and annual consumption may change through the year 2030. We discuss the many factors that this approach does not take into account (such as adoption of air conditioning, electric vehicles, and distributed generation).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗
DOE OSTI2025

A Scientist-in-the-Loop Data Analytics Framework for Intelligent Simulation Model Tuning and Validation

This project developed a scientist-in-the-loop data analytics framework for intelligent simulation model tuning and validation, targeting the Weather Research and Forecasting (WRF) model and its solar energy variant, WRF-Solar-BNL. Domain experts, such as climate scientists, depend on large-scale numerical simulations for knowledge discovery and decision-making, yet the complexity of parameter tuning and the disconnect between automated optimization and domain expertise pose significant challenges. We extended an interactive visual analytics framework that enables domain experts to observe and intervene in the computational steering process by identifying disagreements between the simulation model, surrogate model, and the expert’s domain knowledge. Using Bayesian Optimization with Gaussian Process Regression as the surrogate model, our system allows users to probe parameter relationships, analyze correlation patterns, and adjust tuning parameters in real time. We developed use cases for solar irradiance forecasting through sustained collaboration with Brookhaven National Laboratory, resolving critical model configuration challenges and achieving meaningful reductions in prediction error. The project supported one PhD student, one MS student, and eight undergraduate students across three Data Science Capstone projects, resulting in one master’s thesis.

Dasgupta, Aritra [New Jersey Institute of Technolo↗
DOE OSTI2023

Distributed Wind-Hybrid Microgrids with Autonomous Controls and Forecasting

Distributed wind-hybrid microgrids have the potential to provide key resilience and economic benefits to both the customers they serve and the utility grids they are connected to. Such microgrids will likely be a key part of the grid of the future, whether connected to large utility grids or linked together in multi-microgrid systems. Through the hybridization of distributed wind and solar photovoltaics, autonomous device-level and system-level controls, battery energy storage systems with smart inverters, and forecasting, these microgrids could maintain local stability and provide grid services - all with renewable power. In the literature, these elements have been considered individually. However, they have not been combined and demonstrated at a high fidelity, which is essential to prove the concept's operation before moving to hardware-in-the-loop and physical demonstrations. In this work, we develop a high-fidelity MATLAB-Simulink model of a real distributed wind-hybrid microgrid that includes all these elements. We demonstrate the microgrid maintaining stability and production in a variety of islanded, grid-connected, and transition scenarios. This includes riding through faults and grid transitions, handling resource variability, and providing grid services. The results demonstrate, at a high fidelity, how distributed wind-hybrid microgrids can operate in an economic and resilient fashion. Finally, we provide recommendations for future research to move advanced distributed wind-hybrid microgrids toward deployment.

ancillary services↗
DOE OSTI2025

Updating Nuclear Energy Cost Estimates for Net Zero World Initiative

Energy modeling of decarbonized scenarios in integrated energy systems requires nuclear energy parameters that are critical for forecasting, modeling and cost structure analysis. Using updated real-world data has always been a challenge to estimate current nuclear reactors costs and deployment scenarios. Given this, an updated set of parameters for overnight capital costs and operation and maintenance costs are estimated for the Net Zero World initiative using recent reports that provided a vast set of open sources data inputs. This paper follows the methodology developed in the Net Zero World report and applies the new ranges estimated in the Gateway for Accelerated Innovation in Nuclear report that address many of the current challenges in obtaining accurate cost data for advanced nuclear concepts. The final goal is to provide new estimates of the overnight capital costs and operational costs for different countries. The present paper improves the earlier capital cost estimations, building on recent literature that aims to obtain accurate data for modeling and simulation to enhance energy system evaluations and support decision-making in areas like de-carbonization and capacity expansion. Finally, the paper compares the new cost estimates with the old cost results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

EV Charging Infrastructure Energization An Overview of Approaches for Simplifying and Accelerating Timelines to Processing EV Charging Load Service Requests

The United States has seen significant growth in electric vehicle (EV) adoption, leading to increased demand for EV charging infrastructure. Over the past decade, EV charging infrastructure site developers, site hosts, and electric distribution utilities have navigated the process to integrate chargers onto the electric grid. Site developers and site hosts have raised the alarm that the integration process for high-powered EV charging projects does not meet the needs of the EV market for timeliness or cost. High-powered charging stations typically require a load service request or an agreement with the local utility to connect to the grid. The process of energizing a new high-powered charging site can be complex and time-consuming, often taking up to 2 years. This timeline is the result of current utility energization processes having been designed for construction projects that take longer to build (i.e., buildings). The specific challenges stem from various factors, including compartmentalization in application processes, the integration of EV charging process approvals with other distributed energy resources (DERs), and the need to ensure grid reliability. The energization process needs to evolve to meet the growing demand for high-powered EV charging. This white paper compiles information gathered through various conversations with key stakeholders, including utilities, utility regulators, EV charging operators, site developers, and authorities having jurisdiction (AHJ) as well as through an extensive literature review. This document identifies the challenges and provides potential solutions to streamline the process of connecting EV charging infrastructure to the power grid in the United States, serving as a starting point for future conversations around these solutions. The solutions noted in this white paper require collaborative efforts among utilities, regulators, and EV charging infrastructure developers to streamline the grid connection process for EV charging infrastructure. They are broadly organized into four areas: 1. Increase data access and transparency: Develop automated load service request tools, integrate hosting capacity and load service request analyses, incorporate EV adoption forecasts, and provide transparency on the processing queue. 2. Improve energization processes and timing: Create fast-track options based on prescreening criteria, provide flexibility or phased approvals in the load service request/interconnection process, build internal knowledge within utilities about EV charging technologies, and provide standardized workforce training. 3. Promote economic efficiency: Right size distribution components to accurately reflect the load requirements of EV charging infrastructure, make proactive investments in grid infrastructure based on EV adoption forecasts and growth projections, and consider energy equity and environmental justice factors such as equitable access to EV charging when planning infrastructure. 4. Improve grid reliability and resilience: Use load management/power control systems (PCS) at EV charging stations, adopt and implement harmonized standards for communication protocols and information models between the EV charging and grid control infrastructure, and address cybersecurity considerations by implementing robust security measures and standards for EV charging infrastructure—with particular emphasis on clarifying the security requirements for the interface to the grid. The objective of the solutions proposed in this white paper is to accelerate the timeline and decrease costs associated with connecting EV charging infrastructure to the grid. Electric utilities, utility regulators, EV charging infrastructure developers, and site hosts will first need to understand which solutions are available in their service territory, and if warranted, which combination of solutions would support their specific needs. Through the successful implementations of solutions at scale detailed here, industry will demonstrate a new and innovative ecosystem where timely deployment and energization of EV charging infrastructure with greater grid resiliency and reliability is a reality.

24 POWER TRANSMISSION AND DISTRIBUTION↗