Improvement of Aerosol Optical Depth Data for Localized Solar Forecasting
This presentation provides an overview of the improvement of aerosol optical depth data for localized solar forecasting.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation provides an overview of the improvement of aerosol optical depth data for localized solar forecasting.
Inherent variability in photovoltaic (PV) and associated impacts on power systems is a challenging problem for both the PV owners and the grid operators. Existing statistical and machine learning algorithms typically work well for weather conditions similar to historical data. Furthermore, uncertain weather conditions pose a great challenge to the estimation accuracy of the estimation models. With the enhanced integration of intelligent electronic devices and the realization of associated automation in the power grid, renewable energy data is becoming more accessible, which can be utilized by deep learning models and improve the PV power generation estimation accuracy. In this paper, a hybrid deep learning model driven by external weather data is proposed to do day-ahead PV output forecasting at 15-minute-interval. The proposed model is motivated by the recent advancement of Long-Short-Term-Memory (LSTM) networks and AutoEncoder (AE), which estimates uncertainties in sequence while making the prediction for complex weather conditions. Meanwhile, the persistence model (PM) is used to predict continuous sunny weather conditions. The forecasting result is validated with data from multiple locations
Abstract Doppler-lidar wind-profile measurements at three sites were used to evaluate NWP model errors from two versions of NOAA’s 3-km-grid HRRR model, to see whether updates in the latest version 4 reduced errors when compared against the original version 1. Nested (750-m grid) versions of each were also tested to see how grid spacing affected forecast skill. The measurements were part of the field phase of the Second Wind Forecasting Improvement Project (WFIP2), an 18-month deployment into central Oregon–Washington, a major wind-energy-producing region. This study focuses on errors in simulating marine intrusions, a summertime, 600–800-m-deep, regional sea-breeze flow found to generate large errors. HRRR errors proved to be complex and site dependent. The most prominent error resulted from a premature drop in modeled marine-intrusion wind speeds after local midnight, when lidar-measured winds of greater than 8 m s −1 persisted through the next morning. These large negative errors were offset at low levels by positive errors due to excessive mixing, complicating the interpretation of model “improvement,” such that the updates to the full-scale versions produced mixed results, sometimes enhancing but sometimes degrading model skill. Nesting consistently improved model performance, with version 1’s nest producing the smallest errors overall. HRRR’s ability to represent the stages of sea-breeze forcing was evaluated using radiation budget, surface-energy balance, and near-surface temperature measurements available during WFIP2. The significant site-to-site differences in model error and the complex nature of these errors mean that field-measurement campaigns having dense arrays of profiling sensors are necessary to properly diagnose and characterize model errors, as part of a systematic approach to NWP model improvement. Significance Statement Dramatic increases in NWP model skill will be required over the coming decades. This paper describes the role of major deployments of accurate profiling sensors in achieving that goal and presents an example from the Second Wind Forecast Improvement Program (WFIP2). Wind-profile data from scanning Doppler lidars were used to evaluate two versions of HRRR, the original and an updated version, and nested versions of each. This study focuses on the ability of updated HRRR versions to improve upon predicting a regional sea-breeze flow, which was found to generate large errors by the original HRRR. Updates to the full-scale HRRR versions produced mixed results, but the finer-mesh versions consistently reduced model errors.
Multiple technological, social, and market factors of wind power are evolving rapidly. Most notably, significant wind turbine scaling is occurring and is forecasted to continue. While the larger turbines expected to be deployed in the future are more powerful and efficient, they are also expected to operate at higher sound levels and require larger setbacks than those installed in the last decade. These sometimes-competing deployment trends and impacts cannot be understood via simple extrapolations of past trends. This study analyzes the effect of these future larger turbines on wind turbine micro-siting, project-level power and energy density, and community noise impacts. Due to their taller heights, larger rotors, and higher sound power levels, future wind turbines will require larger setbacks from homes and greater inter-turbine spacing, resulting in fewer turbines deployed for a given land area. This research finds these changes more than offset the effect of the higher turbine sound emissions, significantly decreasing the average sound levels that wind plant hosting communities experience. Yet, simultaneously, plant layouts using future turbine designs also result in projects with higher installed capacities and annual energy output for a given land area. These increases will likely lead to increased tax benefits and local income in the community. The deployment of fewer turbines on a smaller number of parcels could have implications on siting flexibility and landowner payments.
Arctic observations are becoming increasingly valuable as researchers investigate climate change and its associated concerns, such as decreasing sea ice and increasing ship traffic. Networks of sensors with frequent sampling capabilities are needed to run forecast models, improve navigation, and inform climate research. Sampling frequency and deployment duration are currently constrained by battery power limitations. In-situ power generation using marine renewable energy sources such as waves and currents can be used to circumvent this constraint. Wave and current resources vary spatially and temporally in the Arctic, with some locations and seasons being better suited for marine renewable energy power generation. Locations and seasons with small resources may still be able to use marine renewable energy because of the low power requirements of the instruments. In this study, we describe the wave and current resources in the Arctic, outline the electricity generation developments that are needed to utilize the resources, and suggest use cases. Wave and current energy converters developed to power observations in the Arctic could also be used to power observations at lower latitudes. Marine renewable energy has the potential to decrease dependence on batteries and improve data collection capabilities in the Arctic; however, this would require the development of new low power technologies that can operate in extreme Arctic environments.
The process of time-series forecasting such as predicting trajectories of silicon content in blast furnaces is a difficult task. Most time-series approaches today focus on scalar-type MSE loss optimization. This optimization approach, while widely common, could benefit from the use of human expert or process-level preferences. In this paper, we introduce a novel alignment and fine-tuning approach that involves learning from a corpus of preferred and dis-preferred time-series prediction trajectories. Our contributions include (1) a preference annotation pipeline for time-series forecasts, (2) the application of Score-based Preference Optimization (SPO) to train decoder-only transformers from preferences, and (3) results showing improvements in forecast quality. The approach is validated on both proprietary blast furnace data and the UCI Appliances Energy dataset. The proposed preference corpus and training strategy offer a new option for fine-tuning sequence models in industrial settings.
The thermal Sunyaev-Zel’dovich (tSZ) effect induces a Compton-$\mathit{y}$ distortion in cosmic microwave background (CMB) temperature maps that is sensitive to a line-of-sight integral of the ionized gas pressure. By correlating the positions of galaxies with maps of the Compton-$\mathit{y}$ distortion, one can probe baryonic feedback processes and study the thermodynamic properties of a significant fraction of the gas in the Universe. Using a model fitting approach, we forecast how well future galaxy and CMB surveys will be able to measure these correlations, and show that powerful constraints on halo pressure profiles can be obtained. In this work, our forecasts are focused on correlations between galaxies and halos identified by the upcoming Dark Energy Spectroscopic Instrument survey and tSZ maps from the Simons Observatory and CMB-S4 experiments, but have general applicability to other surveys, such as the Large Synoptic Survey Telescope. We include prescriptions for observational systematics, such as halo miscentering and halo mass bias, demonstrating several important degeneracies with pressure profile parameters. Assuming modest priors on these systematics, we find that measurements of halo-$\mathit{y}$ and galaxy-$\mathit{y}$ correlations with future surveys yield tight constraints on the pressure profiles of group-scale dark matter halos, and enable current feedback models to either be confirmed or ruled out.
Simulated hourly electric vehicle charging profiles for light-duty household passenger vehicles in the contiguous United States, 2018-2050. Profiles are differentiated by scenario, county, household and vehicle types, and charging type. Data was produced in 2022 using the Transportation Energy & Mobility Pathway Options (TEMPO) model and published in demand-side grid (dsgrid) toolkit format. Data are available for three adoption scenarios: "AEO Reference Case", which is aligned with the U.S. EIA Annual Energy Outlook 2018 (linked below), "EFS High Electrification", which is aligned with the High Electrification scenario of the Electrification Futures Study (linked below), and "All EV Sales by 2035", which assumes that average passenger light-duty EV sales reach 50% in 2030 and 100% in 2035. The charging shapes are derived from two key assumptions of which data users should be aware: "ubiquitous charger access", meaning that drivers of vehicles are assumed to have access to a charger whenever a trip is not in progress, and "immediate charging", meaning that immediately after trip completion, vehicles are plugged in and charge until they are either fully recharged or taken on another trip. These assumptions result in a bounding case in which vehicles' state of charge is maximized at all times. This bounding case would minimize range anxiety, but is unrealistic from the point of view of both electric vehicle service equipment (EVSE) (i.e., charger) access, and plug-in behavior as it can result in dozens of charging sessions per week for battery electric vehicles (BEVs) that in reality are often only plugged in a few times per week.
Recent observational studies have confirmed the existence of a robust statistical relationship between lightning flash rates and the amount of large precipitating ice hydrometeors in storms. This relationship is exploited, in conjunction with the capabilities of recent forecast models such as WRF, to forecast the threat of lightning from convective storms using the output fields from the model forecasts. The simulated vertical flux of graupel at -15C is used in this study as a proxy for charge separation processes and their associated lightning risk. Six-h simulations are conducted for a number of case studies for which three-dimensional lightning validation data from the North Alabama Lightning Mapping Array are available. Experiments indicate that initialization of the WRF model on a 2 km grid using Eta boundary conditions, Doppler radar radial velocity and reflectivity fields, and METAR and ACARS data yield the most realistic simulations. An array of subjective and objective statistical metrics are employed to document the utility of the WRF forecasts. The simulation results are also compared to other more traditional means of forecasting convective storms, such as those based on inspection of the convective available potential energy field.
To date there have been multiple satellite missions to observe and retrieve cloud top properties and the liquid in, and precipitation from, clouds. There are currently a few missions that attempt to measure cloud ice properties as a byproduct of other observations. However, we do not yet quantitatively understand the processes that control the water budget of the upper troposphere where ice is the predominant phase, and how these processes are linked to precipitation processes and the radiative energy budget. The ice in clouds either melts into rain or is detrained, and persists, as cirrus clouds affecting the hydrological and energy cycle, respectively. Fully modeling the Earth's climate and improving weather and climate forecasts requires accurate satellite measurements of various cloud properties at the temporal and spatial scales of cloud processes. The uncertainty in knowledge of these ice characteristics is reflected in the large discrepancies in model simulations of the upper tropospheric water budget. Model simulations are sensitive to the partition of ice between precipitation and outflow processes, i.e., to the parameterization of ice clouds and ice processes. This presentation will describe the Submillimeter-wave InfraRed Ice Cloud Experiment (SIRICE) concept, a satellite mission designed to acquire global Earth radiance measurements in the infrared and submillimeter-wave region (183-874 GHz). If successful, this mission will bridge the measurement gap between microwave sounders and shorter-wavelength infrared and visible sensors. The brightness temperatures at submillimeter-wave frequencies are especially sensitive to cirrus ice particle sizes (because they are comparable to the wavelength). This allows for more accurate ice water path estimates when multiple channels are used to probe into the cloud layers. Further, submillimeter wavelengths offer simplicity in the retrieval algorithms because they do not probe into the liquid and near surface portions of clouds, thus requiring only one term of the radiative transfer equation (ice scattering) to relate brightness temperatures to ice. Scientific justification and the SIRICE approach to measuring ice water path and particle size that span a range encompassing both the hydrologically active and radiatively active components of cloud systems will be presented.
Tropical Rainfall Measuring Mission (TRMM)lightning and precipitation observations have confirmed the existence of a robust relationship between lightning flash rates and the amount of large precipitating ice hydrometeors in storms. This relationship is exploited, in conjunction with the capabilities of the Weather Research and Forecast (WRF) model, to forecast the threat of lightning from convective storms using the output fields from the model forecasts. The simulated vertical flux of graupel at -15C is used in this study as a proxy for charge separation processes and their associated lightning risk. Initial experiments using 6-h simulations are conducted for a number of case studies for which three-dimensional lightning validation data from the North Alabama Lightning Mapping Array are available. The WRF has been initialized on a 2 km grid using Eta boundary conditions, Doppler radar radial velocity and reflectivity fields, and METAR and ACARS data. An array of subjective and objective statistical metrics is employed to document the utility of the WRF forecasts. The simulation results are also compared to other more traditional means of forecasting convective storms, such as those based on inspection of the convective available potential energy field.
The parameterization of the stably stratified atmospheric boundary layer is a difficult issue, which has a large impact on the medium-range weather forecasts and on climate integrations. A non-strongly stratified arctic case is simulated by nineteen single-column turbulence schemes. The statistics from the Large-eddy simulation (LES) intercomparison made for the same case by eight different models are used as a guiding reference. The single-column parameterizations include research schemes and operational schemes from major forecast and climate research centres. First order schemes, a large number of turbulence kinetic energy closures, and other proposals have submitted results. There is a large spread in the results; in general, the operational schemes mix more efficiently than the research ones, and the TKE and other higher order closures give results closer to the LES statistics. The sensitivities of the schemes to the parameters of their turbulence closures are partially explored.
There are many satellite observations of cloud top properties and the liquid and rain content of clouds, however, we do not yet quantitatively understand the processes that control the water budget of the upper troposphere where ice is the predominant phase, and how these processes are linked to precipitation processes and the radiative energy budget. The ice in clouds in the upper troposphere either melts into rain or is detrained, and persists, as cirrus clouds affecting the hydrological and energy cycle, respectively. Fully modeling the Earth's climate and improving weather and climate forecasts requires accurate satellite measurements of various cloud properties at the temporal and spatial scales of cloud processes. These properties include cloud horizontal and vertical structure, cloud water content and some measure of particle sizes and shapes. The uncertainty in knowledge of these ice characteristics is reflected in the large discrepancies in model simulations of the upper tropospheric water budget. Model simulations are sensitive to the partition of ice between precipitation and outflow processes, i.e., to the parameterization of ice clouds and ice processes. One barrier to achieving accurate global ice cloud properties is the lack of adequate observations at millimeter and submillimeter wavelengths (183-874 GHz). Recent advances in instrumentation have allowed for the development and implementation of an airborne submillimeter-wave radiometer. The brightness temperatures at these frequencies are especially sensitive to cirrus ice particle sizes (because they are comparable to the wavelength). This allows for more accurate ice water path estimates when multiple channels are used to probe into the cloud layers. Further, submillimeter wavelengths offer simplicity in the retrieval algorithms because they do not probe into the liquid and near surface portions of clouds, thus requiring only one term of the radiative transfer equation (ice scattering) to relate brightness temperatures to ice. The next step is a satellite mission designed to acquire global Earth radiance measurements in the submillimeter-wave region, thus bridging the measurement gap between microwave sounders and shorter-wavelength infrared and visible sensors. This presentation provides scientific justification and an approach to measuring ice water path and particle size from a satellite platform that spans a range encompassing both the hydrologically active and radiatively active components of cloud systems.
An observing system simulation experiment (OSSE) was performed to assess the impact of assimilating hyperspectral infrared (IR) radiances from geostationary orbit on numerical weather prediction, with a focus on the proposed sounder on board the Geostationary Extended Observations (GeoXO) program’s central satellite. Infrared sounders on a geostationary platform would fill several gaps left by IR sounders on polar-orbiting satellites, and the increased temporal resolution would allow the observation of weather phenomena evolution. The framework for this OSSE was the Global Modeling and Assimilation Office (GMAO) OSSE system, which includes a full suite of meteorological observations. The experiment additionally assimilated four identical IR sounders from geostationary orbit to create a “ring” of vertical profiling observations. Based on the experimentation, assimilation of the IR sounders provided a beneficial impact on the analyzed mass and wind fields, particularly in the tropics, and produced an error reduction in the initial 24–48 h of the subsequent forecasts. Specific attention was paid to the impact of the GeoXO Sounder (GXS) over the contiguous United States (CONUS) as this is a region that is well-observed and as such difficult to improve. The forecast sensitivity to observation impact (FSOI) metric, computed across all four synoptic times over the CONUS, reveals that the GXS had the largest impact on the 24-h forecast error of the assimilated hyperspectral infrared satellite radiances as measured using a moist energy error norm. Based on this analysis, the proposed GXS has the potential to improve numerical weather prediction globally and over the CONUS.
As global demand for sustainable development grows, the integration of Earth Observation (EO) data into decision making frameworks has become a primary objective for the scientific community. The NASA Prediction of Worldwide Energy Resources (POWER) project serves as a bridge between NASA EO data and the specialized needs of the renewable energy, sustainable infrastructure and agroclimatology communities. In this poster presentation we will present an overview of POWER data products and services along with its use in diverse research to decision-making workflows. By providing over 40 years of high-resolution historical, hourly and daily solar and meteorological data, POWER transforms satellite observations and global model reanalysis into actionable, Analysis-Ready Dataset (ARD). Currently, the project delivers over 250 industry-friendly parameters to the users from different NASA datasets like CERES SYN1Deg, MERRA-2, and IMERG alongside downscaled CMIP6 climate model data, fulfilling over 16 million requests from 50,000 unique users monthly. To ensure data quality and traceability, these parameters are rigorously validated against the ground-based observations from the Baseline Surface Radiation Network (BSRN) and the Global Surface Summary of the Day (GSOD) – these results will be discussed in the presentation. A newly introduced web-based PaRameter Uncertainty ViEwer (PRUVE) tool will be presented that provides an online validation platform to the users that benchmarks satellite-based and assimilation data products against these surface measurements. To reduce technical barriers to data adoption, POWER data is accessible through RESTful APIs, ESRI ArcGIS Image Services, a web-based Data Access Viewer tool, allowing users to visualize, validate and apply the dataset. For efficient data delivery POWER data is cloud-optimized into Zarr datastore accessible through NASA managed Amazon S3 ensures high-performance allowing users to integrate EO directly into operational pipelines. These customized services will be presented. Use cases from application will be presented from the energy sector - such as for design of generation systems, performance monitoring of solar power plants, in infrastructure sector- optimizing building energy efficiency and thermal comfort, in agriculture – such as driving crop simulation and yield forecasting models to enable climate resilient farming. Furthermore, the shift toward machine learning (ML) in EO research that has positioned POWER as a key provider for training datasets which will be discussed. Use-cases will be presented to showcase how NASA data is enabling the development of predictive tools for climate variability and resource management. The poster will present POWER’s future plans including technology development to enhance data traceability and reproducibility and improving I/O performance to support the rapid integration of new EO products, ensuring that POWER remains a robust scalable backend for the evolving landscape of AI-driven Earth Science. Additionally, POWER is developing an AI Agent and an MCP-Server to enable industry AI-Agentic workflows.
The Solar Uncertainty Management and Mitigation for Exceptional Reliability in Grid Operation (SUMMER-GO) project was recently completed through a collaboration among the National Renewable Energy Laboratory, Maxar, the Electric Reliability Council of Texas (ERCOT), the University of Texas at Dallas, the University of California Berkeley, and the University of Colorado Boulder. The project made significant advances in probabilistic solar power forecasting, both through the development of Bayesian model averaging methods for ensemble forecasting and in bringing these and other advancements into practice with Maxar's delivery of operational forecasts to ERCOT. In addition to creating more reliable solar power forecasts, the project developed methods for their utilization in power system operations. These include the development of risk-aware unit commitment and economic dispatch algorithms and methods to reformulate probabilistic forecasts to be used in these power system operational models. Dynamic power system reserve methods were also developed, which have been shown in silico to create economic savings and reliability improvements on an ERCOT-like system as well as financial savings in the ERCOT system through more granular consideration of the uncertainty associated with solar power forecasts. Finally, a situational awareness tool to help grid operators better understand solar power forecast uncertainty in daily operations was developed and extensively vetted.
Mesoscale-to-microscale coupling is an important tool for conducting turbulence-resolving multiscale simulations of realistic atmospheric flows, which are crucial for applications ranging from wind energy to wildfire spread studies. Different techniques are used to facilitate the development of realistic turbulence in the large-eddy simulation (LES) domain while minimizing computational cost. Here, we explore the impact of a simple and computationally efficient Stochastic Cell Perturbation method using momentum perturbation (SCPM-M) to accelerate turbulence generation in boundary-coupled LES simulations using the Weather Research and Forecasting model. We simulate a convective boundary layer (CBL) to characterize the production and dissipation of turbulent kinetic energy (TKE) and the variation of TKE budget terms. Furthermore, we evaluate the impact of applying momentum perturbations of three magnitudes below, up to, and above the CBL on the TKE budget terms. Momentum perturbations greatly reduce the fetch associated with turbulence generation. When applied to half the vertical extent of the boundary layer, momentum perturbations produce an adequate amount of turbulence. However, when applied above the CBL, additional structures are generated at the top of the CBL, near the inversion layer. The magnitudes of the TKE budgets produced by SCPM-M when applied at varying heights and with different perturbation amplitudes are always higher near the surface and inversion layer than those produced by No-SCPM, as are their contributions to the TKE. This study provides a better understanding of how SCPM-M reduces computational costs and how different budget terms contribute to TKE in a boundary-coupled LES simulation.