Building Physics-Based Solar Cycle Forecasts Using the Ensemble Kalman Filter Method
Explore the source record for details and available documents.
SMD↗
SEARCH · Engineering Papers
Results for “ensemble solar forecast”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Physics-Based Solar Cycle Forecast Using the Ensemble Kalman Filter Method
Explore the source record for details and available documents.
SMD↗
Probabilistic Solar Wind Forecasting Using Large Ensembles of Near‐Sun Conditions With a Simple One‐Dimensional “Upwind” Scheme
Explore the source record for details and available documents.
Mathew J. Owens↗
Forecasting the Ambient Solar Wind with Numerical Models. I. On the Implementation of an Operational Framework
The ambient solar wind conditions in interplanetary space and in the near-Earth environment are determined by activity on the Sun. Steady solar wind streams modulate the propagation behavior of interplanetary coronal mass ejections and are themselves an important driver of recurrent geomagnetic storm activity. The knowledge of the ambient solar wind flows and fields is thus an essential component of successful space weather forecasting. Here, we present an implementation of an operational framework for operating, validating, and optimizing models of the ambient solar wind flow on the example of Carrington Rotation 2077. We reconstruct the global topology of the coronal magnetic field using the potential field source surface model (PFSS) and the Schatten current sheet model (SCS) and discuss three empirical relationships for specifying the solar wind conditions near the Sun, namely the Wang–Sheeley (WS) model, the distance from the coronal hole boundary model (DCHB), and the Wang-Sheeley–Arge (WSA) model. By adding uncertainty in the latitude about the sub-Earth point, we select an ensemble of initial conditions and map the solutions to Earth by the Heliospheric Upwind eXtrapolation (HUX) model. We assess the forecasting performance from a continuous variable validation and find that the WSA model most accurately predicts the solar wind speed time series (RMSE≈83 km/s). We note that the process of ensemble forecasting slightly improves the forecasting performance of all solar wind models investigated. We conclude that the implemented framework is well suited for studying the relationship between coronal magnetic fields and the properties of the ambient solar wind flow in the near-Earth environment.
Reiss, Martin A.↗
Validation of Model Forecasts of the Ambient Solar Wind
Independent and automated validation is a vital step in the progression of models from the research community into operational forecasting use. In this paper we describe a program in development at the CCMC to provide just such a comprehensive validation for models of the ambient solar wind in the inner heliosphere. We have built upon previous efforts published in the community, sharpened their definitions, and completed a baseline study. We also provide first results from this program of the comparative performance of the MHD models available at the CCMC against that of the Wang-Sheeley-Arge (WSA) model. An important goal of this effort is to provide a consistent validation to all available models. Clearly exposing the relative strengths and weaknesses of the different models will enable forecasters to craft more reliable ensemble forecasting strategies. Models of the ambient solar wind are developing rapidly as a result of improvements in data supply, numerical techniques, and computing resources. It is anticipated that in the next five to ten years, the MHD based models will supplant semi-empirical potential based models such as the WSA model, as the best available forecast models. We anticipate that this validation effort will track this evolution and so assist policy makers in gauging the value of past and future investment in modeling support.
Macneice, P. J.↗
Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter
Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.
Kitiashvili, Irina N.↗
Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles
Dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extends from the interior to the corona and from fast turbulent motions to the global-Sun magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across the different layers, which contribute to the corona heating and eruptive dynamics, as well as interlinks between different layers of the solar interior and atmosphere. For modeling the global-scale activity we use the data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitation on the prediction accuracy. We present the EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields, and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting the solar activity.
Kitiashvili, I. N.↗
Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles
The dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extend from the interior to the corona and from fast turbulent motions to global magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across layers of the solar interior and atmosphere, which contribute to coronal heating and eruptive dynamics. For modeling global-scale activity, we use a data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitations on prediction accuracy, and we present the EnKF predictions of the upcoming Solar Cycle (25) based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting solar activity.
Kitiashvili, I. N.↗
Synergy of Observations and Dynamo Models to Understand and Predict Solar Activity Cycles
The long-standing problem of understanding the evolution of the global magnetic fields that drive solar activity through different temporal scales is becoming more tractable because, in addition to 400 years of sunspot records, we now have almost 4 solar cycles of magnetic field observations. These observations allow us to discern physical connections between dynamo model variables and observations using data assimilation analysis. In particular, the Ensemble Kalman Filter approach takes into account uncertainties in both observations and modeling and allows us to make reliable forecasts of solar cycle activity cycles by using a relatively simple non-linear dynamical model of the solar dynamo. To expand this approach for more complex 2D and 3D dynamo modeling, it is necessary to decompose the observed synoptic magnetograms into poloidal and toroidal field components. In this presentation I will present initial results on magnetogram decomposition and assimilation of magnetogram data into dynamo modeling.
Synergy↗
Synergy of Observations and Dynamo Models to Understand and Predict Solar Activity Cycles
The long-standing problem of understanding the evolution of the global magnetic fields that drive solar activity through different temporal scales is becoming more tractable because, in addition to 400 years of sunspot records, we now have almost 4 solar cycles of magnetic field observations. These observations allow us to discern physical connections between dynamo model variables and observations using data assimilation analysis. In particular, the Ensemble Kalman Filter approach takes into account uncertainties in both observations and modeling and allows us to make reliable forecasts of solar cycle activity by using a relatively simple non-linear dynamical model of the solar dynamo. To expand this approach for more complex 2D and 3D dynamo modeling, it is necessary to decompose the observed synoptic magnetograms into poloidal and toroidal field components. In this presentation I will present initial results on magnetogram decomposition and assimilation of magnetogram data into dynamo modeling.
Kitiashvili, Irina N.↗
Forecasting Propagation and Evolution of CMEs in an Operational Setting: What Has Been Learned
One of the major types of solar eruption, coronal mass ejections (CMEs) not only impact space weather, but also can have significant societal consequences. CMEs cause intense geomagnetic storms and drive fast mode shocks that accelerate charged particles, potentially resulting in enhanced radiation levels both in ions and electrons. Human and technological assets in space can be endangered as a result. CMEs are also the major contributor to generating large amplitude Geomagnetically Induced Currents (GICs), which are a source of concern for power grid safety. Due to their space weather significance, forecasting the evolution and impacts of CMEs has become a much desired capability for space weather operations worldwide. Based on our operational experience at Space Weather Research Center at NASA Goddard Space Flight Center (http://swrc.gsfc.nasa.gov), we present here some of the insights gained about accurately predicting CME impacts, particularly in relation to space weather operations. These include: 1. The need to maximize information to get an accurate handle of three-dimensional (3-D) CME kinetic parameters and therefore improve CME forecast; 2. The potential use of CME simulation results for qualitative prediction of regions of space where solar energetic particles (SEPs) may be found; 3. The need to include all CMEs occurring within a ~24 h period for a better representation of the CME interactions; 4. Various other important parameters in forecasting CME evolution in interplanetary space, with special emphasis on the CME propagation direction. It is noted that a future direction for our CME forecasting is to employ the ensemble modeling approach.
forecasting↗
Ensemble Forecasting of Coronal Mass Ejections Using the WSA-ENLIL with CONED Model
The combination of the Wang-Sheeley-Arge (WSA) coronal model, ENLIL heliospherical model version 2.7, and CONED Model version 1.3 (WSA-ENLIL with CONED Model) was employed to form ensemble forecasts for 15 halo coronal mass ejections (halo CMEs). The input parameter distributions were formed from 100 sets of CME cone parameters derived from the CONED Model. The CONED Model used image processing along with the bootstrap approach to automatically calculate cone parameter distributions from SOHO/LASCO imagery based on techniques described by Pulkkinen et al. (2010). The input parameter distributions were used as input to WSA-ENLIL to calculate the temporal evolution of the CMEs, which were analyzed to determine the propagation times to the L1 Lagrangian point and the maximum Kp indices due to the impact of the CMEs on the Earth's magnetosphere. The Newell et al. (2007) Kp index formula was employed to calculate the maximum Kp indices based on the predicted solar wind parameters near Earth assuming two magnetic field orientations: a completely southward magnetic field and a uniformly distributed clock-angle in the Newell et al. (2007) Kp index formula. The forecasts for 5 of the 15 events had accuracy such that the actual propagation time was within the ensemble average plus or minus one standard deviation. Using the completely southward magnetic field assumption, 10 of the 15 events contained the actual maximum Kp index within the range of the ensemble forecast, compared to 9 of the 15 events when using a uniformly distributed clock angle.
coronal mass↗
CMEs and SEPs During November–December 2020: A Challenge for Real-Time Space Weather Forecasting
Predictions of coronal mass ejections (CMEs) and solar energetic particles (SEPs) are a central issue in space weather forecasting. In recent years, interest in space weather predictions has expanded to include impacts at other planets beyond Earth as well as spacecraft scattered throughout the heliosphere. In this sense, the scope of space weather science now encompasses the whole heliospheric system, and multipoint measurements of solar transients can provide useful insights and validations for prediction models. In this work, we aim to analyze the whole inner heliospheric context between two eruptive flares that took place in late 2020, that is, the M4.4 flare of 29 November and the C7.4 flare of 7 December. This period is especially interesting because the STEREO-A spacecraft was located ∼60° east of the Sun–Earth line, giving us the opportunity to test the capabilities of “predictions at 360°” using remote-sensing observations from the Lagrange L1 and L5 points as input. We simulate the CMEs that were ejected during our period of interest and the SEPs accelerated by their shocks using the WSA–Enlil–SEPMOD modeling chain and four sets of input parameters, forming a “mini-ensemble.” We validate our results using in situ observations at six locations, including Earth and Mars. We find that, despite some limitations arising from the models' architecture and assumptions, CMEs and shock-accelerated SEPs can be reasonably studied and forecast in real time at least out to several tens of degrees away from the eruption site using the prediction tools employed here.
Coronal mass ejections↗
Global Evolution of Solar Magnetic Fields and Prediction of Solar Activity Cycles
Prediction of solar activity cycles is challenging because the physical processes inside the Sun involve a broad range of multiscale dynamics that no model can reproduce, and the available observations are highly limited and cover mostly surface layers. Helioseismology makes it possible to probe solar dynamics in the convective zone, but variations in the differential rotation and meridional circulation are currently available for only two solar activity cycles. It has been demonstrated that sunspot observations, which cover over 400 years, can be used to calibrate the Parker-Kleeorin-Ruzmaikin model and that the Ensemble Kalman Filter (EnKF) method can be used to link the model magnetic fields to sunspot observations to make reliable predictions of a following cycle. However, for more accurate predictions, it is necessary to use actual observations of the solar magnetic fields, which are available for only four solar cycles. This raises the question of how limitations in observational data and model uncertainties affect predictive capabilities and implies the need for the development of new forecast methodologies and validation criteria. In this presentation, I will discuss the influence of the limited number of available observations on the accuracy of EnKF estimates of solar cycle parameters.
Kitiashvili, Irina N.↗
Operational Dust Prediction
Over the last few years, numerical prediction of dust aerosol concentration has become prominent at several research and operational weather centres due to growing interest from diverse stakeholders, such as solar energy plant managers, health professionals, aviation and military authorities and policymakers. Dust prediction in numerical weather prediction-type models faces a number of challenges owing to the complexity of the system. At the centre of the problem is the vast range of scales required to fully account for all of the physical processes related to dust. Another limiting factor is the paucity of suitable dust observations available for model, evaluation and assimilation. This chapter discusses in detail numerical prediction of dust with examples from systems that are currently providing dust forecasts in near real-time or are part of international efforts to establish daily provision of dust forecasts based on multi-model ensembles. The various models are introduced and described along with an overview on the importance of dust prediction activities and a historical perspective. Assimilation and evaluation aspects in dust prediction are also discussed.
assimilation↗
Improving the Representation of Land Surface Processes Using the Data Assimilation Research Testbed (DART)
The land surface is a critical part of the earth system as processes related to water, carbon, energy and nitrogen cycling have important implications for climate forcing, air quality, water availability and seasonal atmospheric forecasting. Despite advances in land surface modeling, land surface model performance is often limited because of errors related to initial and boundary conditions, model structure, and parameters. Data assimilation (DA) techniques combined with an expanding network of earth system observations present an opportunity to reduce these errors and improve simulations. Here, we emphasize the implementation of tools and approaches to overcome challenges related to land DA to constrain carbon and water cycling. In particular, we discuss the implementation of adaptive inflation to modify ensemble spread in response to time-varying networks of gridded observations. We also discuss methods to generate ensemble spread through boundary condition (meteorology) forcing that can be applied to site-level applications. Next, we describe the application of vertical localization upon surface soil moisture observations, and forward operators specifically designed for the assimilation of snow and solar-induced fluorescence observations. Finally, we discuss the potential benefit of a quantile conserving filter used to update bounded quantities (state or parameter values).
Brett Raczka↗
Improving the Representation of Land Surface Processes using the Data Assimilation Research Testbed (DART)
The land surface is a critical part of the earth system as processes related to water, carbon, energy and nitrogen cycling have important implications for climate forcing, air quality, water availability and seasonal atmospheric forecasting. Despite advances in land surface modeling, land surface model performance is often limited because of errors related to initial and boundary conditions, model structure, and parameters. Data assimilation (DA) techniques combined with an expanding network of earth system observations present an opportunity to reduce these errors and improve simulations. Here we apply an Ensemble Kalman Filter DA system as part of the Data Assimilation Research Testbed to a variety of land surface simulations. First, we describe the use of remotely sensed biomass observations to provide improved simulations of plant phenology, carbon and water cycling for regions highly sensitive to climate change (Western US, China, and Arctic). We discuss approaches to account for systemic biases between models and observations, including the use of spatially-varying adaptive ensemble inflation as an alternative approach to re-scaling soil moisture observations. Finally, we discuss a strategy to incorporate complementary observations (snow water equivalent, solar-induced fluorescence) to better constrain the representation of carbon and water cycling across complex terrain.
DART↗
Quantifying the Aerosol Semi-Direct Effect in the NASA GEOS-5 AGCM
Aerosols such as black carbon, dust, and some organic carbon species both scatter and absorb incoming solar radiation. This direct aerosol radiative forcing (DARF) redistributes solar energy both by cooling the surface and warming the atmosphere. As a result, these aerosols affect atmospheric stability and cloud cover (the semi-direct effect, or SDE). Furthermore, in regions with persistent high loadings of absorbing aerosols (e.g. Asia), regional circulation patterns may be altered, potentially resulting in changes in precipitation patterns. Here we investigate aerosol-climate coupling using the NASA Goddard Earth Observing System model version 5 (GEOS-5) atmospheric general circulation model (AGCM), in which we have implemented an online version of the Goddard Chemistry, Aerosol, Radiation and Transport (GOCART) model. GOCART includes representations of the sources, sinks, and chemical transformation of externally mixed dust, sea salt, sulfate, and carbonaceous aerosols. We examine a series of free-running ensemble climate simulations of the present-day period (2000-2009) forced by observed sea surface temperatures to determine the impact of aerosols on the model climate. The SDE and response of each simulation is determined by differencing with respect to the control simulation (no aerosol forcing). In a free-running model, any estimate of the SDE includes changes in clouds due both to atmospheric heating from aerosols and changes in circulation. To try and quantify the SDE without these circulation changes we then examine the DARF and SDE in GEOS-5 with prescribed meteorological analyses introduced by the MERRA analysis. By doing so, we are able to examine changes in model clouds that occur on shorter scales (six hours). In the GEOS-5 data assimilation system (DAS), the analysis is defined as the best estimate of the atmospheric state at any given time, and it is determined by optimally combining a first-guess short-term GCM forecast with all available observations. The Incremental Analysis Update (IAU) is added to the model forecast tendencies to align them with the analysis every six hours, thus preventing longer timescale feedbacks due to the aerosol forcing. We calculate the SDE by comparing model runs with and without aerosols, and the difference in the IAU between these runs is a useful metric with which to evaluate the impact of the SDE on the model atmosphere and clouds. Decreasing the IAU indicates that the aerosol direct and semi-direct effects act to reduce the bias between the model and observations and vice versa.
Randles, Cynthia A.↗