Wind Bidding in Regulation Markets Accounting for Forecast Uncertainty
This presentation discusses wind bidding in regulation markets accounting for forecast uncertainty.
49 EE - Wind and Water Power Program - Wind (EE-4W↗
SEARCH · Engineering Papers
Results for “performance forecasting”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.
Deep ensembles↗
A Model for Evaluating the Configuration and Dispatch of PV Plus Battery Power Plants
An open-source model was developed to optimize energy storage operation for photovoltaic- (PV-) plus-battery systems with AC-coupled and DC-coupled configurations. It includes the ability to use forecast energy prices to optimize battery charge and discharge on a rolling time horizon. The model allows for exploration of different configurations, including capital costs, inverter performance, dispatch flexibility, and capturing otherwise clipped energy for the DC-coupled system. The model can run 20 full years of hourly data in approximately two seconds, allowing comparison of a large number of configurations. We applied the model in a test case demonstrating reduced inverter clipping for DC-coupled systems and yielded slightly higher overall value than AC-coupled systems, with an approximately 2 percent increase in internal rate of return or benefit/cost ratio. Our results show that at current estimated prices for lithium-ion battery systems, large-scale PV-plus-battery plants are economically viable under the right conditions, with the configuration playing a role in system flexibility and performance. This model provides the ability for project developers, industry professionals, and researchers to use readily available software to quickly evaluate and design these systems.
41 EE - Solar Energy Technologies Office (EE-4S)↗
Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning
This project report presents the results from the AU31 project that is entitled “Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning” performed between FY2021 and FY2022. The technical objective of this project is to enhance risk analysis of accidental release of radioactive materials and provide novel risk forecasting and capabilities for assessing unplanned hazardous chemical releases for the U.S. Department of Energy (DOE). The approach includes a cross-platform finite element analysis of airborne chemical release, machine learning (ML) for simulation and forecasting, and a big data approach to data management, transformation and analysis capable of handling petabyte-scale unstructured and structured data. The outcome of these findings were assembled and accessible as a final output via an intuitive web hosted geospatial-based user interface for demonstration and general dissemination. These new results also provide a mechanism of combining this knowledge in a risk analysis framework tool. The geospatial analysis and output can utilize 5 years of qualified meteorological data to illustrate projected plume footprints that are generated from computational aspects of this study. Specifically, we show the development of a geospatial risk analysis capabilities to respond to and plan for accidental release of radioactive materials and to provide a risk forecasting tool for assessing hazardous chemical releases for the DOE. The focus of this effort is germane to common practices in risk analysis; and it is highly relevant to the timely and transparent release of information related to materials at risk including hazardous materials and chemical vapors and rapid assessment of the potential impacts on the workforce at active sites across the DOE complex.
42 ENGINEERING↗
Detection Thresholds of Falling Snow from Satellite-Borne Active and Passive Sensors
Precipitation, including rain and snow, is a critical part of the Earth's energy and hydrology cycles. Precipitation impacts latent heating profiles locally while global circulation patterns distribute precipitation and energy from the equator to the poles. For the hydrological cycle, falling snow is a primary contributor in northern latitudes during the winter seasons. Falling snow is the source of snow pack accumulations that provide fresh water resources for many communities in the world. Furthermore, falling snow impacts society by causing transportation disruptions during severe snow events. In order to collect information on the complete global precipitation cycle, both liquid and frozen precipitation must be collected. The challenges of estimating falling snow from space still exist though progress is being made. These challenges include weak falling snow signatures with respect to background (surface, water vapor) signatures for passive sensors over land surfaces, unknowns about the spherical and non-spherical shapes of the snowflakes, their particle size distributions (PSDs) and how the assumptions about the unknowns impact observed brightness temperatures or radar reflectivities, differences in near surface snowfall and total column snow amounts, and limited ground truth to validate against. While these challenges remain, knowledge of their impact on expected retrieval results is an important key for understanding falling snow retrieval estimations. Since falling snow from space is the next precipitation measurement challenge from space, information must be determined in order to guide retrieval algorithm development for these current and future missions. This information includes thresholds of detection for various sensor channel configurations, snow event system characteristics, snowflake particle assumptions, and surface types. For example, can a lake effect snow system with low (approx 2.5 km) cloud tops having an ice water content (IWC) at the surface of 0.25 g / cubic m and dendrite snowflakes be detected? If this information is known, we can focus retrieval efforts on detectable storms and concentrate advances on achievable results. Here, the focus is to determine thresholds of detection for falling snow for various snow conditions over land and lake surfaces. The results rely on simulated Weather Research Forecasting (WRF) simulations of falling snow cases since simulations provide all the information to determine the measurements from space and the ground truth. Sensitivity analyses were performed to better ascertain the relationships between multifrequency microwave and millimeter-wave sensor observations and the falling snow/underlying field of view. In addition, thresholds of detection for various sensor channel configurations, snow event system characteristics, snowflake particle assumptions, and surface types were studied. Results will be presented for active radar at Ku, Ka, and W-band and for passive radiometer channels from 10 to 183 GHz.
Gail Skofronick-Jackson↗
Assimilation of Sentinel 1 and SMAP – Based Satellite Soil Moisture Retrievals into SWAT Hydrological Model: the Impact of Satellite Revisit Time and Product Spatial Resolution on Flood Simulations in Small Basins
In runoff generation process, soil moisture plays an important role as it controls the magnitude of the flood events to the rainfall inputs. In this study, we investigated the ability of a new era of satellite soil moisture retrievals to improve the Soil & Water Assessment Tool (SWAT) daily discharge simulations via soil moisture data assimilation for two small (< 500 km2) and hydrologically different catchments located in Central Italy. We ingested 1) the Soil Moisture Active and Passive (SMAP) Enhanced L3 Radiometer Global Daily 9 km EASE-Grid soil moisture, 2) the Advanced SCATterometer (ASCAT) H113 soil moisture product released within the EUMETSAT Satellite Application Facility on Support to Operational Hydrology and Water Management (H-SAF) which has a nearly daily temporal resolution and sampling of 12.5 km, and 3) a fused ASCAT/Sentinel-1 (S1) satellite soil moisture product named SCATSAR-SWI with temporal and spatial sampling of 1 day and 1 km, respectively into SWAT hydrological model via Ensemble Kalman Filter (EnKF). Different configurations were tested with the aim of exploring the effect of the hydrological regime, the land use conditions, the spatial sampling and the revisit time of the products (which controls the amount of available data to be potentially ingested). Results show a general improvement of SWAT discharge simulations for all products in terms of error and Nash Sutcliffe efficiency index. In particular, we found a relatively good behavior of both the active and the passive products in terms of low flows improvement especially for the catchment characterized by a higher baseflow component. The benefit of the higher spatial resolution of SCATSAR obtained via S1 over ASCAT was small likely due to very challenging areas for S1 retrieval. Eventually, better performances were obtained for the passive product in the more forested catchment. With the aim of exploring the benefit of having more frequent satellite soil moisture observations to be ingested, we tested the performance of the ASCAT product with a reduced temporal sampling obtained by temporally matching ASCAT observations to that of SMAP. The results show a significant reduction of the performance of ASCAT, suggesting that the correction frequency (due to the higher number of observations available) for small catchments is an important aspect for improving flood forecasting as it helps to adjust more frequently the soil moisture pre-storm conditions.
Small basins↗
Project Galileo at Jupiter
Galileo made a highly successful arrival at Jupiter on December 7, 1995. The Galileo Atmospheric Entry Probe transmitted the first-ever direct measurements of an outer planet to the Orbiter mothership for nearly one hour while decsending to a pressure depth of 23 bar-far beyond the 10 bar mission requirements...This paper will summarize: 1) the Probe mission results, both engineering and scientific, 2) the problems with the Orbiter tape recorder and its recovery, 3) the Orbiter engineering operations including the loading and performance of the new flight software, and 4) early science results from the arrival and first two orbits and Ganymede encounters. Overall, mission status and the forecast for the remainder of the Orbiter's two-year primary mission will also be provided.
Galileo↗
Assimilation of Sentinel 1 and SMAP–based satellite soil moisture retrievals into SWAT hydrological model: the impact of satellite revisit time and product spatial resolution on flood simulations in small basins
In runoff generation process, soil moisture plays an important role as it controls the magnitude of the flood events in response to the rainfall inputs. In this study, we investigated the ability of a new era of satellite soil moisture retrievals to improve the Soil & Water Assessment Tool (SWAT) daily discharge simulations via soil moisture data assimilation for two small (< 500 km2) and hydrologically different catchments located in Central Italy. We ingested 1) the Soil Moisture Active and Passive (SMAP) Enhanced L3 Radiometer Global Daily 9 km EASE-Grid soil moisture, 2) the Advanced SCATterometer (ASCAT) H113 soil moisture product released within the EUMETSAT Satellite Application Facility on Support to Operational Hydrology and Water Management (HSAF) which has a nearly daily temporal resolution and sampling of 12.5 km, and 3) a fused ASCAT/Sentinel-1 (S1) satellite soil moisture product named SCATSAR-SWI with temporal and spatial sampling of 1 day and 1 km, respectively into SWAT hydrological model via the Ensemble Kalman Filter (EnKF). Different configurations were tested with the aim of exploring the effect of the hydrological regime, the land use conditions, the spatial sampling and the revisit time of the products (which controls the amount of available data to be potentially ingested). Results show a general improvement of SWAT discharge simulations for all products in terms of error and Nash Sutcliffe efficiency index. In particular, we found a relatively good behavior of both the active and the passive products in terms of low flows improvement especially for the catchment characterized by a higher baseflow component. The benefit of the higher spatial resolution of SCATSAR-SWI obtained via S1 over ASCAT was small, likely due to very challenging areas for the S1 retrieval. Eventually, better performances were obtained for the passive product in the more forested catchment. With the aim of exploring the benefit of having more frequent satellite soil moisture observations to be ingested, we tested the performance of the ASCAT product with a reduced temporal sampling obtained by temporally matching ASCAT observations to that of SMAP. The results show a significant reduction of the performance of ASCAT, suggesting that the correction frequency (due to the higher number of observations available) for small catchments is an important aspect for improving flood forecasting as it helps to adjust more frequently the pre-storm soil moisture conditions.
Shima Azimi↗
A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics
AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.
Lu, Dan↗
The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment
The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.
Observation Error↗
Analysis of Airport Ground Delay Program Decisions Using Data Mining Techniques
Air traffic service providers have to make decisions regarding changes to air traffic flow in the event of major weather disturbances and traffic congestions to maintain safety of the system. The behavior of the air traffic management system will be more predictable if consistent decisions are made under similar traffic and weather conditions. Consistency of deciding on control action depends on the weather and traffic conditions as well as accuracy in predicting these conditions. Weather parameters (defined in terms of forecast and actual weather and traffic conditions) on different days can be used to categorize days into days with little decision consistency, days with moderate decision consistency and days with high decision consistency. Four years of traffic, weather and ground delay program decisions data at major airports in the United States are used in the analysis. This paper examines performance of different data mining methods in the three regions of decision consistency. Not surprisingly, data mining methods have the best performance in the region of most decision consistency and have the poorest performance in the region of little decision consistency. In applications where data mining methods have differing performance in differing regions, it would be more useful to characterize the region specific performance instead of characterizing performance by a single parameter. Finally, the results show no significant variation in the performance of different data mining methods for this particular problem. The fact that different mining methods show no significant variation also provides further confidence in the results of data mining methods. Work in this abstract discusses initial results. This paper describes the results in terms of both forecast and actual environmental conditions and discusses how prediction errors impact decision consistency.
Kulkarni, Deepak↗
Range-Specific High-Resolution Mesoscale Model Setup: Data Assimilation
Mesoscale weather conditions can have an adverse effect on space launch, landing, and ground processing at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. Some of these other boundaries include the Indian River breeze front, Banana River breeze front, outflows from previous convection, horizontal convective rolls, convergence lines from other inland bodies of water such as Lake Okeechobee, the trailing convergence line from convergence of sea breeze fronts due to the shape of Cape Canaveral, frictional convergence lines from the islands in the Bahamas, convergence lines from soil moisture differences, convergence lines from cloud shading, and others. All these subtle weak boundary interactions often make forecasting of operationally important weather very difficult at KSC/CCAFS during the convective season (May-Oct). These convective processes often build quickly, last a short time (60 minutes or less), and occur over small distances, all of which also poses a significant challenge to the local forecasters who are responsible for issuing weather advisories, watches, and warnings. Surface winds during the transition seasons of spring and fall pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to aid in their decision making. Both the ER and WFF would benefit greatly from high-resolution mesoscale model output to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned model at a high resolution is needed to provide improved capability. This task is a multi-year effort in which the Applied Meteorology Unit (AMU) will tune the Weather Research and Forecasting (WRF) model individually for each range. The goal of the first year, the results of which are in this report, was to tune the WRF model based on the best model resolution and run time while using reasonable computing capabilities. To accomplish this, the ER and WFF supported the tasking of the AMU to perform a number of sensitivity tests in order to determine the best model configuration for operational use at each of the ranges to best predict winds, precipitation, and temperature (Watson 2013). This task is a continuation of that work and will provide a recommended local data assimilation (DA) and numerical forecast model design optimized for the ER and WFF to support space launch activities. The model will be optimized for local weather challenges at both ranges.
Global and national scale models↗
Reduced‐Order Probabilistic Emulation of Physics‐Based Ring Current Models: Application to RAM‐SCB Particle Flux
Abstract In this work, we address the computational challenge of large‐scale physics‐based simulation models for the ring current. Reduced computational cost allows for significantly faster than real‐time forecasting, enhancing our ability to predict and respond to dynamic changes in the ring current, valuable for space weather monitoring and mitigation efforts. Additionally, it can also be used for a comprehensive investigation of the system. Thus, we aim to create an emulator for the Ring current‐Atmosphere interactions Model with Self‐Consistent magnetic field (RAM‐SCB) particle flux that not only improves efficiency but also facilitates forecasting with reliable estimates of prediction uncertainties. The probabilistic emulator is built upon the methodology developed by Licata and Mehta (2023), https://doi.org/10.1029/2022sw003345 . A novel discrete sampling is used to identify 30 simulation periods over 20 years of solar and geomagnetic activity. Focusing on a subset of particle flux, we use Principal Component Analysis for dimensionality reduction and Long Short‐Term Memory (LSTM) neural networks to perform dynamic modeling. Hyperparameter space was explored extensively resulting in about 5% median symmetric accuracy across all data sets for one‐step dynamic prediction. Using a hierarchical ensemble of LSTMs, we have developed a reduced‐order probabilistic emulator (ROPE) tailored for time‐series forecasting of particle flux in the ring current. This ROPE offers accurate predictions of omnidirectional flux at a single energy with no pitch angle information, providing robust predictions on the test set with an error score below 11% and calibration scores under 8% with bias under 2% providing a significant speed up as compared to the full RAM‐SCB run.
79 ASTRONOMY AND ASTROPHYSICS↗
Predicting initial trans-membrane pressure across cycles in the ultrafiltration process using random forest
With growing freshwater scarcity, direct potable reuse (DPR) systems that reclaim wastewater for drinking are becoming increasingly important for sustainable water supply. Reliable operation requires minimizing downtime in ultrafiltration (UF) units, where membrane fouling leads to elevated trans-membrane pressure (TMP). This study develops data-driven regression models based on random forest (RF) and autoregressive (AR) approaches to forecast the initial TMP at the start of each UF filtration cycle in a pilot-scale DPR system. The RF model consistently outperforms baseline methods, including historical mean, last observation carried forward, and AR models, across multiple forecast horizons, achieving the lowest root mean square error. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent input variables across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is assessed for both direct and recursive RF modelling approaches. The proposed RF framework establishes a robust foundation for predictive monitoring and real-time optimization of UF operations, supporting sustainable and reliable water reuse.
direct potable reuse↗
Uncertainty Analysis of Historical Hurricane Data
An analysis of variance (ANOVA) study was conducted for historical hurricane data dating back to 1851 that was obtained from the U. S. Department of Commerce National Oceanic and Atmospheric Administration (NOAA). The data set was chosen because it is a large, publicly available collection of information, exhibiting great variability which has made the forecasting of future states, from current and previous states, difficult. The availability of substantial, high-fidelity validation data, however, made for an excellent uncertainty assessment study. Several factors (independent variables) were identified from the data set, which could potentially influence the track and intensity of the storms. The values of these factors, along with the values of responses of interest (dependent variables) were extracted from the data base, and provided to a commercial software package for processing via the ANOVA technique. The primary goal of the study was to document the ANOVA modeling uncertainty and predictive errors in making predictions about hurricane location and intensity 24 to 120 hours beyond known conditions, as reported by the data set. A secondary goal was to expose the ANOVA technique to a broader community within NASA. The independent factors considered to have an influence on the hurricane track included the current and starting longitudes and latitudes (measured in degrees), and current and starting maximum sustained wind speeds (measured in knots), and the storm starting date, its current duration from its first appearance, and the current year fraction of each reading, all measured in years. The year fraction and starting date were included in order to attempt to account for long duration cyclic behaviors, such as seasonal weather patterns, and years in which the sea or atmosphere were unusually warm or cold. The effect of short duration weather patterns and ocean conditions could not be examined with the current data set. The responses analyzed were the storm latitude, longitude and intensity, as recorded in the data set, 24 or 120 hours beyond the current state. Several ANOVA modeling schemes were examined. Two forms of validation were used: 1) comparison with official hurricane prediction performance metrics and 2) cases studies conducted on hurricanes from the 2005 season, which were not included within the model construction and ANOVA assessment. In general, the ANOVA technique did not perform as well as the established official prediction performance metrics published by NOAA; still, the technique did remarkably well in this demonstration with a difficult data set and could probably be made to perform better with more knowledge of hurricane development and dynamics applied to the problem. The technique provides a repeatable prediction process that eliminates the need for judgment in the forecast.
Green, Lawrence L.↗
Experiments with the Mesoscale Atmospheric Simulation System (MASS) using the synthetic relative humidity
This study is intended to examine the impact of the synthetic relative humidity on the model simulation of mesoscale convective storm environment. The synthetic relative humidity is derived from the National Weather Services surface observations, and non-conventional sources including aircraft, radar, and satellite observations. The latter sources provide the mesoscale data of very high spatial and temporal resolution. The synthetic humidity data is used to complement the National Weather Services rawinsonde observations. It is believed that a realistic representation of initial moisture field in a mesoscale model is critical for the model simulation of thunderstorm development, and the formation of non-convective clouds as well as their effects on the surface energy budget. The impact will be investigated based on a real-data case study using the mesoscale atmospheric simulation system developed by Mesoscale Environmental Simulations Operations, Inc. The mesoscale atmospheric simulation system consists of objective analysis and initialization codes, and the coarse-mesh and fine-mesh dynamic prediction models. Both models are a three dimensional, primitive equation model containing the essential moist physics for simulating and forecasting mesoscale convective processes in the atmosphere. The modeling system is currently implemented at the Applied Meteorology Unit, Kennedy Space Center. Two procedures involving the synthetic relative humidity to define the model initial moisture fields are considered. It is proposed to perform several short-range (approximately 6 hours) comparative coarse-mesh simulation experiments with and without the synthetic data. They are aimed at revealing the model sensitivities should allow us both to refine the specification of the observational requirements, and to develop more accurate and efficient objective analysis schemes. The goal is to advance the MASS (Mesoscal Atmospheric Simulation System) modeling expertise so that the model output can provide reliable guidance for thunderstorm forecasting.
Chang, Chia-Bo↗
Probabilistic Prediction of Geomagnetic Storms and the K p index
Geomagnetic activity is often described using summary indices to summarize the likelihood of space weather impacts, as well as when parameterizing space weather models. The geomagnetic index K p in particular, is widely used for these purposes. Current state-of-the-art forecast models provide deterministic K p predictions using a variety of methods – including empirically-derived functions, physics-based models, and neural networks – but do not provide uncertainty estimates associated with the forecast. This paper provides a sample methodology to generate a 3-hour-ahead K p prediction with uncertainty bounds and from this provide a probabilistic geomagnetic storm forecast. Specifically, we have used a two-layered architecture to separately predict storm (K p ≥ 5 – ) and non-storm cases. As solar wind-driven models are limited in their ability to predict the onset of transient-driven activity we also introduce a model variant using solar X-ray flux to assess whether simple models including proxies for solar activity can improve the predictions of geomagnetic storm activity with lead times longer than the L1-to-Earth propagation time. By comparing the performance of these models we show that including operationally-available information about solar irradiance enhances the ability of predictive models to capture the onset of geomagnetic storms and that this can be achieved while also enabling probabilistic forecasts.
79 ASTRONOMY AND ASTROPHYSICS↗
Building a Real-Time Predictive Flood Model for Improving Early Warning Systems in Ellicott City, Maryland
As flood events in the United States grow in frequency and intensity, the use of applied remote sensing analyses is increasingly necessary for effective flood monitoring and warning systems. The NASA DEVELOP National Program partnered with the Howard County government in Maryland to investigate the use of machine learning for advanced flood risk detection, and to test the feasibility of integrating this approach into the county’s flood early warning system. To strengthen the efforts of the Howard County Office of Emergency Management (OEM), the project developed a prediction model capable of hindcasting the two severe flash flood events that devastated Ellicott City, and transitioned to an Long Short-Term Memory (LSTM) based sequence-to-sequence deep learning model with 8-hour forecast capability. The team combined data inputs from public sources including river and precipitation gauges, NASA and NOAA Earth observations, and numerical weather model products using scripts written in the Google Colaboratory Python scripting environment. In addition to designing the deep learning architecture, the team trained and tested the model, and evaluated its performance using the Nash-Sutcliffe Efficiency (NSE). The final product, called the Sequentially Trained Real-time EstimAted Model (STREAM), predicts stage height for the Hudson Branch gauge in Ellicott City using data products available in near real-time, including the High-Resolution Rapid Refresh (HRRR) model’s accumulated precipitation forecasts supplemented by stream gauge data from the OEM and the U.S. Geological Survey. STREAM was incorporated into an online dashboard in a user-friendly interface capable of triggering the alarms that initiate the OEM’s emergency response protocols up to 8 hours in advance of a predicted severe flood event. The project demonstrated the potential for the integration of open data and Earth observations into a flood risk forecasting tool capable of informing near real-time decision making.
Ryan Hammock↗