Improved subseasonal prediction of South Asian monsoon rainfall using data-driven forecasts of oscillatory modes
Explore the source record for details and available documents.
Eviatar Bach↗
SEARCH · Engineering Papers
Results for “data-driven forecasting”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
On the Use of SMAP Soil Moisture for Forecasting NDVI Over CONUS Cropland Regions
Vegetation health forecasting (NDVI as a proxy) informs decision-makers about the end of season crop yield productivity but is not well-documented. This study tests improvements in vegetation health forecasting by developing a data-driven Dynamic Agricultural Productivity Indicator ( DAPI ), which simultaneously incorporates satellite-based root zone soil moisture (RZSM) and satellite-based NDVI data. RZSM is estimated via data assimilation of satellite based SMAP SM dataset. We employ the proposed DAPI forecast across four cropland types in CONUS, including corn, cotton, soybeans, and wheat. Results demonstrate superior performance of the DAPI forecasts compared to climatology-based NDVI forecasts, with the largest improvements in water-limited regions. DAPI shows particularly good performance during hydrologic disturbances such as floods and droughts. To this end, the DAPI approach is useful in estimating future vegetation health for identifying potential food-insecure areas, predicting crop price changes, and projecting expected commodities market trends.
Manh Le↗
Hourly Stream Heights – A Short-term Deep Learning Prediction Model
River flooding can have a detrimental impact on a community by causing loss of life, loss or damage to property, and damage to infrastructure. Having the capability to forecast flooding events can prevent the loss of life and mitigate damage to property. A programmatic, data-driven approach using deep learning to forecast a stream’s gauge height every 6 hours has been developed by NASA’s Short-term Prediction Research and Transition Center (SPoRT) and is currently in operation. Based on our end user engagement and feedback, this medium-term product has been successfully adopted by several National Weather Service (NWS) Forecast Offices and River Forecast Centers (RFC). SPoRT is currently researching and developing a short-term hourly deep learning model which will be useful in forecasting flash flood events.
Michael Antia↗
FluxSat: Long-term Earth Science Data Record (ESDR) for Terrestrial Gross Primary Production (GPP) based on satellite data calibrated with eddy covariance data
Gross primary production (GPP), the amount of carbon dioxide (CO 2 ) assimilated by plants through photosynthesis, is one of the most variable and uncertain components of the global carbon cycle. Global GPP has been estimated with a number of process-based models, data-driven, and hybrid approaches. Dynamic global vegetation models (DGVMs), driven by observed environmental changes, are used for global carbon budget assessments and long-term (climate) prediction. Benchmarking these and other models globally with data-driven GPP estimates is critical for understanding the land sink and ensuring accurate forecasts of the carbon cycle. In addition, global data-driven GPP estimates are crucial for studies of interannual variability, including trends that are linked to mechanisms with large uncertainties, such as the indirect CO 2 fertilization effect related to greening. In response to a community need for a GPP data set that well captures spatio-temporal variability, we developed FluxSat, a data-driven approach that optimizes the use of satellite reflectance data from the NASA MODerate-resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, calibrated using ground-based eddy covariance (EC) data. We are enhancing (spatially, higher resolution) and extending FluxSat (in time, with additional sensors) to create a high quality long term GPP Earth System Data Record (ESDR) for use in model benchmarking, carbon cycle modeling, and studies of trends and interannual variability. Our team’s objectives are to: 1. Update and document the current MODIS FluxSat GPP (daily, 0.05o and 0.5o resolutions) products with latest available MODIS and EC data sets; 2. Extend FluxSat GPP record forward in time with the Visible Infrared Imaging Radiometer Suite (VIIRS) on operational weather satellites going forward; 3. Extend FluxSat GPP record backward in time using the Advanced Very High Resolution Radiometer (AVHRR) on weather satellites dating back to 1981; 4. Provide higher spatial resolution MODIS and VIIRS GPP (0.0083o). 5. Thoroughly evaluate all FluxSat products with independent data; and 6. Create a homogenized long-term GPP record spanning 40+ years. We will discuss plans for this long-term data set that is supported through the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) program.
gross Primary Production↗
Object-Based Comparison of Data-Driven and Physics-Driven Satellite Estimates of Extreme Rainfall
The Global Precipitation Measurement (GPM) constellation of spaceborne sensors provides a variety of direct and indirect measurements of precipitation processes. Such observations can be employed to derive spatially and temporally consistent gridded precipitation estimates either via data-driven retrieval algorithms or by assimilation into physically based numerical weather models. We compare the data-driven Integrated Multisatellite Retrievals for GPM (IMERG) and the assimilation-enabled NASA-Unified Weather Research and Forecasting (NU-WRF) model against Stage IV reference precipitation for four major extreme rainfall events in the southeastern United States using an object-based analysis framework that decomposes gridded precipitation fields into storm objects. As an alternative to conventional ‘‘grid-by-grid analysis,’’ the object-based approach provides a promising way to diagnose spatial properties of storms, trace them through space and time, and connect their accuracy to storm types and input data sources. The evolution of two tropical cyclones are generally captured by IMERG and NU-WRF, while the less organized spatial patterns of two mesoscale convective systems pose challenges for both. NU-WRF rain rates are generally more accurate, while IMERG better captures storm location and shape. Both show higher skill in detecting large, intense storms compared to smaller, weaker storms. IMERG’s accuracy depends on the input microwave and infrared data sources; NU-WRF does not appear to exhibit this dependence. Findings highlight that an object-oriented view can provide deeper insights into satellite precipitation performance and that the satellite precipitation community should further explore the potential for ‘‘hybrid’’ data-driven and physics-driven estimates in order to make optimal usage of satellite observations.
extreme events↗
SBIR Space Weather R2O2R Technology Development and Commercial Applications
The Small Business Innovation Research (SBIR) Program provides U.S. small businesses of 500 or fewer employees with the opportunity for early-stage funding for research and development. Through NASA's Science Mission Directorate, the SBIR subtopic S14.01 Space Weather Research-to-Operations-to-Research (R2O2R) Technology Development and Commercial Applications supports high-priority space weather needs as outlined in the National Space Weather Strategy and Action Plan (NSWSAP). There are four focus areas for which solutions are sought; these will be discussed (in no priority order): 1) space-weather forecasting technologies, techniques, and applications, 2) commercial and decision-making applications for space weather technologies, 3) space weather advanced data-driven discovery techniques, and 4) space-weather instrumentation.
Space weather↗
Advancing Open Science in Atmospheric Research: Integrating Data Usability and Machine Learning
In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences." "In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences.
Jennifer Wei↗
A Satellite Data-Driven, Client-Server Decision Support Application for Agricultural Water Resources Management
Water cycle extremes such as droughts and floods present a challenge for water managers and for policy makers responsible for the administration of water supplies in agricultural regions. In addition to the inherent uncertainties associated with forecasting extreme weather events, water planners need to anticipate water demands and water user behavior in a typical circumstances. This requires the use decision support systems capable of simulating agricultural water demand with the latest available data. Unfortunately, managers from local and regional agencies often use different datasets of variable quality, which complicates coordinated action. In previous work we have demonstrated novel methodologies to use satellite-based observational technologies, in conjunction with hydro-economic models and state of the art data assimilation methods, to enable robust regional assessment and prediction of drought impacts on agricultural production, water resources, and land allocation. These methods create an opportunity for new, cost-effective analysis tools to support policy and decision-making over large spatial extents. The methods can be driven with information from existing satellite-derived operational products, such as the Satellite Irrigation Management Support system (SIMS) operational over California, the Cropland Data Layer (CDL), and using a modified light-use efficiency algorithm to retrieve crop yield from the synergistic use of MODIS and Landsat imagery. Here we present an integration of this modeling framework in a client-server architecture based on the Hydra platform. Assimilation and processing of resource intensive remote sensing data, as well as hydrologic and other ancillary information occur on the server side. This information is processed and summarized as attributes in water demand nodes that are part of a vector description of the water distribution network. With this architecture, our decision support system becomes a light weight 'app' that connects to the server to retrieve the latest information regarding water demands, land use, yields and hydrologic information required to run different management scenarios. Furthermore, this architecture ensures all agencies and teams involved in water management use the same, up-to-date information in their simulations.
Agricultural↗
TPSAS-NF1676L-10829-DND
Galactic cosmic rays (GCR) and solar energetic particles (SEP) are the primary sources of human exposure to high linear energy transfer (LET) radiation in the atmosphere. High-LET radiation is effective at directly breaking DNA strands in biological tissue, or producing chemically active radicals in tissue that alter the cell function, both of which can lead to cancer or other adverse health effects. A prototype operational nowcast model of air-crew radiation exposure is currently under development and funded by NASA. The model predicts air-crew radiation exposure levels from both GCR and SEP that may accompany solar storms. The new air-crew radiation exposure model is called the Nowcast of Atmospheric Ionizing Radiation for Aviation Safety (NAIRAS) model. NAIRAS will provide global, data-driven, real-time exposure predictions of biologically harmful radiation at aviation altitudes. Observations are utilized from the ground (neutron monitors), from the atmosphere (the NCEP Global Forecast System), and from space (NASA/ACE and NOAA/GOES). Atmospheric observations characterize the overhead mass shielding and the ground- and space-based observations provide boundary conditions on the incident GCR and SEP particle flux distributions for transport and dosimetry calculations. Radiation exposure rates are calculated using the NASA physics-based HZETRN (High Charge (Z) and Energy TRaNsport) code. An overview of the NAIRAS model is given: the concept, design, prototype implementation status, data access, and example results. Issues encountered thus far and known and/or anticipated hurdles to research to operations transition are also discussed.
Christopher J Mertens↗
Studying the 2019 Australian Bushfires Disaster using NASA Data: A Data-Driven Storytelling Approach
The 2019-2020 Australian fire season was particularly devastating, with millions of acres of land burned and impacts affecting Australian ecology, local populations and air quality, and the atmosphere. Australia saw unprecedented heat waves, with temperatures reaching 120 F (49.1 C) in January across central and eastern Australia. The fires gave rise to a host of atmospheric phenomenon, including smoke transport and lofting generated by storm-induced by fires, known as pyrocumulonimbus, reaching the stratosphere. NASA’s satellites not only tracked the event in real time, but also gathered data to further inform forecasting and response methods in the future. To better assist the public in understanding the lead up, impacts, and aftermath effects of these fires, the Science Outreach Team at NASA Langley Research Center’s Atmospheric Science Data Center (ASDC) Distributed Active Archive Center (DAAC) used Esri’s storymap tool to guide users through understanding relevant phenomenon, contributing factors, the effects this event has had on global atmospheric composition, and the science behind researching the tie between disasters and public health. The storymap uses data from the ASDC-supported NASA missions Measurements Of Pollution In The Troposphere (MOPITT), Cloud-Aerosol and Infrared Pathfinder Satellite Observation (CALIPSO), Clouds and the Earth’s Radiant Energy System (CERES), the Stratospheric Aerosol and Gas Experiment (SAGE III), and Multi-angle Imaging SpectroRadiometer (MISR). By using data-driven storytelling to communicate impacts of a large fire event, we hope to provide an accessible, engaging science outreach tool format.
Sanjana Paul↗
The Global Structure of UTLS Ozone in GEOS-5: A Multi-Year Assimilation of EOS Aura Data
Eight years of ozone measurements retrieved from the Ozone Monitoring Instrument (OMI) and the Microwave Limb Sounder, both on the EOS Aura satellite, have been assimilated into the Goddard Earth Observing System version 5 (GEOS-5) data assimilation system. This study thoroughly evaluates this assimilated product, highlighting its potential for science. The impact of observations on the GEOS-5 system is explored by examining the spatial distribution of the observation-minus-forecast statistics. Independent data are used for product validation. The correlation coefficient of the lower-stratospheric ozone column with ozonesondes is 0.99 and the bias is 0.5%, indicating the success of the assimilation in reproducing the ozone variability in that layer. The upper-tropospheric assimilated ozone column is about 10% lower than the ozonesonde column but the correlation is still high (0.87). The assimilation is shown to realistically capture the sharp cross-tropopause gradient in ozone mixing ratio. Occurrence of transport-driven low ozone laminae in the assimilation system is similar to that obtained from the High Resolution Dynamics Limb Sounder (HIRDLS) above the 400 K potential temperature surface but the assimilation produces fewer laminae than seen by HIRDLS below that surface. Although the assimilation produces 5 - 8 fewer occurrences per day (up to approximately 20%) during the three years of HIRDLS data, the interannual variability is captured correctly. This data-driven assimilated product is complementary to ozone fields generated from chemistry and transport models. Applications include study of the radiative forcing by ozone and tracer transport near the tropopause.
GEOS-5↗
Usage-based Lifing of Lithium-Ion Battery with HybridPhysics-Informed Neural Networks
Lithium-ion batteries are commonly used to power unmanned aircraft vehicles (UAVs).The ability to model and forecast the remaining useful life of these batteries enables UAV reliability assurance. Building accurate models for battery state of charge and state of health based on first principles is challenging due to the complex electrochemistry that governs battery operations and computational complexity required to solve them. Therefore, reduced order models are often used due to their ability to capture the overall battery discharge. Un-fortunately, these simplifications lead to residual discrepancy between model predictions and observed data. In this paper, we present a hybrid modeling approach merging reduced-order models and neural networks. In this approach, while most of the input-output relationship is captured by Nernst and Butler-Volmer equations, data-driven kernels reduce the gap between predictions and observations. We validate our approach using data publicly available through the NASA Prognostics Center of Excellence repository. Results showed that our hybrid battery prognosis model can be successfully calibrated, even with a limited number of observations.
Lithium-ion Battery↗
Data-driven Expectations for Electromagnetic Counterpart Searches Based on LIGO/Virgo Public Alerts
Searches for electromagnetic counterparts of gravitational-wave signals have redoubled since the first detection in2017 of a binary neutron star merger with a gamma-ray burst, optical/infrared kilonova, and panchromatic after glow. Yet, one LIGO/Virgo observing run later, there has not yet been a second, secure identification of an electromagnetic counterpart. This is not surprising given that the localization uncertainties of events in LIGO and Virgo’s third observing run, O3, were much larger than predicted. We explain this by showing that improvements in data analysis that now allow LIGO/Virgo to detect weaker and hence more poorly localized events have increased the overall number of detections, of which well-localized, gold-plated events make up a smaller proportion overall. We present simulations of the next two LIGO/Virgo/KAGRA observing runs, O4 and O5, that are grounded in the statistics ofO3 public alerts. To illustrate the significant impact that the updated predictions can have, we study the follow-up strategy for the Zwicky Transient Facility. Realistic and timely forecasting of gravitational-wave localization accuracy is paramount given the large commitments of telescope time and the need to prioritize which events are followed up. We include a data release of our simulated localizations as a public proposal planning resource for astronomers
Polina Petrov↗
Gaussian Process for Flight Delay Prediction: Learning a Stochastic Process
This paper presents a machine-learning approach to predict flight delays. Whereas neural networks are extensively studied for predictive capabilities, they involve non-intuitive design and extensive analysis, particularly in training and optimization processes. Instead, the proposed framework employs Gaussian Processes as a supervised learning technique for flight delay prediction. This data-driven approach trains the model using prior information, specifically the mean and covariance tied to existing data. The proposed Gaussian Process Regression (GPR) model employs the day of flight as a pivotal feature for delay forecasting. We analyze flights from various routes and gauge the accuracy of the presented learning technique by comparing the predicted delays with the actual ones. Given the inherent challenges in precisely forecasting delays, we predict the delays with a 95 % confidence interval. Also, an error propagation analysis in the prediction horizon is carried out to determine the optimal time frame for prediction. The proposed method for flight delay prediction is important as airlines can strategize flight operations and issue timely advisories.
stochastic↗