Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

86 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Multiclass Flight Anomaly Detection Using Sensor Fusion Based on Dempster-Shafer Theory

As aviation systems in commercial operations continue to grow in complexity, the anomalies exhibited by these systems become more elaborate and difficult to detect. To address the challenge of detecting these complex anomalies, deep learning models have been used extensively in aviation anomaly detection studies, at the expense of end-user interpretability. Aiming to maintain the same level of interpretability as traditional threshold-exceedance methods, we continue our development of prediction models using ordinal patterns and their distributions throughout the flight. Specifically, this study extends our work into multiclass anomaly detection using sensor fusion based on Dempster-Shafer theory (DST), a second-order probability theory used to combine information from different sources of evidence. Our approach uses DST toreduce the uncertainty in the class predictions of an ensemble of classifiers. These classifiers rely on the similarity between flight data and class templates to make a prediction of the state of the aircraft. Our approach aims to take advantage of simple models trained on interpretable features (ordinal patterns) to correctly predict an anomaly and identify the flight dynamics linked to the anomaly. Our results show an improvement when using DST-based sensor fusion over simple majority voting. Additionally, our results provide insight into aircraft states linked to rare high-risk anomalies.

Risk detection↗
NASA NTRSDate not supplied

Multiclass Flight Anomaly Detection Using Sensor Fusion Based on Dempster-Shafer Theory

As aviation systems in commercial operations continue to grow in complexity, the anomalies exhibited by these systems become more elaborate and difficult to detect. To address the challenge of detecting these complex anomalies, deep learning models have been used extensively in aviation anomaly detection studies, at the expense of end-user interpretability. Aiming to maintain the same level of interpretability as traditional threshold-exceedance methods, we continue our development of prediction models using ordinal patterns and their distributions throughout the flight. Specifically, this study extends our work into multiclass anomaly detection using sensor fusion based on Dempster-Shafer theory (DST), a second-order probability theory used to combine information from different sources of evidence. Our approach uses DST to reduce the uncertainty in the class predictions of an ensemble of classifiers. These classifiers rely on the similarity between flight data and class templates to make a prediction of the state of the aircraft. Our approach aims to take advantage of simple models trained on interpretable features (ordinal patterns) to correctly predict an anomaly and identify the flight dynamics linked to the anomaly. Our results show an improvement when using DST-based sensor fusion over simple majority voting. Additionally, our results provide insight into aircraft states linked to rare high-risk anomalies.

Risk detection↗
NASA NTRS2019

Learning from GES DISC's MLS and OMI Data Users: Metrics Matter

It has been over 15 years since Aura research satellite launched in 2004 to observe the Earth's ozone layer, air quality, and climate from four different instruments - the High Resolution Dynamics Limb Sounder (HIRDLS), the Microwave Limb Sounder (MLS), the Ozone Monitoring Instrument (OMI), and the Tropospheric Emission Spectrometer (TES). Observations from the Aura mission have established a concrete understanding of the changing chemistry of our atmosphere.The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the official archive and distribution center for the HIRDLS, MLS, and OMI instruments. This presentation will report metrics of data usage and services on these instruments. Key to GES DISC's mission to provide better data support is gaining a better understanding of our users' needs and behaviors as they discover, access and utilize these data. We will summarize the users' needs from these instruments based on user inquiry information collected over the Aura mission lifetime and present findings from this ensemble metrics.

Metrics↗
NASA NTRS2024

Celebrating 10 Years of the Sub-Seasonal to Seasonal Prediction Project and Looking to the Future

The conference clearly demonstrated the increasing interest and growth of the scientific community working on the development and application of sub-seasonal to seasonal prediction since the start of the World Weather Research Programme (WWRP)/World Climate Research Programme (WCRP) sub-seasonal to seasonal (S2S) prediction project in 2013. The conference, which was held at the University of Reading (United Kingdom), was organized into three main themes as briefly summarized below, with eleven invited talks, 74 oral contributed talks, and 101 posters. The conference also included a two-hour breakout session, wherein eight groups discussed the current state and prospect for S2S prediction, and an early career researcher event. A summary of these discussions and recommendations is presented below. The conference web page (https://research.reading.ac.uk/s2s-summit2023/) is archived at the University of Reading. Introductory comments by representatives of the World Meteorological Organization (WMO) WWRP and WCRP emphasized the importance of the weather–climate linkage, targeted by S2S forecasts (from 2 weeks to a season ahead), addressing the challenges of creating “end-to-end” forecasts that encompass the entire climate-services chain from the prediction science and forecast, to the development and issuing of forecast products tailored to informing user-decisions. They also emphasized the efficacy of multi-model ensemble efforts and databases to foster collaborations internationally and between operational centres and academia. Although the WWRP/WCRP S2S project comes to an end in 2023, S2S prediction will remain an important focus for WWRP and WCRP. In WWRP, a new project called SAGE (Sub-seasonal to seasonal predictions for Agriculture and Environment) will start in 2024. Another important legacy of the S2S project will be the maintenance of the S2S database (Vitart et al. 2017) and the establishment of a WMO Lead Center for sub-seasonal prediction multi-model ensemble (LC-SSPMME) which will provide real-time multi-model S2S climate information. In two keynote presentations, Prof. Brian Hoskins (University of Reading) and Dr. Gilbert Brunet (Australian Bureau of Meteorology) discussed the potential of S2S predictability and the ongoing journey for understanding and improving these predictions. This conference was a sequel to the International Conference on Sub-seasonal to Seasonal Prediction (Robertson et al., 2014) which took place in College Park (Maryland, USA) in February 2014 to celebrate the start of the WWRP/WCRP S2S project, and to WCRP and WWRP conferences in Boulder, USA, in 2018 (Merryfield et al., 2020). A significant development compared to the previous S2S conferences was the large number of presentations on research to operation (R2O) and S2S applications and on the use of artificial intelligence and machine learning (AI/ML) methods for S2S prediction. Some of these methods provide empirical S2S forecasts which are competitive with state-of-the-art dynamical models. Other presentations demonstrated that AI/ML can provide alternative calibration of dynamical model outputs to traditional methods. Several talks and posters highlighted the increasing use of AI/ML, including deep learning, in S2S forecast post-processing and using AI to identify higher flow-dependent skill. Finally, some presentations demonstrated the value of AI/ML methods for a better understanding of S2S sources of predictability and attribution of extreme events.

S. J. Woolnough↗
NASA NTRS2019

Exploring the Utility of Machine Learning-Based Passive Microwave Brightness Temperature Data Assimilation over Terrestrial Snow in High Mountain Asia

This study explores the use of a support vector machine (SVM) as the observation operator within a passive microwave brightness temperature data assimilation framework (herein SVM-DA) to enhance the characterization of snow water equivalent (SWE) over High Mountain Asia (HMA). A series of synthetic twin experiments were conducted with the NASA Land Information System (LIS) at a number of locations across HMA. Overall, the SVM-DA framework is effective at improving SWE estimates (~70% reduction in RMSE relative to the Open Loop) for SWE depths less than 200 mm during dry snowpack conditions. The SVM-DA framework also improves SWE estimates in deep, wet snow (~45% reduction in RMSE) when snow liquid water is well estimated by the land surface model, but can lead to model degradation when snow liquid water estimates diverge from values used during SVM training. In particular, two key challenges of using the SVM-DA framework were observed over deep, wet snowpacks. First, variations in snow liquid water content dominate the brightness temperature spectral difference (TB) signal associated with emission from a wet snowpack, which can lead to abrupt changes in SWE during the analysis update. Second, the ensemble of SVM-based predictions can collapse (i.e., yield a near-zero standard deviation across the ensemble) when prior estimates of snow are outside the range of snow inputs used during the SVM training procedure. Such a scenario can lead to the presence of spurious error correlations between SWE and TB, and as a consequence, can result in degraded SWE estimates from the analysis update. These degraded analysis updates can be largely mitigated by applying rule-based approaches. For example, restricting the SWE update when the standard deviation of the predicted TB is greater than 0.05 K helps prevent the occurrence of filter divergence. Similarly, adding a thin layer (i.e., 5 mm) of SWE when the synthetic TB is larger than 5 K can improve SVM-DA performance in the presence of a precipitation dry bias. The study demonstrates that a carefully constructed SVM-DA framework cognizant of the inherent limitations of passive microwave-based SWE estimation holds promise for snow mass data assimilation.

Kwon, Yonghwan↗
NASA NTRS2010

Bird Migration Under Climate Change - A Mechanistic Approach Using Remote Sensing

The broad-scale reductions and shifts that may be expected under climate change in the availability and quality of stopover habitat for long-distance migrants is an area of increasing concern for conservation biologists. Researchers generally have taken two broad approaches to the modeling of migration behaviour to understand the impact of these changes on migratory bird populations. These include models based on causal processes and their response to environmental stimulation, "mechanistic models", or models that primarily are based on observed animal distribution patterns and the correlation of these patterns with environmental variables, i.e. "data driven" models. Investigators have applied the latter technique to forecast changes in migration patterns with changes in the environment, for example, as might be expected under climate change, by forecasting how the underlying environmental data layers upon which the relationships are built will change over time. The learned geostatstical correlations are then applied to the modified data layers.. However, this is problematic. Even if the projections of how the underlying data layers will change are correct, it is not evident that the statistical relationships will remain the same, i.e. that the animal organism may not adapt its' behaviour to the changing conditions. Mechanistic models that explicitly take into account the physical, biological, and behaviour responses of an organism as well as the underlying changes in the landscape offer an alternative to address these shortcomings. The availability of satellite remote sensing observations at multiple spatial and temporal scales, coupled with advances in climate modeling and information technologies enable the application of the mechanistic models to predict how continental bird migration patterns may change in response to environmental change. In earlier work, we simulated the impact of effects of wetland loss and inter-annual variability on the fitness of migratory shorebirds in the central fly ways of North America. We demonstrated the phenotypic plasticity of a migratory population of Pectoral sandpipers consisting of an ensemble of 10,000 individual birds in response to changes in stopover locations using an individual based migration model driven by remotely sensed land surface data, climate data and biological field data. With the advent of new computing capabilities enabled hy recent GPU-GP computing paradigms and commodity hardware, it now is possible to simulate both larger ensemble populations and to incorporate more realistic mechanistic factors into migration models. Here, we take our first steps use these tools to study the impact of long-term drought variability on shorebird survival.

Smith, James A.↗
NASA NTRS2023

The Statistical Emulators of GGCMI Phase 2: Responses of Year-to-Year Variation of Crop Yield to CO 2 , Temperature, Water and Nitrogen Perturbations

Understanding the impact of climate change on year-to-year variation of crop yield is critical to global food stability and security. While crop model emulators are believed to be lightweight tools to replace the models, few emulators have been developed to capture such interannual variation of crop yield in response to climate variability. In this study, we developed a statistical emulator with a machine learning algorithm to reproduce the response of year-to-year variation of four crop yields to CO 2 (C), temperature (T), water (W), and nitrogen (N) perturbations defined in the Global Gridded Crop Model Intercomparison Project (GGCMI) phase 2. The emulators were able to explain more than 52 % of the variance of simulated yield and performed well in capturing the year-to-year variation of global average and gridded crop yield over current croplands in the baseline. With the changes in CO 2 –temperature–water–nitrogen (CTWN) perturbations, the emulators could reproduce the year-to-year variation of crop yield well over most current cropland. The variation of R and the mean absolute error was small under the single CTWN perturbations and dual-factor perturbations. These emulators thus provide statistical response surfaces of yield, including both its mean and interannual variability, to climate factors. They could facilitate spatiotemporal downscaling of crop model simulation, projecting the changes in crop yield variability in the future and serving as a lightweight tool for multi-model ensemble simulation. The emulators enhanced the flexibility of crop yield estimates and expanded the application of large-ensemble simulations of crop yield under climate change.

Climate change↗
NASA NTRS2013

Forecasting Propagation and Evolution of CMEs in an Operational Setting: What Has Been Learned

One of the major types of solar eruption, coronal mass ejections (CMEs) not only impact space weather, but also can have significant societal consequences. CMEs cause intense geomagnetic storms and drive fast mode shocks that accelerate charged particles, potentially resulting in enhanced radiation levels both in ions and electrons. Human and technological assets in space can be endangered as a result. CMEs are also the major contributor to generating large amplitude Geomagnetically Induced Currents (GICs), which are a source of concern for power grid safety. Due to their space weather significance, forecasting the evolution and impacts of CMEs has become a much desired capability for space weather operations worldwide. Based on our operational experience at Space Weather Research Center at NASA Goddard Space Flight Center (http://swrc.gsfc.nasa.gov), we present here some of the insights gained about accurately predicting CME impacts, particularly in relation to space weather operations. These include: 1. The need to maximize information to get an accurate handle of three-dimensional (3-D) CME kinetic parameters and therefore improve CME forecast; 2. The potential use of CME simulation results for qualitative prediction of regions of space where solar energetic particles (SEPs) may be found; 3. The need to include all CMEs occurring within a ~24 h period for a better representation of the CME interactions; 4. Various other important parameters in forecasting CME evolution in interplanetary space, with special emphasis on the CME propagation direction. It is noted that a future direction for our CME forecasting is to employ the ensemble modeling approach.

forecasting↗
NASA NTRS1997

[Low-Frequency Flow Oscillation

The results of the research conducted under this grant are presented in detail in three Master theses, by Heinrich, Balow, and Broeren. Additional analysis of the experimental data can be found in two AIAA Journal articles and two conference papers. Citations for all of the studies' publications can be found in the bibliography which is attached. The objective of Heinrich's study was to document the low-frequency flow oscillation on the LRN-1007 airfoil, which had been previously observed at low Reynolds number, to determine its origin, and explore the phenomenon at higher Reynolds number. Heinrich performed detailed flow visualization on the airfoil using surface fluorescent oil and laser-sheet off-body visualization. A large leading-edge separation bubble and trailing-edge separation was identified on the airfoil just prior to the onset of the unsteady stall flow oscillation. From the laser-sheet data, the unsteady flow appeared as a massive boundary-layer separation followed by flow reattachment. Hot-wire data were taken in the wake to identify the presence of the flow oscillation and the dominant frequency. The oscillation was found in the flow from a Reynolds number of 0.3 to 1.3 x 10 exp 6. The Strouhal number based on airfoil projected height was nominally 0.02 and increased slightly with increasing Reynolds number and significantly with increasing airfoil angle of attack. Balow focused his research on the leading-edge separation bubble which was hypothesized to be the origin of the low-frequency oscillation. Initially, experimental measurements in the bubble at the onset of the low-frequency oscillation were attempted to study the characteristics of the bubble and explain possible relationships to the shear-layer-flapping phenomena. Unfortunately, the bubble proved to be extremely sensitive to the probe interference and it drastically reduced the size of the bubble. These detailed measurements were then abandoned by Balow. However, this led to a series of tests where the leading-edge bubble and trailing-edge separation were altered and the affect on the flow-oscillation studied. Balow found that by tripping the airfoil boundary-layer with "zigzag" tape ahead of bubble separation, the bubble was effectively eliminated mid the oscillation suppressed. Wake survey drag measurements showed a drastic reduction in airfoil drag when the bubble and oscillation were eliminated. Using the "zigzag" tape, the trailing-edge separation was moved downstream approximately 5 percent chord. This was found to reduce the amplitude of the oscillation, particularly in the onset stage at low angle of attack (around 14 degrees). Through detailed analysis of the wake behind the airfoil during the unsteady flow oscillation, Balow provided a better understanding of the wake flowfield. Broeren studied the oscillating flowfield in detail at Reynolds number equal 3 x 10 exp 5 and an angle of attack of 15 degrees using laser Doppler velocimetry (LDV). Two-dimensional LDV data were acquired at 687 grid points above the model upper surface while hot-wire data were taken simultaneously in the wake. Using the hot-wire signal, the LDV data were phase averaged into 24 bins to represent a single ensemble average of one oscillation cycle. The velocity data showed a flowfield oscillation that could be divided into three flow regimes. In the first regime, the flow over the airfoil was completely separated initially, the flowfield reattached from the leading edge and the reattachment point moved downstream with increasing time or phase. Broeren referred to this as the reattachment regime. The bubble development regime followed, where a leading-edge separation bubble formed at the leading edge and grew with increasing time. During the initial part of this regime the trailing-edge separation continued to move downstream. However, during the last 30 degrees of phase the trailing-edge separation moved rapidly forward and appeared to merge with the leading-edge bubble. During the third regime, the separation regime, the flow was segmented from the airfoil leading edge and did not reattach to the airfoil surface. The reverse flow was seen to grow in vertical extent up from the model surface as the phase increased. Next reattachment began again at the leading edge signaling the start of the reattachment regime, and so the cycle continued. From Broeren's work, the details of the unsteady flowfield over the airfoil were seen for the first time. From this research a great deal has been learned about the low-frequency flow oscillation which naturally occurs on the LRN-1007 airfoil near stall. The oscillation was seen to persist at higher Reynolds number, the dependence of the Strouhal number on angle of attack and Reynolds number were discovered, the critical role played by the laminar bubble was shown and the entire upper surface flowfield during a flow oscillation cycle was measured and analyzed. What still eludes understanding is the scaling of the flow oscillation and why certain airfoils, such as the LRN, have a very strong low-frequency mode and other airfoils exhibit no organized low-frequency oscillation at all.

Bragg, Michael B.↗
NASA NTRSDate not supplied

Medium-Range River Flood Forecasts Using a Long Short-Term Memory Network

River flooding and the impacts are a concern for decision makers throughout the United States. Accurate medium-range forecasts (~3-7 days) are critical for providing advanced outlooks to emergency management officials. Unfortunately, accurately forecasting rainfall-runoff and the subsequent rise and fall within rivers remain a challenge in hydrological modeling. While complex physical modeling systems are the standard for representing the hydrological processes, they are computationally demanding and can require extensive calibration. Further, uncertainties remain in the model parameters and input data. The use of machine learning can reduce some of the computational demand while maintaining high accuracy. Therefore, this project makes use of a Long Short-Term Memory (LSTM) network which explicitly accounts for the time-dependent nature of rainfall-runoff modeling. The developed LSTM was trained to predict river gauge height, or stage height, based on time-lagged input features which include: gauge height to initialize the model, the NASA Short-term Prediction Research and Transition Center’s instance of the Land Information System (SPoRT-LIS) relative soil moisture to describe the rainfall infiltration rate, and 6-hr Multi-Radar Multi-Sensor quantitative precipitation estimate (MRMS QPE). The developed LSTM based system is then used to produce 7-day forecasts with a 6-hr temporal resolution using three different quantitative precipitation forecasts (QPF) from the NWS’s Weather Prediction Center (WPC), the NCEP Global Forecast System (GFS) model and the National Blend of Models (NBM). This trained modeling system has been implemented as an experimental product at over 100 different rivers in collaboration with at multiple National Weather Service (NWS) Forecast Offices and River Forecast Centers (RFC) across the eastern half of the United States. The developed LSTM model achieved average Nash-Sutcliffe efficiency (NSE) 0.89 higher than the equivalent medium-range National Water Model ensemble member forecast over a 7-day forecast. In addition to the initial development and evaluation, this project has continued to expand. While the initial model was developed for precipitation dominated basins, expansion of the project has taken it to basins effected by snow melt. This presentation will provide an overview of the project with focus on recent developments on incorporating snow melt processes into the model.

Andrew T. White↗
NASA NTRS2023

Large-Scale Groundwater Monitoring in Brazil Assisted With Satellite-Based Artificial Intelligence Techniques

Here, we develop and test an artificial intelligence (AI)-based approach to monitor major Brazilian aquifers. The approach combines Gravity Recovery and Climate Experiment (GRACE) data and ground-based hydrogeological measurements from Brazil’s Integrated Groundwater Monitoring Network at hundreds of wells distributed in twelve aquifers across the country. We tested model ensembles based on three AI approaches: Extreme Gradient Boost, Light Gradient Boosting Model and CatBoost, followed by a Linear Regression (LR) step. The approach is further boosted with wavelet and seasonal decomposition processes applied to GRACE data. To determine the AI-based model’s sensitivity to data availability, we propose four experiments combining hydrogeological measurements from different aquifers. Groundwater storage estimates from the Global Land Data Assimilation System (GLDAS) are used as benchmark. A sensitivity analysis shows that the LR-based model ensemble is the best suited and to reproduce groundwater storage change in all studied Brazilian aquifers. Results show that the proposed approach outperforms GLDAS in all experiments, with an RMSE value of 2.68cm for the experiment that covers all monitored wells in Brazil. GLDAS resulted in RMSE=6.76cm. Using our AI model outputs, we quantified the groundwater storage change of two major aquifers, Urucuia and Bauru-Caiuá, over the past two decades: -31km 3 and -6km 3 , respectively. Water loss is driven by a prolonged drought across most of the country and intensification of groundwater pumping for irrigation. This study demonstrates that combining satellite data and AI can be a cost-effective alternative to monitor poorly equipped aquifers at the continental scale, with possible global replicability.

GRACE↗
NASA NTRSDate not supplied

Spaceborne Lidar Retrievals of PM2.5 for Air Quality Studies and Applications

Fine particulate matter (PM2.5) substantially contributes to air pollution and negatively affects human health. While many studies have investigated the use of passive column-integrated aerosol optical depth to infer surface PM2.5, the use of lidar observations for air quality characterization is not nearly as extensive. Lidar measurements are critical, however, due to the vertical aerosol information they provide, including near the surface. In this presentation, we first provide an overview of various lidar-based approaches for estimating PM2.5 concentrations and then discuss how lidar measurements can assist other air quality applications. For example, estimates of PM2.5 have been obtained in a physics-based approach through CALIOP near-surface aerosol extinction retrievals, assumptions on the mass extinction efficiency, and incorporating other parameters (an aerosol hygroscopic growth factor and PM2.5/PM10 ratio). Application of this algorithm over the contiguous United States (CONUS) from 2006 to 2018 yielded larger PM2.5 values over the eastern and western CONUS (~10-15 μg/m³) and lower PM2.5 levels in the central CONUS (~5 μg/m³). These spatial patterns were similar to those from gridded PM2.5 concentrations obtained through in situ measurements at ground stations operated by the US Environmental Protection Agency. In another approach, the Cloud Aerosol Transport System (CATS) lidar was used with the Goddard Earth Observing System (GEOS) model in a 1D ensemble-based variational technique to obtain PM2.5 over the US and Europe, and the spatial patterns of the CATS/GEOS based PM2.5 concentrations generally captured those from surface stations (with corresponding hourly EPA PM2.5 vs CATS PM2.5 statistics of R=0.4 and bias=1.5 μg/m³). In our recent work, as part of the Models, In situ, and Remote sensing of Aerosols (MIRA) Working Group, we have applied both the CALIOP and CATS/GEOS based approaches over the highly polluted country of India during the post-monsoon season (September-October 2016). We derived elevated levels of two-month mean PM2.5 (~100 μg/m³) in northern India, especially near New Delhi. These high PM2.5 concentrations in the Indo-Gangetic plain are driven in large part from the seasonal burning of crop residue and meteorological conditions typical at this time of the year, such as low wind speeds and a shallow boundary layer. While the satellite-derived PM2.5 moderately replicates (R = ~0.7-0.9) the spatial variability in the two-month mean of surface in situ PM2.5 from monitoring sites operated by the Central and State Pollution Control Boards, we show results from specific scenes for which there are large deviations between the satellite-derived PM2.5 and in situ measurements. Other current work on this topic focuses on developing PM2.5 estimates using airborne high spectral resolution lidar measurements through machine learning regression algorithms and involves several parameters (e.g., aerosol extinction, color ratio, lidar ratio). Application of this method over major metropolitan areas in the US and Asia have resulted in high correlations (R = 0.93) with surface measurements. This airborne lidar approach can be adapted to spaceborne lidar measurements, and all three of these approaches can be applied to ESA’s EarthCARE Atmospheric Lidar instrument, setting the stage for the future Cloud Aerosol Lidar for Global Scale Observations of the Ocean-Land Atmosphere System (CALIGOLA) mission. Ultimately, beyond estimates of PM2.5, the aerosol vertical distribution from lidars can benefit studies involving passive sensor approaches for PM2.5 proxies (including from geostationary satellites), wildfire smoke plume injection heights, volcanic emissions (e.g., ash height retrievals), and aerosol/air quality model assimilation, evaluation, and forecasts.

Travis D Toth↗
NASA NTRS2018

Recent Updates in the SMAP Level-4 Soil Moisture Algorithm

The NASA Soil Moisture Active Passive (SMAP) mission generates, among other data sets, the Level-4 Soil Moisture (L4_SM) product. The L4_SM data are published with a mean latency of ~2.5 days from the time of observation and provide global, three-hourly, 9-km resolution estimates of surface and root-zone soil moisture and related land surface states and fluxes. The L4_SM algorithm is based on the assimilation of SMAP radiometer brightness temperature observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF). In 2018, the L4_SM algorithm was upgraded from Version 3 to Version 4. Underlying the new version is a revised modeling system that includes improved input parameter datasets for land cover, topography, and vegetation height that are based on recent, high-quality, space-borne remote sensing observations. Additionally, SMAP Level-2 soil moisture retrievals and in situ soil moisture measurements were used to calibrate a particular Catchment model parameter that governs the recharge of surface soil moisture from below under non-equilibrium conditions, which brings the model's surface soil moisture more in line with the SMAP Level-2 and in situ soil moisture. Moreover, the calibration of the assimilated SMAP brightness temperatures changed substantially from Version 3 to Version 4, and the "catchment deficit" model variable was removed from the EnKF state vector to avoid degrading the model's groundwater estimates.Considerable effort went into the version upgrade, creating an expectation that the new version is improved over the old version. Indeed, some aspects of the new version are clearly better. However, other aspects are not. In this presentation we summarize the skill of the new and old versions vs. independent in situ measurements and in terms of data assimilation diagnostics, including, for example, the statistics of the (soil moisture) analysis increments and the observation-minus-forecast (brightness temperatures) residuals. We share our experience with trying to improve to the L4_SM product and the lessons learned from the effort.

Reichle, Rolf H.↗
NASA NTRS2018

Improving the SMAP Level-4 Soil Moisture Product

The NASA Soil Moisture Active Passive (SMAP) mission generates, among other data sets, the Level 4 Soil Moisture (L4 SM) product. The L4 SM algorithm is based on the assimilation of SMAP radiometer brightness temperature observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. The L4 SM data are published with a mean latency of approx. 2.5 days from the time of observation and provide global, three-hourly, 9 km resolution estimates of surface and root-zone soil moisture and related land surface states and fluxes. In 2018, the product was upgraded from Version 3 to Version 4. Underlying the new version is a revised modeling system that includes improved input parameter datasets for land cover, topography, and vegetation height that are based on recent, high quality space-borne remote sensing observations. Land cover inputs were updated to the GlobCover2009 product, which is based on satellite observations from the Medium Resolution Imaging Spectrometer. Topographic statistics now rely on observations from the Shuttle Radar Topography Mission. Finally, vegetation height inputs are derived from space-borne Lidar measurements. Additionally, SMAP Level-2 soil moisture retrievals and in situ soil moisture measurements were used to calibrate a particular Catchment model parameter that governs the recharge of soil moisture from the models root-zone excess reservoir into the surface excess reservoir. Specifically, the replenishment of soil moisture near the surface from below under non-equilibrium conditions was substantially reduced, which brings the models surface soil moisture more in line with the SMAP Level 2 and in situ soil moisture. Finally, the calibration of the assimilated SMAP brightness temperatures changed substantially from Version 3 to Version 4. Considerable effort went into the version upgrade, creating an expectation that the new version is improved over the old version. Indeed, some aspects of the new version are clearly better. However, other aspects are not, and on balance, the overall improvement is modest at best. In this presentation we summarize the skill of the new and old versions vs. independent in situ measurements and in terms of data assimilation diagnostics, including, for example, the statistics of the (soil moisture) analysis increments and the observation minus forecast (brightness temperatures) residuals. We share our experience with trying to improve to the L4 SM product and the lessons learned from the effort.

Reichle, Rolf↗