Results for “Error Metrics” — Page 12

NASA NTRS2010

Simulating Future GPS Clock Scenarios with Two Composite Clock Algorithms

Using the GPS Toolkit, the GPS constellation is simulated using 31 satellites (SV) and a ground network of 17 monitor stations (MS). At every 15-minutes measurement epoch, the monitor stations measure the time signals of all satellites above a parameterized elevation angle. Once a day, the satellite clock estimates the station and satellite clocks. The first composite clock (B) is based on the Brown algorithm, and is now used by GPS. The second one (G) is based on the Greenhall algorithm. The composite clock of G and B performance are investigated using three ground-clock models. Model C simulates the current GPS configuration, in which all stations are equipped with cesium clocks, except for masers at USNO and Alternate Master Clock (AMC) sites. Model M is an improved situation in which every station is equipped with active hydrogen masers. Finally, Models F and O are future scenarios in which the USNO and AMC stations are equipped with fountain clocks instead of masers. Model F is a rubidium fountain, while Model O is more precise but futuristic Optical Fountain. Each model is evaluated using three performance metrics. The timing-related user range error having all satellites available is the first performance index (PI1). The second performance index (PI2) relates to the stability of the broadcast GPS system time itself. The third performance index (PI3) evaluates the stability of the time scales computed by the two composite clocks. A distinction is made between the "Signal-in-Space" accuracy and that available through a GNSS receiver.

global positioning system↗

DOE OSTI2022

Investigating Tropical Versus Extratropical Influences on the Southern Hemisphere Tropical Edge in the Unified Model

Abstract Since the late 1970s, observations have shown a widening of the tropical Hadley cell (HC) circulation. State‐of‐the‐art climate models reproduce the general trend along with a projected continuous expansion. Discrepancies in expansion rates of observation‐ and model‐based studies have been attributed to differences in applied methods, natural variability and model shortcomings. Furthermore, the driving influence of tropical or extratropical processes on these changes is not well understood. All of this highlights the dynamical mechanisms and the region of origin controlling the tropical width are still insufficiently understood. Here we examine the influence of systematic model biases of the atmosphere‐only Unified Model (UM) onto the simulation of the Southern Hemisphere (SH) tropical edge. We utilize nudged experiments with prescribed sea surface temperatures, where potential temperature and horizontal winds are relaxed back to ERA‐Interim reanalysis for a 20‐year period in selected regions. Correcting model biases in the tropics and extratropics separately allows us to dissect the dominant remote impacts of present model errors onto the SH tropical edge simulation. The experiments are applied to established tropical width metrics ranging from near‐surface to upper‐level metrics capturing the poleward flank of the HC. We find both regions work remotely to reduce errors in the UM fields and location of the tropical edge. Surprisingly, correcting the extratropical biases, south of 45°S, more consistently improves the tropical width across the metrics and seasons than nudging the tropics (10°N–10°S). These findings demonstrate the substantial role of extratropical influences in locating the SH tropical edge.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2017

Adjoint-Based Mesh Adaptation for the Sonic Boom Signature Loudness

The mesh adaptation functionality of FUN3D is utilized to obtain a mesh optimized to calculate sonic boom ground signature loudness. During this process, the coupling between the discrete-adjoints of the computational fluid dynamics tool FUN3D and the atmospheric propagation tool sBOOM is exploited to form the error estimate. This new mesh adaptation methodology will allow generation of suitable meshes adapted to reduce the estimated errors in the ground loudness, which is an optimization metric employed in supersonic aircraft design. This new output-based adaptation could allow new insights into meshing for sonic boom analysis and design, and complements existing output-based adaptation techniques such as adaptation to reduce estimated errors in off-body pressure functional. This effort could also have implications for other coupled multidisciplinary adjoint capabilities (e.g., aeroelasticity) as well as inclusion of propagation specific parameters such as prevailing winds or non-standard atmospheric conditions. Results are discussed in the context of existing methods and appropriate conclusions are drawn as to the efficacy and efficiency of the developed capability.

Rallabhandi, Sriram K.↗

DOE OSTI2021

Toward Guided Mutagenesis: Gaussian Process Regression Predicts MHC Class II Antigen Mutant Binding

Antigen-specific immunotherapies (ASI) require successful loading and presentation of antigen peptides into the major histocompatibility complex (MHC) binding cleft. One route of ASI design is to mutate native antigens for either stronger or weaker binding interaction to MHC. Exploring all possible mutations is costly both experimentally and computationally. To reduce experimental and computational expense, here we investigate the minimal amount of prior data required to accurately predict the relative binding affinity of point mutations for peptide-MHC class II (pMHCII) binding. Using data from different residue subsets, we interpolate pMHCII mutant binding affinities by Gaussian process (GP) regression of residue volume and hydrophobicity. We apply GP regression to an experimental data set from the Immune Epitope Database, and theoretical data sets from NetMHCIIpan and Free Energy Perturbation calculations. We find that GP regression can predict binding affinities of nine neutral residues from a six-residue subset with an average R 2 coefficient of determination value of 0.62 ± 0.04 (±95% CI), average error of 0.09 ± 0.01 kcal/mol (±95% CI), and with an receiver operating characteristic (ROC) AUC value of 0.92 for binary classification of enhanced or diminished binding affinity. Similarly, metrics increase to an R2 value of 0.69 ± 0.04, average error of 0.07 ± 0.01 kcal/mol, and an ROC AUC value of 0.94 for predicting seven neutral residues from an eight-residue subset. Our work finds that prediction is most accurate for neutral residues at anchor residue sites without register shift. This work holds relevance to predicting pMHCII binding and accelerating ASI design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2022

Evaluation of remote sensing-based evapotranspiration products at low-latitude eddy covariance sites

Remote sensing-based evapotranspiration (ET) products have been evaluated primarily using data from northern middle latitudes; therefore, little is known about their performance at low latitudes. To address this bias, an evaluation dataset was compiled using eddy covariance data from 40 sites between latitudes 30° S and 30° N. The flux data were obtained from the emerging network in Mexico (MexFlux) and from openly available databases of FLUXNET, AsiaFlux, and OzFlux. This unique reference dataset was then used to evaluate remote sensing-based ET products in environments that have been underrepresented in earlier studies. The evaluated products were: MODIS ET (MOD16, both the discontinued collection 5 (C5) and the latest collection (C6)), Global Land Evaporation Amsterdam Model (GLEAM) ET, and Atmosphere-Land Exchange Inverse (ALEXI) ET. Products were compared with unadjusted fluxes (ETorig) and with fluxes corrected for the lack of energy balance closure (ETebc). Three common statistical metrics were used: coefficient of determination (R2), root mean square error (RMSE), and percent bias (PBIAS). The effect of a vegetation mismatch between pixel and site on product evaluation results was investigated by examining the relationship between the statistical metrics and product-specific vegetation match indexes. Evaluation results of this study and those published in the literature were used to examine the performance of the products across latitudes. Differences between the MOD16 collection 5 and 6 datasets were generally smaller than differences with the other products. Performance and ranking of the evaluated products depended on whether ETorig or ETebc was used. When using ETorig, GLEAM generally had the highest R2, smallest PBIAS, and best RMSE values across the studied land cover types and climate zones. Neither MOD16 nor ALEXI performed consistently better than the other. When using ETebc, none of the products stood out in terms of both low bias and strong correlations. The use of ETebc instead of ETorig affected the biases more than the correlations. The product evaluation results showed no significant relationship with the degree of match between the vegetation at the pixel and site scale. The latitudinal comparison showed tendencies of lower R2 (all products) but better PBIAS and normalized RMSE values (MOD16 and GLEAM) for forests at low latitudes than for forests at northern middle latitudes. For non-forest vegetation, the products showed no clear latitudinal differences in performance.

Diego Salazar-Martínez↗

DOE OSTI2021

Monitoring agroecosystem productivity and phenology at a national scale: A metric assessment framework

Effective measurement of seasonal variations in the timing and amount of production is critical to managing spatially heterogeneous agroecosystems in a changing climate. Although numerous technologies for such measurements are available, their relationships to one another at a continental extent are unknown. Using data collected from across the Long-Term Agroecosystem Research (LTAR) network and other networks, we investigated correlations among key metrics representing primary production, phenology, and carbon fluxes in croplands, grazing lands, and crop-grazing integrated systems across the continental U.S. Metrics we examined included gross primary productivity (GPP) estimated from eddy covariance (EC) towers and modelled from the Landsat satellite, Landsat NDVI, and vegetation greenness (Green Chromatic Coordinate, GCC) from tower-mounted PhenoCams for 2017 and 2018. Overall, our analysis compared production dynamics estimated from three independent ground and remote platforms using data for 34 agricultural sites constituting 51 site-years of co-located time series. Pairwise sensor comparisons across all four metrics revealed stronger correlation and lower root mean square error (RMSE) between end of season (EOS) dates (Pearson R ranged from 0.6 to 0.7 and RMSE from 32.5 to 67.8) than start of season (SOS) dates (0.46 to 0.69 and 40.4 to 66.2). Overall, moderate to high correlations between SOS and EOS metrics complemented one another except at some lower productivity grazing land sites where estimating SOS can be challenging. Growing season length estimates derived from 16-day satellite GPP (179.1 days) were significantly longer than those from PhenoCam G CC (70.4 days, p adj < 0.0001) and EC GPP (79.6 days, p adj < 0.0001). Landscape heterogeneity did not explain differences in SOS and EOS estimates. Annual integrated estimates of productivity from EC GPP and PhenoCam G CC diverged from those estimated by Landsat GPP and NDVI at sites where annual production exceeds 1000 gC/m –2 yr –1 . Based on our results, we developed a “metric assessment framework” that articulates where and how metrics from satellite, eddy covariance and PhenoCams complement, diverge from, or are redundant with one another. The framework was designed to optimize instrumentation selection for monitoring, modeling, and forecasting ecosystem functioning with the ultimate goal of informing decision-making by land managers, policy-makers, and industry leaders working at multiple scales.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Evaluating simplifications of subsurface process representations for field-scale permafrost hydrology models

Abstract. Permafrost degradation within a warming climate poses a significant environmental threat through both the permafrost carbon feedback and damage to human communities and infrastructure. Understanding this threat relies on better understanding and numerical representation of thermo-hydrological permafrost processes and the subsequent accurate prediction of permafrost dynamics. All models include simplified assumptions, implying a tradeoff between model complexity and prediction accuracy. The main purpose of this work is to investigate this tradeoff when applying the following commonly made assumptions: (1) assuming equal density of ice and liquid water in frozen soil, (2) neglecting the effect of cryosuction in unsaturated freezing soil, and (3) neglecting advective heat transport during soil freezing and thaw. This study designed a set of 62 numerical experiments using the Advanced Terrestrial Simulator (ATS v1.2) to evaluate the effects of these choices on permafrost hydrological outputs, including both integrated and pointwise quantities. Simulations were conducted under different climate conditions and soil properties from three different sites in both column- and hillslope-scale configurations. Results showed that amongst the three physical assumptions, soil cryosuction is the most crucial yet commonly ignored process. Neglecting cryosuction, on average, can cause 10 %–20 % error in predicting evaporation, 50 %–60 % error in discharge, 10 %–30 % error in thaw depth, and 10 %–30 % error in soil temperature at 1 m beneath the surface. The prediction error for subsurface temperature and water saturation is more obvious at hillslope scales due to the presence of lateral flux. By comparison, using equal ice–liquid density has a minor impact on most hydrological metrics of interest but significantly affects soil water saturation with an averaged 5 %–15 % error. Neglecting advective heat transport presents the least error, 5 % or even much lower, in most metrics of interest for a large-scale Arctic tundra system without apparent influence caused by localized groundwater flow, and it can decrease the simulation time at hillslope scales by 40 %–80 %. By challenging these commonly made assumptions, this work provides permafrost hydrology scientists an important context for understanding the underlying physical processes, including allowing modelers to better choose the appropriate process representation for a given modeling experiment.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer

The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases of specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Dense Image Matching Uncertainty Estimation and Confidence Metrics

Dense stereo matching takes overlapping image pairs as input and outputs a disparity map which encodes pixel-by-pixel matches between the images. Recently, there has been an interest in ranking the quality, or even quantifying the accuracy, of disparity estimates. The proposed methods can be described as either uncertainty estimators or confidence metrics. Uncertainty estimators are a small minority of the research. However, they have the potential to be the most useful because they estimate disparity accuracy (in pixel units) that can be used to threshold matches or carried forward using error propagation. The majority of the research deals with confidence metrics which give an ordinal (or binary) ranking of a match’s quality relative to other matches. Confidence metrics do not have units and thus are useful primarily for thresholding matches from mismatches. The methods could also be described as handcrafted or deep-learning based. The majority of the research focused on outdoor driving scenes. Hence, our interest–application to a satellite semi-global matching pipeline–is a domain shift that may challenge deep-learning based methods. We conclude by recommending five handcrafted and two deep-learning based methods for evaluation in our pipeline.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Machine learning application to single channel design of molten salt reactor

This study proposes a robust approach to quickly design a nuclear reactor core and explores the best performing machine learning (ML) technique for predicting feature parameters of the core. Here we implemented the approach into a hypothetical channel of molten salt reactors to demonstrate the applicability of the method. We prepared a Python tool, named Plankton, which couples to a reactor physics code and an optimization tool, and imports ML methods. The tool performs three consecutive phases: reactor database generation, machine learning application, and design optimization. We identified the extra trees method as the best performing estimator. With the estimator, we found nine optimum designs in total, one for each fuel-salt pair, and estimated all the performance metrics of the designs with a <5% prediction error compared to their actual values. U-Pu-NaCl fuel-salt gave promising results with the highest conversion ratio, the most negative feedback coefficient, and the lowest fast flux.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2020

Benchmarking noise extrapolation with the OpenPulse control framework

Distilling precise estimates from noisy intermediate scale quantum (NISQ) data has recently attracted considerable attention Kandala et al., Nature (London) 567, 491 (2019). In order to augment digital qubit metrics, such as gate fidelity, we discuss analog error mitigability, i.e., the ability to accurately distill precise observable estimates, as a hybrid quantum classical computing benchmarking task. Specifically, using Rabi oscillations as a test program, we characterize single qubit error rates on IBM's Poughkeepsie superconducting quantum hardware, incorporate control-mediated noise dependence into a generalized rescaling protocol, and analyze how noise characteristics influence Richardson extrapolation-based error mitigation. Finally, our results identify regions in the space of Hamiltonian control fields and circuit depth which are most amenable to reliable noise extrapolation, as well as shed light on how low-level hardware characterization can be used as a predictive tool for uncertainty quantification in error-mitigated NISQ computations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Assessing equation of state-independent relations for neutron stars with nonparametric models

Relations between neutron star properties that do not depend on the nuclear equation of state offer insights on neutron star physics and have practical applications in data analysis. Such relations are obtained by fitting to a range of phenomenological or nuclear physics equation of state models, each of which may have varying degrees of accuracy. In this study we revisit commonly used relations and reassess them with a very flexible set of phenomenological nonparametric equation of state models that are based on Gaussian processes. Our models correspond to two sets: equations of state which mimic hadronic models, and equations of state with rapidly changing behavior that resemble phase transitions. Here we quantify the accuracy of relations under both sets and discuss their applicability with respect to expected upcoming statistical uncertainties of astrophysical observations. We further propose a goodness-of-fit metric which provides an estimate for the systematic error introduced by using the relation to model a certain equation-of-state set. Overall, the nonparametric distribution is more poorly fit with existing relations, with the I–Love–Q relations retaining the highest degree of universality. Fits degrade for relations involving the tidal deformability, such as the binary-Love and compactness-Love relations, and when introducing phase transition phenomenology. For most relations, systematic errors are comparable to current statistical uncertainties under the nonparametric equation of state distributions.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1995

Automated spectral classification and the GAIA project

Two dimensional spectral types for each of the stars observed in the global astrometric interferometer for astrophysics (GAIA) mission would provide additional information for the galactic structure and stellar evolution studies, as well as helping in the identification of unusual objects and populations. The classification of the large quantity generated spectra requires that automated techniques are implemented. Approaches for the automatic classification are reviewed, and a metric-distance method is discussed. In tests, the metric-distance method produced spectral types with mean errors comparable to those of human classifiers working at similar resolution. Data and equipment requirements for an automated classification survey, are discussed. A program of auxiliary observations is proposed to yield spectral types and radial velocities for the GAIA-observed stars.

Lasala, Jerry↗

NASA NTRS1997

An Analytical Comparison of the Acoustic Analogy and Kirchhoff Formulation for Moving Surfaces

The Lighthill acoustic analogy, as embodied in the Ffowcs Williams-Hawkings (FW-H) equation, is compared with the Kirchhoff formulation for moving surfaces. A comparison of the two governing equations reveals that the main Kirchhoff advantage (namely nonlinear flow effects are included in the surface integration) is also available to the FW-H method if the integration surface used in the FW-H equation is not assumed impenetrable. The FW-H equation is analytically superior for aeroacoustics because it is based upon the conservation laws of fluid mechanics rather than the wave equation. This means that the FW-H equation is valid even if the integration surface is in the nonlinear region. This is demonstrated numerically in the paper. The Kirchhoff approach can lead to substantial errors if the integration surface is not positioned in the linear region. These errors may be hard to identify. Finally, new metrics based on the Sobolev norm are introduced which may be used to compare input data for both quadrupole noise calculations and Kirchhoff noise predictions.

Brentner, Kenneth S.↗

NASA NTRS2014

Link Analysis for Space Communication Links Using ARQ Protocol

In space communications, standard link analysis assumes that messages are sent once. For a communication link that uses an error-correction coding scheme, bit-error-rate (BER) or frame-error-rate (FER), and link margins are common metrics that characterize the quality of a link, and they are used to determine the supportable data rate. With the advent of Automatic Repeat-reQuest (ARQ) protocols, when messages are corrupted during transmission, they can be resent multiple times automatically until they are correctly received and acknowledged. The concept of BER, FER, and link margin cannot be directly applied, and the link analysis approach for ARQ links needs to be re-examined.

Cheung, Kar-Ming↗

NASA NTRS2022

Quantifying and Reducing Uncertainty in Microwave Vegetation Optical Depth and Soil Moisture Retrievals

Soil moisture and vegetation optical depth (VOD; related to vegetation water content) retrieved from SMAP and SMOS satellites are widely used for a range of hydrosphere and biosphere applications. However, while soil moisture has been globally well-validated, VOD validation has been sparse. Furthermore, simultaneously retrieval of these parameters results in uncertainties both individually in soil moisture and VOD retrievals as well as in compensation between the parameters. Here, we show global locations where soil moisture and VOD retrievals will have lower uncertainty, based on complementary brightness temperature information content and signal-to-noise ratio metrics. In these same locations, we show that error still propagates more into VOD. However, using VOD regularization algorithms, this error is greatly reduced, especially at sub-weekly timescales where algorithmic error can be most apparent. Despite these regularization approaches that reduce errors, there are yet vast differences in available global regularized retrievals originating from different algorithmic choices.

Passive microwave radiometry↗

NASA NTRSDate not supplied

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

NASA NTRSDate not supplied

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗