Results for “Comparative framework” — Page 4

NASA NTRS2020

Dust Aerosol Retrieval Over the Oceans With the MODIS/VIIRS Dark Target Algorithm: 2. Nonspherical Dust Model

The Dark‐target (DT) aerosol algorithm retrieves spectral Aerosol Optical Depth (AOD) and other aerosol properties from Moderate‐resolution Imaging Spectrometer (MODIS) reflectance observations. Over the ocean, the DT algorithm is known to contain scattering‐angle‐dependent biases in its retrievals of AOD, Angstrom Exponent (AE), and Fine Mode Fraction (FMF) for dust aerosols. Following a two‐step strategy to improve the DT retrieval of dust over ocean, for which the first step is to identify dusty pixels (reported in “Part 1”), in this “Part 2,” we report on construction of a new dust model lookup table (LUT) and the strategy for applying it within the existing DT algorithm. In particular, we evaluate different characterizations of dust optical properties from a variety of frameworks and databases, and compare them with the current DT retrieval assumptions. Substituting the standard operational LUT with a spheroid dust model with identified dusty pixels shows significant improvement when compared with collocated AERONET‐identified dusty pixels. Specifically, the application of the new dust model to dusty pixels reduces their AOD bias from 0.06 to 0.02 while improving the fraction of retrievals within expected error from 64% to 82%. At the same time, the overall bias in AE is reduced from 0.13 to 0.06, and the scattering‐angle‐dependent AE bias is largely eliminated. In testing on two full months of data (April and July), the new retrieval will reduce the monthly mean AOD by up to 0.1 and 0.2 in the north Atlantic and Arabian seas, respectively. The average AE and FMF are also reduced in these dust heavy regions

dust aerosol retrieval↗

NASA NTRSDate not supplied

HIFiRE Flight 2 Unstart Reliability Analysis

The objective of this work was to assess the unstart reliability of the HIFiRE Flight 2 system. To do this, a quantification of margins and uncertainties framework was used for comparing model predictions of the predicted combustion induced shock location to the predicted last stable shock location within the isolator. Uncertainty sources included parametric uncertainty in the flight conditions, the heat release model, and turbulence modeling, as well as model verification errors. Additionally, an estimate of model-form uncertainty was established by comparing the model to measured ground test data. A computationally efficient non-intrusive polynomial chaos approach was used to propagate parametric uncertainty through the computational flu-ids dynamics models of both the ground test configuration and the flight vehicle. Compared to direct-connect ground test data, computational fluid dynamics predictions yielded about two duct heights of model-form uncertainty. This was applied to a prediction of flight vehicle unstart margin at the Mach 6.5 flight condition. Building up all of the computational model uncertainty, including parametric uncertainty, verification errors, and the determined model-form uncertainty, a 95% probability level based confidence ratio, or a ratio of total uncertainty to a statistical margin measure, was found to be 0.31 for the flight system.

Thomas K West↗

NASA NTRSDate not supplied

Expanding the Spatiotemporal Range of Soil Moisture Analysis Utilizing NASA Earth Observations and In Situ Measurements

Drought can cause immense agricultural and ecological damage resulting in high mitigation and compensation costs. Climate variability in future decades is expected to cause severe drought conditions and threaten necessary water resources. Stakeholders seek to implement effective drought assessments in preparation for potential economic and environmental damage invoked by drought. Although in-situ measurements are accurate, the current infrastructure is spatially limited and costly to maintain. A framework was created to compare modeled, satellite and in-situ data in drought monitoring. Here we show that the comparison of in-situ and remotely sensed soil moisture (SM) measurements can increase the spatiotemporal range of SM assessments. Data collected between 2003 and 2021 by NASA’s SPoRT Land Information System (SPoRT-LIS) and Soil Moisture Active Passive (SMAP) mission were standardized and compared with in-situ data provided through the Illinois Climate Network (WARM). Statistical analysis results including the Pearson correlation coefficient (r), root mean squared error, mean absolute error and others were calculated to compare the WARM measurements to the SMAP and SPoRT-LIS products. Results indicate that both satellite products demonstrate seasonally variable bias that is not present in the in-situ measurements. Bias was highest in the winter months and lowest in the late summer and early fall months in both satellite datasets. Overall, WARM-SPoRT comparisons resulted in lower seasonal variability. However, on average, the SMAP comparison demonstrated higher correlation values and lower error values. The WARM-SMAP average correlation (r) was 0.61 compared to the WARM-SPoRT average correlation (r) value of 0.54. Average mean absolute error values calculated for the SMAP and SPoRT comparisons were 0.07 and 0.08 percent soil moisture by volume, respectively. These analyses suggest integrating in-situ measurements and those provided by NASA Earth observations can be utilized in a multi-faceted SM evaluation, a valuable contribution to drought monitoring and water resource decision making.

Emma P Myrick↗

NASA NTRSDate not supplied

Benchmark Problem for Autonomous Urban Air Mobility

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

NASA NTRSDate not supplied

Community Benchmark Problem for Intelligent Contingency Management

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

NASA NTRS2026

Benchmarking Bayesian Optimization Frameworks and Acquisition Strategies for Materials Discovery and Autonomous Laboratories

Bayesian optimization (BO) can accelerate materials discovery by guiding expensive experiments toward the most promising processing conditions. We systematically compare five BO surrogate and framework combinations (Gaussian processes in Ax, Gaussian processes and Monte-Carlo neural networks in BayBE, random forests in Lolopy, and tree-structured Parzen (TPE) estimators in Hyperopt) on three benchmarks that mimic common materials design tasks (a discrete solid-electrolyte composition space, a hybrid discrete/continuous laminate-composite design problem solved with micromechanics modeling, and the continuous Ishigami analytic function which is a standard optimization benchmark). Each BO surrogate is paired with posterior mean, probability of improvement, and expected improvement acquisition functions and run for 100 trials from randomized initial samples with uniform random search providing a control. Across five random seeds per setting, BayBE’s Gaussian-process surrogate with expected improvement consistently reached ≥95 % of the known optimum in the fewest evaluations, while Lolopy’s random forest matched or exceeded GP performance on purely categorical or mixed spaces at a higher computational cost. Posterior mean alone often stagnated at local optima, underscoring the need for exploration, whereas probability and expected improvement balanced exploration and exploitation leading to better optimization in fewer trials. Execution times ranged from milliseconds for TPE to minutes for neural-network and random-forest surrogates. These results establish baseline expectations for BO in automated materials laboratories and highlight expected improvement with Gaussian processes as a reliable first choice, with random forests offering a strong alternative when categorical variables dominate. The benchmark suite and code are released to facilitate future surrogate, acquisition, and constraint-handling research in data-driven materials optimization.

Bayesian optimization↗

NASA NTRS2022

Reservoir Assessment Tool 2.0: Stakeholder driven improvements to satellite remote sensing based reservoir monitoring

In light of the rapidly increasing regulation of rivers due to planned and constructed reservoirs, monitoring reservoir operations has become very crucial. The Reservoir Assessment Tool (RAT) framework was developed to monitor reservoir operations globally, using hydrological modeling and satellite observations. With feedback from stakeholders, improvements in the RAT framework are demonstrated in this study using the Mekong River Basin as an example. A novel multi-sensor reservoir area mapping technique was developed using complementary strengths of optical and SAR sensors at a 1-5 day temporal resolution, allowing the quantification of sub-weekly reservoir operations. Additionally, the skill of radar altimeters in the RAT framework was tested using the Jason-3 altimeter. Using in-situ data from three Thai reservoirs in the Mekong Basin, consistent improvements were observed as compared to the original RAT framework. A functionality for visualizing forecasted outflow was also added using historically inferred reservoir operations or stakeholder-driven target storage expectations.

Reservoirs↗

NASA NTRS2023

Impacts of Estimated Plume Rise on PM 2.5 Exceedance Prediction During Extreme Wildfire Events: A Comparison of Three Schemes (Briggs, Freitas, and Sofiev)

Plume height plays a vital role in wildfire smoke dispersion and the subsequent effects on air quality and human health. In this study, we assess the impact of different plume rise schemes on predicting the dispersion of wildfire air pollution and the exceedances of the National Ambient Air Quality Standards (NAAQS) for fine particulate matter (PM 2.5 ) during the 2020 western United States wildfire season. Three widely used plume rise schemes (Briggs, 1969; Freitas et al., 2007; Sofiev et al., 2012) are compared within the Community Multiscale Air Quality (CMAQ) modeling framework. The plume heights simulated by these schemes are comparable to the aerosol height observed by the Multi-angle Imaging SpectroRadiometer (MISR) and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO). The performance of the simulations with these schemes varies by fire case and weather conditions. On average, simulations with higher plume injection heights predict lower aerosol optical depth (AOD) and surface PM 2.5 concentrations near the source region but higher AOD and PM 2.5 in downwind regions due to the faster spread of the smoke plume once ejected. The 2-month mean AOD difference caused by different plume rise schemes is approximately 20 %–30 % near the source regions and 5 %–10 % in the downwind regions. Thick smoke blocks sunlight and suppresses photochemical reactions in areas with high AOD. The surface PM 2.5 difference reaches 70 % on the West Coast of the USA, and the difference is lower than 15 % in the downwind regions. Moreover, the plume injection height affects pollution exceedance (>35 µg m−3) predictions. Higher plume heights generally produce larger downwind PM 2.5 exceedance areas. The PM 2.5 exceedance areas predicted by the three schemes largely overlap, suggesting that all schemes perform similarly during large wildfire events when the predicted concentrations are well above the exceedance threshold. At the edges of the smoke plumes, however, there are noticeable differences in the PM 2.5 concentration and predicted PM 2.5 exceedance region. For the whole period of study, the difference in the total number of exceedance days could be as large as 20 d in northern California and 4 d in the downwind regions. This disagreement among the PM 2.5 exceedance forecasts may affect key decision-making regarding early warning of extreme air pollution episodes at local levels during large wildfire events.

Yunyao Li↗

NASA NTRS2011

Advances in Landslide Nowcasting: Evaluation of a Global and Regional Modeling Approach

The increasing availability of remotely sensed data offers a new opportunity to address landslide hazard assessment at larger spatial scales. A prototype global satellite-based landslide hazard algorithm has been developed to identify areas that may experience landslide activity. This system combines a calculation of static landslide susceptibility with satellite-derived rainfall estimates and uses a threshold approach to generate a set of nowcasts that classify potentially hazardous areas. A recent evaluation of this algorithm framework found that while this tool represents an important first step in larger-scale near real-time landslide hazard assessment efforts, it requires several modifications before it can be fully realized as an operational tool. This study draws upon a prior work s recommendations to develop a new approach for considering landslide susceptibility and hazard at the regional scale. This case study calculates a regional susceptibility map using remotely sensed and in situ information and a database of landslides triggered by Hurricane Mitch in 1998 over four countries in Central America. The susceptibility map is evaluated with a regional rainfall intensity duration triggering threshold and results are compared with the global algorithm framework for the same event. Evaluation of this regional system suggests that this empirically based approach provides one plausible way to approach some of the data and resolution issues identified in the global assessment. The presented methodology is straightforward to implement, improves upon the global approach, and allows for results to be transferable between regions. The results also highlight several remaining challenges, including the empirical nature of the algorithm framework and adequate information for algorithm validation. Conclusions suggest that integrating additional triggering factors such as soil moisture may help to improve algorithm performance accuracy. The regional algorithm scenario represents an important step forward in advancing regional and global-scale landslide hazard assessment.

Kirschbaum, Dalia Bach↗

NASA NTRS1996

The limits of palaeontological knowledge: finding the gold among the dross

Palaeontological interpretation rests on two interwoven sets of comparisons with the modern world. Palaeobiological interpretation relies on the placement of fossils within a phylogenetic and functional framework based primarily on the comparative biology of living organisms. Analogy to currently observable chemical, physical and taphonomic processes enables palaeoenvironmental inferences to be drawn from geological data. In older rocks, comparisons with the modern Earth can become tenuous, limiting palaeontological interpretation. The problem reaches its apogee in Archaean successions, yet pursuit of multiple lines of evidence establishes that complex microbial communities, fuelled by autotrophy and, likely, photoautotrophy, existed 3500 million years ago. Although Archaean palaeontology has to date focused on silicified coastal sediments, improved understanding of Earth's earliest biosphere may depend on the development of alternative environmental and taphonomic analogies. Spring precipitates and hydrothermal metal deposits are promising candidates. Terrestrial organisms may be of limited value in interpreting such fossils as may be found on Mars, although some points of comparison could prove general. Given limited opportunities for exploration, proper choice of environmental analogy is critical. Spring precipitates constitute excellent deposits for addressing questions of biology on another planet.

NASA Discipline Exobiology↗

NASA NTRS2010

Predictor-Based Model Reference Adaptive Control

This paper is devoted to the design and analysis of a predictor-based model reference adaptive control. Stable adaptive laws are derived using Lyapunov framework. The proposed architecture is compared with the now classical model reference adaptive control. A simulation example is presented in which numerical evidence indicates that the proposed controller yields improved transient characteristics.

Lavretsky, Eugene↗

NASA NTRS2022

Combining Machine Learning and Numerical Simulation for High-Resolution PM2.5 Concentration Forecast

Forecasting ambient PM2.5 concentrations with spatiotemporal coverage is key to alerting decision-makers of pollution episodes and preventing detrimental public exposure, especially in regions with limited ground air monitoring stations. The existing methods either rely on chemical transport models (CTMs) to forecast spatial distribution of PM2.5 with nontrivial uncertainty or statistical algorithms to forecast PM2.5 concentration time-series at air monitoring locations without continuous spatial coverage. In this study, we developed a PM2.5 forecast framework by combining the robust Random Forest algorithm with a publicly accessible global CTM forecast product – NASA’s Goddard Earth Observing System “Composition Forecasting” (GEOS-CF), providing spatiotemporally continuous PM2.5 concentration forecasts for the next five days at a 1-km spatial resolution. Our forecast experiment was conducted for a region in Central China including the populous and polluted Fenwei Plain. The forecast for the next two days had overall validation R2 of 0.76 and 0.64, respectively; the R2 was around 0.5 for the following three forecast days. Spatial cross-validation showed similar validation metrics. Our forecast model, with validation normalized mean bias close to zero, substantially reduced the large biases in GEOS-CF. The proposed framework requires minimal computational resources compared to running CTMs at urban scales, enabling near-real-time PM2.5 forecast in resource-restricted environments.

PM2.5↗

NASA NTRS2022

A Generalized Approach to Aircraft Trajectory Prediction via Supervised Deep Learning

As research advances diverse forms and missions of aircraft, the National Airspace System (NAS) will become increasingly crowded, limiting current communications resources to accommodate aviation operations. Ongoing research proposes a paradigm of airspace communications, such that resources are autonomously and dynamically allocated via intelligent agents; this allocation requires accurate representations of the NAS, including the predicted positions of aircraft. State-of-the-art research emphasizes the importance of a hybrid-recurrent framework for trajectory prediction and compares the impact of commonly considered weather data on prediction accuracy. However, current research has been limited in its scope of efforts, frequently utilizing a unique flight route, architecture, set of weather data, and date range. This article considers the challenges of generalizing hybrid-recurrent predictive models for flight trajectories. Results illustrate an increase in error variance when identical models are trained over a generalized set of flights; this may be mitigated with careful tuning of hyperparameters, both in the network structure and optimization algorithms. Even so, an irreducible vertical error was identified, resulting from the complex takeoff and landing procedures which can not be correlated to functions of weather or additional assumptions of aircraft behavior. Finally, the use of a test route indicates that generalized models still do not possess sufficient knowledge for general aircraft predictions, with mean error increases ranging from 70-500%. These results illustrate the need for continued efforts on improving model versatility, as well as potential limitations for spectrum allocation near airports and other centers.

Nathan Schimpf↗

NASA NTRS2023

A Framework for Evaluating Distributed Electric Propulsion on the SUSAN Electrofan Aircraft

This work presents a framework for evaluating models and algorithms for Distributed Electric Propulsion (DEP) on the SUSAN Electrofan Aircraft. Throughout the development of the SUSAN aircraft, the performance of various configurations of the aircraft will need to be analyzed. However, the static behavior alone is not sufficient to describe the performance of these configurations. Therefore, simulation with fully integrated subsystem models is required. The proposed framework considers the vehicle aerodynamic, propulsion, and control subsystems. The presented framework automatically generates control laws for any vehicle configuration in response to changes in these subsystems. To compare these different vehicle configurations, various time and frequency domain performance metrics are compared. Three different system modifications are used as cases to evaluate this framework. The first modification integrates the propulsion control system with the flight controller to enable differential thrust without stalling the main engine. This evaluation case is used to validate the framework for aircraft configurations with coupled subsystems. The second modification compares the effect of the vertical tail size on open and closed loop performance. This evaluation case is used to validate the framework for controlling different configurations and tuning towards comparable closed loop performance despite changes to the aircraft's aerodynamic model. The third modification implements two different control allocation schemes. This evaluation case demonstrates the framework's ability to evaluate allocation modifications needed to take advantage of DEP. The first evaluation case is used to show that controller integration enables differential thrust, improving realized wingfan bandwidth by up to 40\% in simulation. The second evaluation case demonstrates that the framework can stabilize the reduced tail size aircraft with closed loop control. The third evaluation case demonstrates that a pseudoinverse control allocation scheme improves lateral velocity settling time by approximately 17~seconds over a symmetric-thrust allocation. These cases show that the framework is useful for evaluating the performance of integrated system designs, enabling analyses of new models and algorithms for the SUSAN distributed electric propulsion vehicle.

Nicholas C Ogden↗

NASA NTRSDate not supplied

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

NASA NTRSDate not supplied

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

NASA NTRS1995

Property-Based Software Engineering Measurement

Little theory exists in the field of software system measurement. Concepts such as complexity, coupling, cohesion or even size are very often subject to interpretation and appear to have inconsistent definitions in the literature. As a consequence, there is little guidance provided to the analyst attempting to define proper measures for specific problems. Many controversies in the literature are simply misunderstandings and stem from the fact that some people talk about different measurement concepts under the same label (complexity is the most common case). There is a need to define unambiguously the most important measurement concepts used in the measurement of software products. One way of doing so is to define precisely what mathematical properties characterize these concepts regardless of the specific software artifacts to which these concepts are applied. Such a mathematical framework could generate a consensus in the software engineering community and provide a means for better communication among researchers, better guidelines for analysis, and better evaluation methods for commercial static analyzers for practitioners. In this paper, we propose a mathematical framework which is generic, because it is not specific to any particular software artifact, and rigorous, because it is based on precise mathematical concepts. This framework defines several important measurement concepts (size, length, complexity, cohesion, coupling). It is not intended to be complete or fully objective; other frameworks could have been proposed and different choices could have been made. However, we believe that the formalism and properties we introduce are convenient and intuitive. In addition, we have reviewed the literature on this subject and compared it with our work. This framework contributes constructively to a firmer theoretical ground of software measurement.

Briand, Lionel↗

NASA NTRSDate not supplied

Application of Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations Using NASA's X-57 Maxwell

A framework to estimate the performance and associated uncertainty of modified configurations of certified aircraft is applied to the X-57 Maxwell aircraft. In previous theoretical studies, the framework was shown to predict performance and uncertainty bounds accurately. The X-57 Maxwell is an experimental aircraft designed to demonstrate the benefits of distributed electric propulsion through a series of four incremental modifications to a Tecnam P2006T aircraft. The available models and data are first shown to be within the application domain of the framework. We then apply the framework to two X-57 Maxwell modifications. We compare the estimated performance and associated uncertainties against the airworthiness criteria. The results indicate that the framework is a promising tool for the certification by analysis workflow. We expect the framework to reduce and supplement the flight testing required to show compliance to airworthiness certification criteria for a modified configuration.

Uncertainty Quantification↗