Results for “EVALUATION” — Page 22

NASA NTRS2022

Evaluation of High Mountain Asia-Land Data Assimilation System (version 1) from 2003 to 2016: 2. The impact of assimilating satellite-based snow cover and freeze/thaw observations into a land surface model

This second paper of the two-part series focuses on demonstrating the impact of assimilating satellite-based snow cover and freeze/thaw observations into the hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region from 2003 to 2016. To this end, this study systematically evaluates a total of six sets of 0.01° (∼1 km) model simulations forced by different precipitation forcings, with and without the dual assimilation scheme enabled, at point-scale, basin-scale, and domain-scale. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent (SWE), and total runoff. First, the point-scale assessment is mainly conducted via evaluating against ground-based measurements. In general, the assimilation enabled estimates are better than no-assimilation counterparts. Second, the basin-scale runoff assessment demonstrates that across three snow-dominated basins, the assimilation enabled experiment yields systematic improvements in all goodness-of-fit statistics through mitigating the negative effects brought by the fixed long-term precipitation correction factors. For example, when forced by the bias-corrected precipitation, the assimilation-enabled experiment improves the bias by 69%, the root-mean-squared error by 30%, and the unbiased root-mean-squared error by 18% (relative to the no-assimilation counterpart). Finally, the domain-scale assessment is conducted via evaluating against satellite-based SWE and skin temperature products. Both sets of domain-scale analysis further corroborate the findings in the point-scale evaluations. Overall, this study suggests the benefits of the proposed multi-variate assimilation system in improving the cryospheric-hydrological process within a land surface model for use in HMA.

Yuan Xue↗

NASA NTRSDate not supplied

Evaluation of Heat Transfer Coefficient from Velocity Distribution in Boundary Layer

This paper describes a method of evaluating heat transfer coefficient from a velocity distribution in the boundary layer. The power law velocity profile and universal velocity distribution in a smooth pipe have been used to evaluate the wall shear stress, and the heat transfer coefficient was evaluated from the wall shear stress using the Chilton-Colburn analogy. The predicted pressure drop was compared with the pressure drop computed by the Colebrook equation, and the predicted heat transfer coefficient was compared with the heat transfer coefficient calculated by the Dittus-Boelter equation. The accuracy of pressure drop prediction was within 1%, and the accuracy of heat transfer coefficient prediction was within 8%. This method has the potential to use a Navier-Stokes based CFD solution to evaluate the heat transfer coefficient in nodal or network flow codes.

Heat Transfer Coefficient↗

NASA NTRSDate not supplied

Evaluating Microgreens Crop Readiness for Space Production.

Microgreens are small-size, nutrient-rich, and fast-grown crops, which are considered as candidates for future space exploration missions. In particular, the ISS, the Lunar Gateway, and Mars and Lunar missions could benefit from growing microgreens to supplement astronaut diets in the near future. Research at NASA’s Kennedy Space Center has focused on (1) the selection of microgreens compatible species, (2) the evaluation of microgreens food safety, (3) the use of passive wicking, on-demand watering, and hydroponics cultivation, (4) simulated microgravity growth, (5) microgreen canopy gas exchange, and (6) harvesting techniques in microgravity. This presentation summarizes this research. Microgreen species will be evaluated for their yield in relationship to the quantity of inputs – water, seeds, substrate, light intensity, photoperiod, crew time – required for their growth; for their organoleptic and sensory factors in order to down select species that are highly acceptable for humans; and for their microbial loads as detected in their growth environment and the food safety metrics of their edible tissue. Passive wicking, on-demand watering, and hydroponic systems are being studied as an efficient way to deliver essential nutrients and water to microgreens, included in a microgravity environment. Growth studies in simulated microgravity (using 3-dimensional clinostats) will assess microgreens growth relative to that in 1g. Gas exchange studies on microgreens canopies in various airflows will assess their photosynthesis and transpiration. Finally, a series of parabolic flights has enabled the evaluation of different harvesting and bagging techniques in microgravity. Indeed, traditional plant harvesting methods (scissors) in microgravity could generate significant microgreen debris in the space station cabin. Two innovative techniques, coupled to a dedicated bagging method, were designed and evaluated against the control, traditional, harvesting technique. This research was supported by grants from NASA KSC’s Independent Research and Technology Development Program, NASA’s Flight Opportunity Program, NASA Postdoctoral Program Fellowships (L.P. & C.J.) supported by NASA’s Space Biology program, and support from NASA’s Human Research Program.

crop↗

NASA NTRSDate not supplied

Evaluation of Heat Transfer Coefficient from Velocity Distribution in Boundary Layer

This paper describes a method of evaluating heat transfer coefficient from a velocity distribution in the boundary layer. The power law velocity profile and universal velocity distribution in a smooth pipe have been used to evaluate the wall shear stress, and the heat transfer coefficient was evaluated from the wall shear stress using the Chilton-Colburn analogy. The predicted pressure drop was compared with the pressure drop computed by the Colebrook equation, and the predicted heat transfer coefficient was compared with the heat transfer coefficient calculated by the Dittus-Boelter equation. The accuracy of pressure drop prediction was within 1%, and the accuracy of heat transfer coefficient prediction was within 8%. This method has the potential to use a Navier-Stokes based CFD solution to evaluate the heat transfer coefficient in nodal or network flow codes.

Heat Transfer Coefficient↗

NASA NTRSDate not supplied

Evaluation of Novel eVTOL Aircraft Automation Concepts

As new electric propulsion technologies have matured, many new electric propulsion Vertical Takeoff and Landing (eVTOL) aircraft concepts have been proposed. These new aircraft concepts enable the creation of new aviation markets including Urban Air Mobility (UAM) but also pose new challenges in safety assurance. One early challenge is the evaluation of the diverse aircraft configurations and accompanying advanced control systems and automation designed to aid controllability. This paper describes a research activity to propose candidate means of evaluation for the aircraft concepts and automation in the context of UAM operations. The research activity proposes the adaptation of an evaluation design standard used by the military for advanced rotorcraft along with proposed descriptions and definitions to support evaluation of diverse automated concepts in the civilian eVTOL community.

AAM↗

NASA NTRSDate not supplied

101 Surveys in 28 Days - Evaluating Response Rates to a Demanding Request

We report the results of a survey test conducted in advance of a series of community response tests (CRTs) to evaluate response to noise from NASA’s X-59 aircraft. The CRTs will require a substantial number of observations to generate a dose response curve and the timeframe is limited due to resource and scheduling constraints with an experimental aircraft. Within each CRT area, we will recruit a sample of residents in advance and ask them to fill out a brief survey each time the aircraft passes over. Respondents will be asked to fill out the survey either on the web or as part of an application they are able to download onto their mobile phones. On many days, respondents will be asked to fill out the survey for multiple passes. The survey test followed the proposed methodology of the CRTs, albeit gauging reactions to normal in-situ aircraft events. To demonstrate initial interest, we will present response rates to the recruitment portion of the survey test which used an ABS frame. We will then evaluate the ongoing response rates among the recruited population to a demanding survey schedule involving 101 surveys over a 28-day period. The response rate evaluation will focus on demographics, mode (app vs. web) and whether and how these change over time. We will use the results of this work to confirm or improve the design of the CRTs, ensuring the collection of data needed by NASA to evaluate the impact of this innovative technology.

response rates↗

NASA NTRSDate not supplied

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗

NASA NTRS2024

High Spectral Resolution Lidar – Generation 2 (HSRL-2) Retrievals of Ocean Surface Wind Speed: Methodology and Evaluation

Ocean surface wind speed (i.e., wind speed 10 m above sea level) is a critical parameter used by atmospheric models to estimate the state of the marine atmospheric boundary layer (MABL). Accurate surface wind speed measurements in diverse locations are required to improve characterization of MABL dynamics and assess how models simulate large-scale phenomena related to climate change and global weather patterns. To provide these measurements, this study introduces and evaluates a new surface wind speed data product from the NASA Langley Research Center nadir-viewing High Spectral Resolution Lidar – generation 2 (HSRL-2) using data collected as part of the NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) mission. The HSRL-2 can directly measure vertically resolved aerosol backscatter and extinction profiles without additional constraints or assumptions, enabling the instrument to accurately derive atmospheric attenuation and directly determine surface reflectance (i.e., surface backscatter). Also, the high horizontal spatial resolution of the HSRL-2 retrievals (0.5 s or ∼ 75 m along track) allows the instrument to probe the fine-scale spatial variability in surface wind speeds over time along the flight track and over breaks in broken cloud fields. A rigorous evaluation of these retrievals is performed by comparing coincident HSRL-2 and National Center for Atmospheric Research (NCAR) Airborne Vertical Atmosphere Profiling System (AVAPS) dropsonde data, owing to the joint deployment of these two instruments on the ACTIVATE King Air aircraft. These comparisons show correlations of 0.89, slopes of 1.04 and 1.17, and y intercepts of −0.13 and −1.05 m s−1 for linear and bisector regressions, respectively, and the overall accuracy is calculated to be 0.15 ± 1.80 m s−1. It is also shown that the dropsonde surface wind speed data most closely follow the HSRL-2 distribution of wave slope variance using the distribution proposed by Hu et al. (2008) rather than the ones proposed by Cox and Munk (1954) and Wu (1990) for surface wind speeds below 7 m s−1, with this category comprising most of the ACTIVATE data set. The retrievals are then evaluated separately for surface wind speeds below 7 m s−1 and between 7 and 13.3 m s−1 and show that the HSRL-2 retrieves surface wind speeds with a bias of ∼ 0.5 m s−1 and an error of ∼ 1.5 m s−1, a finding not apparent in the cumulative comparisons. Also, it is shown that the HSRL-2 retrievals are more accurate in the summer (−0.18 ± 1.52 m s−1) than in the winter (0.63 ± 2.07 m s−1), but the HSRL-2 is still able to make numerous (N=236) accurate retrievals in the winter. Overall, this study highlights the abilities and assesses the performance of the HSRL-2 surface wind speed retrievals, and it is hoped that further evaluation of these retrievals will be performed using other airborne and satellite data sets.

Sanja Dmitrovic↗

NASA NTRS2024

Determining Simulation Fidelity Necessary for Evaluating Onboard Vehicle Capabilities and Crew Roles on Long Duration Exploration Missions Beyond Low-Earth Orbit

Identification of onboard vehicle capabilities and crew roles and responsibilities necessary for achieving effective human-systems collaboration will require iterative cycles of concept development and empirical evaluation of human performance in complex operations. This report presents the results of an effort to lay the groundwork for determining the level of fidelity of simulated environments most suitable for validating concepts and evaluating implementations of a new Human Systems Integration Architecture (HSIA) that will support the flight crew on long duration exploration missions beyond low-Earth orbit. To do that, we conducted a literature review on simulation fidelity and surveyed simulation capabilities inside and outside of NASA used in NASA-sponsored research. We also analyzed two International Space Station (ISS) vehicle anomalies to identify the types of scenario events and crew activities that may need to be simulated. Our survey findings reveal that most NASA simulation facilities are designed to achieve high physical fidelity while HSIA risk mitigation requires simulation emphasizing task and functional fidelity aspects. A trade analysis shows that, for standard and requirement development, evaluation conducted using synthetic task environments with inexperienced participants will support testing a wide variety of conditions and yield findings robust enough to be generalized to a wide variety of designs on which developed standards and requirements might be levied while allowing human performance standard measures to be collected using consistent methods across tasks and conditions. For technology/tool development, because findings will only need to be generalized to the actual target environment in which the technology/tool will be used, it is more suitable to evaluate the prototypes in a scaled world that preserves functional relationships present in the actual target environment with intended user populations. To wrap up, we give an overview of a well-known synthetical task environment in the space domain and discuss what it takes to construct a synthetic task environment.

simulation fidelity↗

NASA NTRSDate not supplied

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗

NASA NTRSDate not supplied

Evaluation of Long-Term Storage Stability and Operational Efficiency of Rapid Cycle Amine Adsorbents

With the recent incorporation of Mars Extravehicular Activity (EVA) into the 2025 NASA roadmap, Rapid Cycle Amine (RCA) technology advancement within the Exploration Extravehicular Mobility Unit (xEMU) applies to both the upcoming Lunar Artemis missions and future human exploration of Mars. The incorporation of commercial spacesuit vendors to service NASA’s crewed-space programs since 2021 has increased the demand for regenerable, RCA-based carbon dioxide (CO2) and humidity control adsorbents. The regenerable RCA subunit is the most advanced, long-term solution for CO2 removal and humidity control, enabling both lunar and Martian EVAs. The adsorbent selected for use within the RCA unit must exhibit sufficient storage stability and operational efficiency for prolonged missions. As XploSafe worked to simultaneously develop both a recirculating sub-atmospheric test rig and adsorbents for the RCA system within the xEMU, several novel adsorbents were evaluated for long-term storage stability in support of future extended-duration missions. The chosen materials were periodically evaluated by nuclear magnetic resonance (NMR) spectroscopy, thermal desorption-coupled with gas chromatography/mass spectrometry (TD-GC/MS), and CO2 adsorption to assess long-term storage efficacy across various environmental storage conditions. NMR spectroscopy was utilized by extracting the active CO2 adsorbing chemical from the solid support with deuterated solvent and comparing the spectra over time for degradation and change. The solid adsorbents were also analyzed via TD-GC/MS to reveal any potential off-gassing chemicals over time. Additionally, XploSafe’s breakthrough test rig was utilized to dose the solid adsorbents with a 585 BTU/h metabolic rate flow-equivalent CO2 stream and monitored for 0–99% CO2 breakthrough. The performance metrics from the breakthrough analysis were compared over the storage study duration for CO2 removal and humidity control. Xplo-SA9T was evaluated for 24 months, whereas two additional adsorbent variants, MMPA-Sorbent and LPEI-Sorbent, were each evaluated for 12 months.

John R Tidwell↗

NASA NTRS2006

Chemical Kinetics and Photochemical Data for Use in Atmospheric Studies Evaluation Number 15

This is the fifteenth in a series of evaluated sets of rate constants and photochemical cross sections compiled by the NASA Panel for Data Evaluation. The data are used primarily to model stratospheric and upper tropospheric processes, with particular emphasis on the ozone layer and its possible perturbation by anthropogenic and natural phenomena. Copies of this evaluation are available in electronic form and may be printed from the following Internet URL: http://jpldataeval.jpl.nasa.gov/.

data evaluation↗

NASA NTRS2016

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗

NASA NTRS2019

Evaluation of Matthews-WLR-CH4: A New Wetland, Lake, and Reservoir Methane Emissions Data Set

Methane (CH4) is emitted from a variety of sources, both natural and anthropogenic, and is the second most important greenhouse gas contributing to climate change. Natural wetlands are the largest single contributor to annual global CH4 emissions and other inland water sources, such as lakes and reservoirs, produce CH4 but have received less attention. These emission sources are among the most uncertain components of the global CH4 cycle. These uncertainties stem from numerous issues, including the vast variability in these ecosystems and the sensitivity of CH4 emissions to interannual climate variations. Existing CH4 emission models display large differences in wetland spatial extent and include simplified, or lack all together, wetland-type classifications. Furthermore, CH4 emissions from lakes and reservoirs are typically combined with wetlands, or ignored, on a regional and global scale. Our NASA Interdisciplinary Research in Earth Science (IDS) study is focused on developing a suite of data sets on wetlands, lakes, and reservoirs (WLR) including global distributions of types, CH4-centric classifications, and daily CH4 emission rates (hereafter Matthews-WLR-CH4). This project is unique in that it comprises source-independent emission data for WLR, the first spatially-explicit data set of lake and reservoir CH4 emissions, and wetland emissions comprising numerous different wetland-type classifications.The focus of this study is to perform the initial evaluation of the wetland and lake CH4 emissions data from Matthews-WLR-CH4. This evaluation will focus on the domain of North America and include: 1) estimates of the contribution of wetland and lake sources to total CH4 emissions and atmospheric mixing ratios, 2) comparisons of wetland fraction and CH4 emissions to a suite of existing models (e.g., Wetland and Wetland CH4 Inter-comparison of Models Project (WETCHIMP), Global Carbon Project (GCP)), and 3) an accuracy assessment with in situ airborne and tower-based atmospheric CH4 observations when the Matthews-WLR-CH4 emissions are implemented in forward and inverse CarbonTracker-Lagrange (CT-L) CH4 model simulations. Here we will present the new Matthews-WLR-CH4 wetland and lake CH4 emissions data, the initial evaluation of these products, and the path forward for our project.

Reservoir↗

NASA NTRS2020

Evaluation Issues for a Flight Deck Interface; CAST SE-210 Output 2: Report 4 of 6

This report is part of a series of reports that addresses flight deck design and evaluation, written as a response to loss of control accidents. In particular, this activity is directed at failures in airplane state awareness, in which the pilot loses awareness of the airplane’s energy state or attitude and enters an upset condition. Another report in this series of reports speaks directly to flight deck evaluation methods and metrics for the types of attention and awareness issues that were revealed from the airplane state awareness events. In this report, we describe a wide range of flight deck evaluation issues tied to flight crew performance. The objectives are to establish a framework for thinking about how the flight deck interface should support the performance of the flight crew, and to aid the Federal Aviation Administration (FAA) in identifying relevant human performance issues during the evaluation/certification process. Issues are broken out into sections that cover physical ergonomics, design for usability, data integration and display content, attention and task management, flight crew problem solving, and flight crew teaming. For each issue, we recommend specific ways that the flight deck interface should support the flight crew. For each, we also identify existing 14 CFR Part 25 rules and guidance that are relevant to the issue. This allows the FAA to determine what current regulatory materials can support them in raising the issue with the applicant.

commercial aviation↗

NASA NTRSDate not supplied

Shadow Evaluation of the ATD-2 Phase 3Trajectory Option Set Reroute Capability in the North Texas Metroplex

This paper presents results of NASA’s Airspace Technology Demonstration 2 Phase 3 Trajectory Option Set reroute capability designed to resolve a demand capacity imbalance along the terminal airspace boundary. We focus on Candidate flights generated during the Stormy 2020 Shadow Evaluation which was the result of using the system to passively collect predictions for each flight at the OUT event. Benefit metrics associated with the predictions are defined for the individual rerouted flight and also the system-wide savings. Candidate flights are grouped into three distinct use cases and the benefit mechanism is explained for each use case along with illustrative data. Analysis of the different use cases shed light on the underlying causes of the reroute opportunities. Lessons learned from the Stormy 2020 Shadow Evaluation including the importance of reroutes during recovery from Severe Weather Avoidance Programs and also reroutes in the absence of terminal airspace constraints will be incorporated into the Phase 3 Field Evaluation in 2021 to maximize reroute opportunities.

Airspace Technology Demonstration 2↗

NASA NTRS2022

ATD-2 Field Evaluation of Pre-Departure Trajectory Option Set Reroutes in North Texas Metroplex

The NASA Airspace Technology Demonstration-2 Phase 3 capabilities extend Integrated Arrival, Departure and Surface scheduling to a Metroplex environment where multiple airports are interacting and sharing resources along the terminal boundary. The Phase 3 coordinated scheduling provides pre-departure reroute recommendations to ﬂight operators which reduce delay caused by terminal restrictions. This paper reports results of the Phase 3 Stormy 2021 Field Evaluation conducted between November 2020 and September 2021 in the North Texas Metroplex. During the ﬁeld evaluation NASA partnered with the FAA, American Airlines, Southwest Airlines, and Envoy Airlines to evaluate Phase 3 capabilities in an operational environment. The beneﬁts results are provided as delay savings metrics measured in time and converted to fuel and emissions savings using detailed fuel ﬂow models provided by ﬂight operators.

ATD-2 Field Evaluation, Trajectory Option Set, Pre↗

NASA NTRSDate not supplied

ATD-2 Field Evaluation of Pre-Departure Trajectory Option Set Reroutes in North Texas Metroplex

The NASA Airspace Technology Demonstration-2 Phase 3 capabilities extend Integrated Arrival, Departure and Surface scheduling to a Metroplex environment where multiple airports are interacting and sharing resources along the terminal boundary. The Phase 3 coordinated scheduling provides pre-departure reroute recommendations to ﬂight operators which reduce delay caused by terminal restrictions. This paper reports results of the Phase 3 Stormy 2021 Field Evaluation conducted between November 2020 and September 2021 in the North Texas Metroplex. During the ﬁeld evaluation NASA partnered with the FAA, American Airlines, Southwest Airlines, and Envoy Airlines to evaluate Phase 3 capabilities in an operational environment. The beneﬁts results are provided as delay savings metrics measured in time and converted to fuel and emissions savings using detailed fuel ﬂow models provided by ﬂight operators.

ATD-2↗