Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “thunderstorm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Lightning Enriched Global Precipitation Feature Database

The Tropical Rainfall Measurement Mission (TRMM) has provided a wealth of insight about lightning and precipitation in the tropics. However TRMM did not provide coverage outside the tropics and sub-tropics (i.e., beyond ±38°latitude), and hence it was unable to sample the lightning activity and precipitation features over a large fraction of mid-latitude continents and oceans, including extratropical cyclone storm tracks. The Global Precipitation Measurement (GPM) mission picks up where TRMM left off in that it provides information on precipitation features in the mid-and high latitudes (up to 65°N/S). However, GPM lacks a lightning instrument that can provide additional insights into mid-latitude thunderstorm activity and distribution. Hence we integrate observations from coincident the ISS Lightning Imaging Sensor (LIS) and the World Wide Lightning Location Network (WWLLN) observations with measurements from the GPM constellation of satellites, in particular to extend the existing GPM Precipitation Feature (PF) database so its data parameters are similar to that of the TRMM PF database (i.e., precipitation + lighting). Currently, WWLLN and ISS-LIS lightning have been collocated into precipitation features defined from GPM core satellite and constellation satellites observations.

Precipitation↗

Lightning Strike Distance Distribution Beyond a Preexisting Lightning Area

The 45th Weather Squadron (45 WS) asked the Applied Meteorology Unit (AMU) to review the 30-year-old, lightning stand-off distances of 5 nautical miles (nmi) for applicability to today's operations. This was based on the realization that previous lightning strike distance studies did not match how 45 WS issues lightning warnings (Roeder, 2008). The previous lightning distance studies were from the point of origin of the lightning or the average starting location that would tend to be in the core of the thunderstorm. However, the 45 WS issues lightning warnings based on the edge of a preexisting lightning area. Before beginning the AMU project, it took several years to develop a method to calculate a distance distribution beyond a preexisting area (Roeder, 2015). The AMU pulled Lightning Detection and Ranging (LDAR) sensor data from 1/1/2013 to 12/31/2013. This dataset consisted of 37 million individual source data points from the LDAR sensors. Only sources within 50 km north, south, east or west of the LDAR grid center were included in the dataset. This limited the use of LDAR data to that with the greatest accuracy of source detection and increased data processing. Points were grouped into flashes based on spatial and temporal criteria. Based on the sensitivity analysis the AMU performed on the flash clustering algorithm, a time value of 0.3 seconds was found to model flashes adequately. Distance parameters were tested from 1,500 to 7,500 meters (m) in 500 m increments. Distance parameters of both 3,000 m and 4,000 m produced results in the plotting tool that were most representative of the physical behavior of lightning. Thus statistics were gathered for the most representative of these spatial and temporal criteria on the flash size and the polygon expansion distance in order to find the correct data distributions. The best fit curves for the LDAR polygon expansion frequency vs. distances for both the 3 kilometer (km) and 4 km distance threshold values were exponential decay functions and had R2 values of > 0.998, indicating good model fits. The equations of the best fit curves were then used to calculate a desired safety radius of 4 nmi for either 3 km or 4 km distance threshold criteria. The AMU analysis concludes the safe reduction of the 5 nmi lightning warning circles to 4 nmi should improve the operational impact by 36% if based on distance from the center of the property area being protected. If based on the edge of the property being protected, then the reduction is 4.5 nmi to 4 nmi and the operational impact is decreased by 21%. For the 6 nmi lightning warning circles, the recommended 4 nmi stand-off distance will result in a safe reduction of operational impact of 31% if based on the center of the area being protected, or 16% if based on the edge of the property.

Flash clustering algorithm↗

Monitoring Extreme Weather in the Hindu Kush Himalaya Region

Why is monitoring extreme weather events important? The HKH (Hindu Kush Himalaya region experiences many extreme weather events, such as thunderstorms, especially during monsoon season. These events can cause economic hardship and loss of life. Monitoring Extreme Weather in the HKH Region is a service in development through SERVIR-Hindu Kush Himalaya that aims to develop a customized numerical weather prediction toolkit to assess these high impact events in this relatively data-sparse region. The High Impact Weather Assessment Toolkit (HIWAT) consists of an ensemble Weather Research and Forecasting (WRF)model, threat assessments based on the Global Precipitation Measurement (GPM) missions, and impact assessments based on Landsat and the Moderate Resolution Imaging Spectroradiometer (MODIS) imagery. In spring 2019, we began validation of forecasted precipitation using station data in Bangladesh and Climate Hazards Group InfraRed with Station data (CHIRPS).

Remote Sensing↗

Synthetic Aperture Radar and Optical Remote Sensing of Crop Damage Attributed to Severe Weather in the Central United States

Damaging hail and wind from severe thunderstorms threatens agricultural areas annually, especially across the central United States where agriculture is prevalent. On average, these storms produce $160 to $580 million worth of damage in the US every year and contribute significantly to food prices, crop insurance, and agricultural related stocks. However, hail damage is not regularly ground-surveyed like tornadoes. Optical (visible, NIR (Near Infra-Red), and SWIR (Short-Wave Infra-Red) remote sensing techniques have been shown to successfully identify and monitor hail damage swaths. Techniques of identification and monitoring hail damage swaths from synthetic aperture radar (SAR) are currently unexplored. We hypothesize that hail-damaged cropland will exhibit lower power return than surrounding healthy vegetation due to changes in the geometry of the targets. Further analysis is needed to determine a threshold for future automated monitoring of hail damage swaths.

Bell, Jordan↗

Investigating Meteorological Conditions Associated with Valley Fever Outbreaks in Southwestern United States

According to CDC, a sharp increase in reported Valley fever cases (Coccidioidomycosis) has been found between 2009 and 2012. Environmental conditions play an important role for Valley fever outbreaks. For example, dust storms can significantly increase the amount of the fungus Coccidioides in the air and associated strong winds can transport the fungus to other areas. In last year’s AGU session, we reported a preliminary study to investigate hydrometeorological conditions and their connection with dust storm activities in southwestern United States. We found wind is a major contributing factor for the seasonal variation of dust storm activities. Interannual variation of the regional hydrometeorological conditions are closely linked to the large-scale environment such as the Pacific Decadal Oscillation (PDO). Strong winds are linked with a number of weather events such cold front passages, thunderstorms that produce downbursts and strong winds, the Santa Ana winds, etc. In this presentation, we will report the results of our latest investigation on meteorological conditions associated with Valley fever outbreaks in southwestern United States, using NLDAS (North American Land Data Assimilation System), GPM (Global Precipitation Measurement), and MERRA-2 (Modern Era Retrospective-analysis for Research and Applications, Version 2) hourly datasets, from the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC).

Liu, Zhong↗

History of the American Geophysical Union Atmospheric and Space Electricity Section

Atmospheric and Space Electricity (ASE) has been a part of the American Geophysical Union (AGU) since its initial founding and organization in 1919. John Fleming, who invented the vacuum tube, was the first Secretary of the AGU Terrestrial Magnetism and Atmospheric Electricity Section, and today has an AGU medal named after him. ASE played an important role in the post-World War II era of AGU, as a locus for scientific discussions regarding major ASE-related events, such as the Thunderstorm Project (1946–1949) and the 1969 Apollo 12 lightning incident. By the 1970s and 1980s, the ASE community was represented by the Committee on ASE (CASE) within the Atmospheric Sciences Section. CASE was able to bridge the gap between the fields of aeronomy and atmospheric science by sponsoring its own sessions and nominating AGU Fellow awardees. ASE business meetings at the AGU Fall and Spring Meetings lasted for hours, with anyone from the community presenting scientific ideas, field campaigns, and more - practically turning the business meeting into an ad hoc AGU session!

Lang, Timothy↗

A SATELLITE AGNOSTIC APPROACH TO QUANTIFYING HAIL DAMAGE SWATHS ACROSS THE CENTRAL UNITED STATES AND OTHER AGRICULTURAL REGIONS

Intense thunderstorms can bring damaging winds and large hail to agricultural regions during the prime growing season. In certain cases, large swaths of damage from the wind and hail are left behind and visible to satellite remote sensing instruments. Often times, Earth observing optical remote sensing from low to high spatial resolutions are able to view these damaged swaths. With the large number of moderate to high-resolution instruments in orbit, these damaged areas have potential to be viewed daily. However, during the prime growing season, clouds frequently block the viewing of the land surface by these optical instruments. Space-borne synthetic aperture radar (SAR) instruments allow for the viewing of the land surface in most weather conditions, but instead measure backscatter as opposed to optical sensors measuring reflected or emitted radiation. Additionally, the number of SAR instruments with free and open data lags behind the number of optical sensors. This paper describes the development of a methodology that attempts to characterize hail damaged swaths, through independent use of multiple optical and SAR platforms. This satellite-agnostic approach will focus statistical analysis by comparing undamaged areas to suspected damaged areas by using commonly derived indices from optical instruments and SAR backscatter from multiple polarizations.

Jordan R Bell↗

Key Observations and Discoveries from the Vector Electric Field Investigation on the C/NOFS Satellite

Launched in 2008 and operating for 7.5 years, the Air Force Communication /Navigation Outage Forecasting System (C/NOFS) satellite included the Vector Electric Field Investigation (VEFI) designed and built at NASA’s Goddard Space Flight Center. VEFI successfully met its objectives: 1) investigate the role of ambient electric fields in initiating nighttime density depletions and turbulence; 2) determine the quasi-DC electric fields associated with abrupt density depletions, and 3) quantify the spectrum of the irregularities associated with density depletions, providing many key observations and discoveries including: -- Global (low latitude) vector DC electric fields at 16 s/sec revealing variations with local time, longitude, and season between extremely low and moderate solar activity-- Reversed zonal E x B drifts below the F-region ledge at sunset and simultaneous observations of large scale Kelvin-Helmholtz instabilities as seeds of spread-F -- Large expanses of quasi-coherent kilometer-scale vector wave observations (electric field and density) below 450 km and their discovery as a source of scintillations using the C/NOFS GPS -- Reversed zonal DC electric fields and simultaneous observations of afternoon counter electrojet-- Enhanced zonal DC electric fields at sunrise and full vector plasma flow continuity at the terminator-- Vector electric field and density irregularities extending to meter-scales within equatorial plasma depletions -- Intense electric field structure within the equatorial ionosphere at night in the absence of density depletions -- First observations of the westward equatorial electrojet in post-midnight ionosphere and possible association with downward meridional drifts-- Spaceborne Dst observations and implications for ring current asymmetries-- Vector electric and magnetic field Poynting flux within depletions and TIDs-- Measurements of ionospheric reflectance and Alfvenic waves associated with TIDs-- Observations of Alfven resonators -- ULF magnetic field structure within the nightime equatorial ionosphere-- Discovery of Schumman resonances in space and implications of ELF radiowave propagation-- Vector observations of 50-60 Hz powerline radiation without harmonics-- Ion cyclotron resonance absorption lines associated with ELF hiss and the identification of ambient ions-- Parallel electric fields associated with lower hybrid waves driven by thunderstorm lightning-related sferics-- Discovery of Z-mode radiation in the equatorial ionosphere including its associated with density depletions-- Optical lightning detector waveforms and electric field sferics observed up to altitudes of 800 km

Robert F Pfaff↗

A Terrestrial Gamma-ray Flash from the 2022 Hunga Tonga–Hunga Ha’apai Volcanic Eruption

The Hunga Tonga–Hunga Ha’apai submarine volcano recently resumed activity. Violent eruptions on 2022 January 14th and 15th launched a tall ash plume that produced extremely high lightning rates. Here we report a terrestrial gamma-ray flash (TGF) that was produced by the volcanic lightning and observed from space by the Fermi Gamma-ray Burst Monitor (GBM). Observations by radio lightning networks and especially by the Geostationary Lightning Mapper (GLM) show that the only lightning close enough to produce a TGF detectable by Fermi GBM was from the volcano’s plume. With the observing duration of Fermi, observing a single TGF is consistent with the hypothesis that the volcanic lightning of this eruption produced TGFs at the average rate of thunderstorm lightning. The observation of a strong TGF from space also indicates that the electric field was oriented so as to accelerate electrons upward.

Terrestrial gamma-ray flashes↗

Modeling Methods for 3D Lightning Mapping from Space

Global lightning detection has advanced greatly over the past few decades both on ground and from orbit. Ground-based systems like the Lightning Mapping Array (LMA) excel at high-precision 3D reconstruction of local flashes, while spaceborne lightning sensors have much larger potential coverage but have been limited by coarser resolution and often rely on data from other instruments to determine flash location. The primary focus of this study is to examine the level of flash detail that can be expected from one or more low-Earth orbiting small satellites that combine VHF and optical measurements of lightning, which is a new mission concept called CubeSpark. The goal of CubeSpark is to map the 3D charge structure of thunderstorms at 1-2 km spatial resolution on a global scale, enabling a host of new atmospheric and space electricity studies. In order to maximize the potential data quality and minimize potential cost, flashes were simulated beneath single- and multi-satellite configurations. In the multi-satellite approach, RF detectors on each of the six satellites would measure the arrival times of impulsive VHF sources to collectively pinpoint their locations in 3D and reconstruct flashes with higher resolution than has been achieved from space. A single-station approach for 3D observation of lightning would follow the method of determining altitudes of strong VHF sources that produce trans-ionospheric pulse pairs (TIPPs) while relying on an on-board high-resolution optical day/night lightning mapper for approximate horizontal flash locations. Here we present preliminary results comparing the expected data fidelity and accuracy between these methods to inform potential satellite missions like CubeSpark.

lightning↗

Modeling Methods for 3D Lightning Mapping from Space

Global lightning detection has advanced greatly over the past few decades both on ground and from orbit. Ground-based systems like the Lightning Mapping Array (LMA) excel at high-precision 3D reconstruction of local flashes, while spaceborne lightning sensors have much larger potential coverage but are limited by coarser resolution and often rely on data from other instruments to determine 3D flash locations. CubeSpark is a new mission concept focused on combining these two methods in the form of six small satellites in low-Earth orbit. CubeSpark will combine RF and bispectral optical measurements of lightning in order to map the 3D structure of both individual flashes and their parent thunderstorms at 1-2 km spatial resolution on a global scale, enabling a host of new atmospheric, climate, and space electricity studies. The goal of this study is to assess the feasibility and expected resolution of lightning mapping via indivudal VHF sources using different methods and detector combinations. Flashes were simulated beneath orbital configurations consisting of 1-6 satellites, taking into account the complicated interactions with Earth's ionosphere. In the multi-satellite (>5) approach, RF detectors on each satellite measure the arrival times of impulsive VHF sources to collectively pinpoint their locations in 3D and reconstruct flashes with higher resolution than has been achieved from space. The same can process can be performed with 3-4 satellites by constraining sources' horizontal locations with onboard optical imagers. A 1-2 station approach follows the established method of determining the height of an RF source using the arrival time difference between direct RF waves and their reflections off the Earth's surface. Here we present preliminary results of the expected accuracy of these methods to inform potential satellite missions like CubeSpark.

Lightning↗

The ALOFT Campaign: Why and how we did it

ALOFT is a collaborative field campaign that used the NASA ER-2 in July 2023 to hunt for gamma-rays and lightning in tropical thunderstorms

Timothy Lang↗

Leveraging the Multiplatform Precipitation Feature Database of Combined Ground Radar and Satellite Lightning Observations for Convective Studies

The Multiplatform Precipitation Feature (MPF) database combines coincident observations of lightning from space with satellite- and ground-based radar data in a storm-based, feature-defined framework. The concept for the MPF database stems from the motivation to extend the scale and scope of investigations into the complex connections between ice precipitation, updrafts, and lightning in thunderstorms. The earliest iteration of the MPF database incorporates NASA International Space Station Lightning Imaging Sensor (ISS LIS) observations alongside the NASA Global Precipitation Measurement (GPM) Mission Dual-frequency Precipitation Radar (DPR) and Validation Network (VN). Because of the specific role of the GPM VN in forming the first MPFs, this subset is referred to as the VNMPF database. The synthesis of these multi-scale and multi-resolution observations leveraged each platform’s unique insights into convective properties and processes, offering a more complete view of deep convection over the large viewing area afforded by satellite coverage. The VNMPF database established the feasibility and infrastructure to combine microphysical, kinematic, and lightning observations from multiple satellite- and ground-based platforms. Following this successful proof-of-concept, recent progress has expanded the MPF database to make use of coincident ISS LIS lightning observations and data from the operational Weather Surveillance Radar - 1988 Doppler (WSR-88D) network, where individual WSR-88D proximity facilitates vertical wind retrievals via dual-Doppler analysis. These database changes have expanded the scope of the dataset by removing the requirement for coincident GPM and ISS LIS overpasses. This increases the sample size dramatically and facilitates analysis of higher-resolution radar-derived properties. These advancements allow both storm-scale and unprecedented broad statistical analyses of deep convection from electrical, kinematic, and microphysical perspectives over the contiguous United States. This presentation outlines the construction of the new MPF database and introduces some preliminary analyses of the convection captured within it. Early results summarize relationships based on updraft characteristics ascertained from WSR-88D dual-Doppler three-dimensional wind retrievals, properties of ice microphysics gleaned from dual-polarization analyses, and electrical characteristics observed by the ISS LIS. The expanded scale and scope offered by more than five years of ISS LIS observations enable new insights into regional and seasonal variations in the microphysical, kinematic, and electrical relationships of convection. Analysis of the database highlights the potential for advancements in lightning meteorology made possible by combining large-scale spaceborne lightning detection and proven storm interrogation tools such as operational polarimetric Doppler radar.

Lightning↗

StratoFIRE: Modeling Wildfire Smoke in the Stratosphere

The most extreme manifestation of a fire–weather interaction is the formation of pyrocumulonimbus (pyroCb) thunderstorms, triggered by super-heated updrafts, which can eject smoke at altitudes exceeding 20 Km. In this study, we investigated climate-related impacts from the most intensive pyroCb-triggered injection of smoke in the stratosphere: the Australian New Year wildfires in 2019/2020. We first provide a general overview of the vision and objectives of the StratoFIRE project. With the aid of the global chemistry-climate model EMAC, we then simulate radiative and chemical perturbations in the stratosphere in relation to 0.9 Tg smoke in the stratosphere assuming different injection heights, from 13 to 16 Km. The simulation of stratospheric optical depth perturbations were found to be sensitive to the assumed injection height, with a maximum height at 16 Km showing the best agreement with the GLOSSAC and SAGE-ISS aerosol extinction observations.

PyroCb↗

Dynamical Considerations of Hypothesized Vertically Stacked Meridional Circulation Cells in the Ice Giant Atmospheres

This study examines the dynamical implications of the vertically stacked meridional circulation structure hypothesized for the atmospheres of Uranus and Neptune. The existence of vertically stacked circulation cells was first hypothesized for Jupiter to explain the puzzling observation during Voyager and Galileo missions that Jupiter’s thunderstorms tend to erupt in regions where the atmosphere is expected to have enhanced static stability rather than reduced static stability. Since then, Juno has added a wealth of data, including the deep ammonia distribution, to add further context to this hypothesis. For the Ice Giant planets, a similar hypothesis for vertically stacked circulation was proposed to explain the meridional distribution of methane in the upper troposphere near the 1-bar level, and further hypothesized that Uranus and Neptune may harbor three layers of cells at depth driven by condensations of methane for the top cell, hydrogen sulfide-methane mixture for the middle cell, and ammonia-hydrogen sulfide-methane mixture for the lowest cell. This study examines the dynamical implications of the existence of such vertically stacked cells. Specifically, using the Eulerian Mean framework in the beta-plane, we derive the constraints for the eddy momentum flux, diabatic heating (i.e. latent heat), and eddy heat flux required to balance the vertically stacked circulation. Using these constraints, observable effects will be identified to guide future observations by the upcoming missions to Uranus and Neptune that may test the hypothesized vertically stacked circulation.

Kunio M Sayanagi↗

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗

Overview of Lightning Science at NASA Marshall Space Flight Center

NASA Marshall Space Flight Center (MSFC) is a recognized world leader in the science of lightning. To date, MSFC has led three space-based global lightning observing missions and has helped lead multiple suborbital field campaigns involving lightning observations. Recently, the MSFC Lightning Team is closing out the recently completed International Space Station Lightning Imaging Sensor (ISS LIS) mission, including developing a nearly three-decade global climatology of lightning from space. This work also includes integrating lightning observations with data from NASA precipitation missions. The Team is also busy analyzing data from a recent airborne field campaign that observed dozens of terrestrial gamma-ray flashes (TGFs) from intense tropical thunderstorms. Lightning Team members are also leaders in validation of the Geostationary Lightning Mapper (GLM) operated by NOAA, and in developing lightning safety applications and studying the relationship between lightning and wildfires. The Lightning Team also studies chemical production by lightning and contributes to the National Climate Assessment (NCA). Finally, the Lightning Team is busy developing the next generation of spaceborne lightning sensors to broaden our understanding of the relationships between lightning, weather, climate, and atmospheric composition.

Timothy Lang↗

A Machine Learning Approach to Improve Air Traffic Management Initiatives

Collaborating closely with commercial air carriers and related organizations, the Federal Aviation Administration(FAA) regulates air traffic and ensures the safety and efficiency of air operations. Air traffic controllers make strategic decisions, such as delaying, rerouting, or canceling flights, partly based on guidance provided by the FAA’s Air TrafficControl System Command Center (ATCSCC). The guidance includes, among other things, control measures known asTraffic Management Initiatives (TMIs) designed to enhance safety and improve operational efficiency. TMIs play a crucial role in managing the demand and capacity within the U.S. National Airspace System (NAS). Two major TMIs that are routinely used (primarily to mitigate the adverse effects of bad weather) are Ground Delay Programs (GDPs) andGround Stops (GSs). In a GDP, flights destined for airports facing thunderstorm activity experience delays at their origin airports. This proactive approach minimizes the risk of routing aircraft through hazardous weather conditions and also replaces (fuel burning) airborne delays with ground delays. In a GS, a temporary restriction is imposed on the departure or arrival of aircraft at a specific airport or within a designated airspace. Although other TMIs (e.g., miles-in-trail) are also implemented as part of (air) traffic flow management in the NAS, the focus of this work is on GDPs and GSs. Since TMIs, by design, lead to flight delays or cancellations, it is crucial to put in place the right set of parameters(e.g., scope and duration of the GDP). For example, when the end time of a GDP extends beyond what is necessary, it imposes unnecessary delays on departing flights. This situation could occur as a result of inaccurate prediction of the(required) duration of the GDP based on the weather forecast. On the other hand, if a GDP ends prematurely before the underlying capacity constraints are resolved at the destination airport, it may result in airborne holding. The delicate balance lies in matching the termination of the GDP precisely with the resolution of capacity constraints, avoiding both the imposition of unnecessary ground delays and the need for airborne holding due to premature program termination.Failing to specify the right parameters for TMIs also leads to flight delays, creating a significant obstacle in managing the increasing traffic volumes causing increased work load for the controllers. To address this issue, we propose the integration of Machine Learning (ML) models in the traffic flow management(TFM) pipeline. In current operations, decisions are made by human experts based on extensive training, historical patterns, available traffic and weather data. Since we have an abundance of data from past events that tell us the likely impact of various TMIs, by ingesting historical data, properly trained ML models can offer valuable insights and aid human decision-making. With the FAA increasingly exploring advanced analytics, ML emerges as a focal point for enhancing TFM within the National Airspace System (NAS). As a first step, this study aims to provide traffic controllers with decision-making support for the issuance and adjustment of TMIs. Data analytics and machine learning have been previously employed to address some of the challenges associated with TMIs. Numerous studies have concentrated on various facets of TMI issuance, exploring factors influencing TMI parameters, including arrival rate, airport capacity, and delay prediction. For example, using weather forecasts, several statistical methods were used to produce probabilistic capacity profiles which in conjunction with deterministic models provided insights into the GDP planning process [1–4]. The downside of using deterministic models is that they rely on fixed inputs and predetermined rules, which lack the ability to account for the inherent uncertainty and variability present in real-world scenarios. In a separate series of studies, researchers aimed to predict the occurrences of GDPs and GSs. The majority of these studies utilized various supervised learning methods, including Decision Trees, Naive Bayes, Support VectorMachines, and Random Forests to analyze the influence of weather conditions and arrival demand on TMI incidents[5–8]. However, these studies primarily focused on predicting the incidence of TMIs without explicitly addressing the scope of TMIs, including their duration and their geographical coverage. Furthermore, the emphasis of these studies was largely on GDPs, given their higher frequency and longer duration when compared to GSs. A limited number of studies focused on predicting the parameters of TMIs, specifically addressing their duration and extent. In one such study focusing on optimizing the TMI parameters at San Francisco International Airport (SFO),the authors utilized a probabilistic forecast of fog [9]. They simulated various capacity scenarios based on the (fog)burn-off forecasts, selecting GDP parameters that minimized airborne and overall ground delays. However, this approach exclusively emphasizes stratus (fog) burn-off as the primary determinant of GDP and GS, neglecting other influential factors like severe weather events, runway closures, lower capacity than traffic demand, and other important variables. Given the complexity of predicting the TMI and determining its scope, we seek a more holistic approach. We aim to consider all significant factors that could impact TMIs and their parameters. What sets this research apart is the fusion of all data sources relevant to the issuance and adjustment of TMIs and it represents the first comprehensive attempt to optimize TMIs in this manner. Since this comprehensive solution involves various aspects, we break down the problem into smaller components and input all parameters into a unified model called the “TMI Adjuster”. Figure 1 shows the overall framework and the list of datasets used in each model. The objective of the TMI Adjuster module is to deliver reliable, consistent and expedited recommendations for the progression, adjustment, and termination of TMIs. The ML solution entails developing a pipeline capable of predicting the necessity of a TMI (e.g., GS or GDP) along with its various parameters. For example, in the case of a GS, this includes the scope of the GS either in terms of distance from the destination airport or based on pre-defined airspace sectors. Here, scope refers to those regions and departing airports that are subject to the GS. In this paper, we concentrate on the issuance of GSs in the three major airports in the New York area — LaGuardia(LGA), John F. Kennedy International (JFK), and Newark Liberty International (EWR). We fuse traffic, weather and other relevant aviation data from years 2017 to 2019 to train and validate the ML models. In particular, we use the following datasets: •Terminal Aerodrome Forecast (TAF): meteorological forecasts specific to each airport, issued four times a day, covering predefined time periods. •TMI data: includes all GSs and GDPs along with their respective parameters. •Aviation System Performance Metrics (ASPM): includes traffic related data such as aircraft delays, arrival, and departure rates. •Notices to Airmen (NOTAMs): utilized to extract runway closure data and manage interdependencies between terminals in close proximity. •Flight cancellation data •Airspace Flow Programs (AFP): includes information on flight airborne holdings caused by TMIs. The data preprocessing entails transforming ASPM, TMI, AFP, NOTAMs, and weather data into an hourly format and consolidating all datasets by merging them based on date and time as the primary key. The TMI Adjuster framework comprises two parallel models: one dedicated to GS and a second model focused on GDP. As previously mentioned, our specific focus is on the GS model as a multi-classification problem. In this framework, each data point of the GS model input summarizes ten hours of data. Specifically, the data loader for the GS model generates the input and output of the model as follows: at a given time step, the input includes the actual traffic, weather, and TMI data from the two-hour window before the time step, alongside the weather forecast and scheduled traffic for the next 8 hours starting from the time step. Based on this information, the output of the GS model for each time interval consists of three dimensions. The first dimension represents a binary decision on whether there should be a GS in place for the next hour or not. The second dimension is related to the scope of the GS in the United States, and the third dimension is related to the scope of the GS in Canada (i.e., to determine if the GS impacts airports in Canada).One of the challenges with TMI modeling is the sparsity of TMI events, particularly regarding its scope. To address this challenge in the scope of the GS model output, we implement grouping. The GS scope for the US region is defined based on a list of centers that should be included when the GS is in place. With 20 centers in the US, we utilized historical data to group them into 4 categories. In particular, we summarized our historical data in a graph format where nodes represent centers, and link weights are defined based on the co-occurrence of centers in the scope parameter ofTMIs. By identified strongly connected components in this graph, we were able to partition the centers into four groups. We consider two model structures for the GS Model. Firstly, a hierarchical classification model [10], where the human decision-making for a GS is of hierarchical nature. The decision-maker first decides whether there is a need fora GS, and if the answer is yes, determines the scope. A hierarchical classification model organizes the problem into a class hierarchy, typically a tree or a Directed Acyclic Graph (DAG) structure, and considers the dependency of the decision in the previous step to the next component [10]. Here, we employ the local classifier per level approach, which involves training one multi-class classifier for each level of the class hierarchy. The second structure is the independent structure. In this setting, as the name suggests, we do not consider the dependency of the decisions in the different dimensions of the output of the model. Instead, for each dimension, we train a multi-class classifier independently. Table 1 summarizes GS model statistics for training, validation and testing. The table documents the effect of limiting data to the time steps when there was actually a TMI in place or when a TMI had just terminated. This resulted in a more balanced distribution of the GS class(GS positive class)versus “No GS”(GS negative class), which might help the training process. While JFK and LGA follow very similar distributions, with 40% and 42% GS positive class respectively, EWR has proportionally fewer GS incidents at 28%. Our subsequent phase involves evaluating the performance of both hierarchical structure and independent structure using different state-of-the-art multi-class classifier models such as Random Forest, Decision Trees, K-nearest Neighbors, and Logistic Regression and forecast the duration and scope of the GSs.

Farzan Masrour Shalmani↗