Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system partition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

797 records · Page 45
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

A Hybrid Line List for CH4 and Hot Methane Continuum

Molecular line lists (a catalogue of transition frequencies and line strengths) are important for modelling absorption and emission processes in atmospheres of different astronomical objects, such as cool stars and exoplanets. In order to be applicable for high temperatures, line lists for molecules like methane must contain billions of transitions, which makes their direct (line-by-line) application in radiative transfer calculations impracticable. Here we suggest a new, hybrid line list format to mitigate this problem, based on the idea of temperature-dependent absorption continuum. Methods. The line list is partitioned into a large set of relatively weak lines and a small set of important, stronger lines. The weaker lines are then used either to construct a temperature-dependent (but pressure-independent) set of intensity cross sections or are blended into a greatly reduced set of super-lines. The strong lines are kept in the form of temperature independent Einstein A coefficients. Results. A line list for methane is constructed as a combination of 17 million strong absorption lines relative to the reference absorption spectra and a background methane continuum in two temperature-dependent forms, of cross sections and super-lines. This approach eases the use of large high temperature line lists significantly as the computationally expensive calculation of pressure dependent profiles only need to be performed for a relatively small number of lines. Both the line list and cross sections were generated using a new 34 billion methane line list (34 to10), which extends the 10to10 line list to higher temperatures (up to 2000 K). The new hybrid scheme can be applied to any large line lists containing billions of transitions. We recommend to use super-lines generated on a high resolution grid based on resolving power R = 1,000,000 to model the molecular continuum as a more flexible alternative to the temperature dependent cross sections.

Line Profiles↗
NASA NTRS2024

Global Sensitivity Analysis of Simulated Remote Sensing Polarimetric Observations Over Snow

This study presents a detailed theoretical assessment of the information content of passive polarimetric observations over snow scenes, using a global sensitivity analysis (GSA) method. Conventional sensitivity studies focus on varying a single parameter while keeping all other parameters fixed. In contrast, the GSA correctly addresses the covariance of state parameters across their entire parameter space, hence favoring a more correct interpretation of inversion algorithms and the optimal design of their state vectors. The forward simulations exploit a vector radiative transfer model to obtain the Stokes vector emerging at the top of the atmosphere for different solar zenith angles, when the bottom boundary consists of a vertically resolved snowpack of non-spherical grains. The presence of light-absorbing particulates (LAPs), either embedded in the snow or aloft in the atmosphere above in the form of aerosols, is also considered. The results are presented for a set of wavelengths spanning the visible (VIS), near-infrared (NIR), and shortwave infrared (SWIR) region of the spectrum. The GSA correctly captures the expected, high sensitivity of the reflectance to LAPs in the VIS–NIR and to grain size at different depths in the snowpack in the NIR–SWIR. With adequate viewing geometries, mono-angle measurements of total reflectance in the VIS–SWIR (akin to those of the Moderate Resolution Imaging Spectroradiometer, MODIS) resolve grain size in the top layer of the snowpack sufficiently well. The addition of multi-angle polarimetric observations in the VIS–NIR provides information on grain shape and microscale roughness. The simultaneous sensitivity in the VIS–NIR to both aerosols and snow-embedded impurities can be disentangled by extending the spectral range to the SWIR, which contains information on aerosol optical depth while remaining essentially unaffected when the same particulates are mixed with the snow. Multi-angle polarimetric observations can therefore (i) effectively partition LAPs between the atmosphere and the surface, which represents a notorious challenge for snow remote sensing based on measurements of total reflectance only and (ii) lead to better estimates of grain shape and roughness and, in turn, the asymmetry parameter, which is critical for the determination of albedo. The retrieval uncertainties are minimized when the degree of linear polarization is used in place of the polarized reflectance. The Sobol indices, which are the main metric for the GSA, were used to select the state parameters in retrievals performed on data simulated for multiple instrument configurations. Improvements in retrieval quality with the addition of measurements of polarization, multi-angle views, and different spectral channels reflect the information content, identified by the Sobol indices, relative to each configuration. The results encourage the development of new remote sensing algorithms that fully leverage multi-angle and polarimetric capabilities of modern remote sensors. They can also aid flight planning activities, since the optimal exploitation of the information content of multi-angle measurements depends on the viewing geometry. The better characterization of surface and atmospheric parameters in snow-covered regions advances research opportunities for scientists of the cryosphere and ultimately benefits albedo estimates in climate models.

remote sensing↗
NASA NTRSDate not supplied

A Machine Learning Approach to Improve Air Traffic Management Initiatives

Collaborating closely with commercial air carriers and related organizations, the Federal Aviation Administration(FAA) regulates air traffic and ensures the safety and efficiency of air operations. Air traffic controllers make strategic decisions, such as delaying, rerouting, or canceling flights, partly based on guidance provided by the FAA’s Air TrafficControl System Command Center (ATCSCC). The guidance includes, among other things, control measures known asTraffic Management Initiatives (TMIs) designed to enhance safety and improve operational efficiency. TMIs play a crucial role in managing the demand and capacity within the U.S. National Airspace System (NAS). Two major TMIs that are routinely used (primarily to mitigate the adverse effects of bad weather) are Ground Delay Programs (GDPs) andGround Stops (GSs). In a GDP, flights destined for airports facing thunderstorm activity experience delays at their origin airports. This proactive approach minimizes the risk of routing aircraft through hazardous weather conditions and also replaces (fuel burning) airborne delays with ground delays. In a GS, a temporary restriction is imposed on the departure or arrival of aircraft at a specific airport or within a designated airspace. Although other TMIs (e.g., miles-in-trail) are also implemented as part of (air) traffic flow management in the NAS, the focus of this work is on GDPs and GSs. Since TMIs, by design, lead to flight delays or cancellations, it is crucial to put in place the right set of parameters(e.g., scope and duration of the GDP). For example, when the end time of a GDP extends beyond what is necessary, it imposes unnecessary delays on departing flights. This situation could occur as a result of inaccurate prediction of the(required) duration of the GDP based on the weather forecast. On the other hand, if a GDP ends prematurely before the underlying capacity constraints are resolved at the destination airport, it may result in airborne holding. The delicate balance lies in matching the termination of the GDP precisely with the resolution of capacity constraints, avoiding both the imposition of unnecessary ground delays and the need for airborne holding due to premature program termination.Failing to specify the right parameters for TMIs also leads to flight delays, creating a significant obstacle in managing the increasing traffic volumes causing increased work load for the controllers. To address this issue, we propose the integration of Machine Learning (ML) models in the traffic flow management(TFM) pipeline. In current operations, decisions are made by human experts based on extensive training, historical patterns, available traffic and weather data. Since we have an abundance of data from past events that tell us the likely impact of various TMIs, by ingesting historical data, properly trained ML models can offer valuable insights and aid human decision-making. With the FAA increasingly exploring advanced analytics, ML emerges as a focal point for enhancing TFM within the National Airspace System (NAS). As a first step, this study aims to provide traffic controllers with decision-making support for the issuance and adjustment of TMIs. Data analytics and machine learning have been previously employed to address some of the challenges associated with TMIs. Numerous studies have concentrated on various facets of TMI issuance, exploring factors influencing TMI parameters, including arrival rate, airport capacity, and delay prediction. For example, using weather forecasts, several statistical methods were used to produce probabilistic capacity profiles which in conjunction with deterministic models provided insights into the GDP planning process [1–4]. The downside of using deterministic models is that they rely on fixed inputs and predetermined rules, which lack the ability to account for the inherent uncertainty and variability present in real-world scenarios. In a separate series of studies, researchers aimed to predict the occurrences of GDPs and GSs. The majority of these studies utilized various supervised learning methods, including Decision Trees, Naive Bayes, Support VectorMachines, and Random Forests to analyze the influence of weather conditions and arrival demand on TMI incidents[5–8]. However, these studies primarily focused on predicting the incidence of TMIs without explicitly addressing the scope of TMIs, including their duration and their geographical coverage. Furthermore, the emphasis of these studies was largely on GDPs, given their higher frequency and longer duration when compared to GSs. A limited number of studies focused on predicting the parameters of TMIs, specifically addressing their duration and extent. In one such study focusing on optimizing the TMI parameters at San Francisco International Airport (SFO),the authors utilized a probabilistic forecast of fog [9]. They simulated various capacity scenarios based on the (fog)burn-off forecasts, selecting GDP parameters that minimized airborne and overall ground delays. However, this approach exclusively emphasizes stratus (fog) burn-off as the primary determinant of GDP and GS, neglecting other influential factors like severe weather events, runway closures, lower capacity than traffic demand, and other important variables. Given the complexity of predicting the TMI and determining its scope, we seek a more holistic approach. We aim to consider all significant factors that could impact TMIs and their parameters. What sets this research apart is the fusion of all data sources relevant to the issuance and adjustment of TMIs and it represents the first comprehensive attempt to optimize TMIs in this manner. Since this comprehensive solution involves various aspects, we break down the problem into smaller components and input all parameters into a unified model called the “TMI Adjuster”. Figure 1 shows the overall framework and the list of datasets used in each model. The objective of the TMI Adjuster module is to deliver reliable, consistent and expedited recommendations for the progression, adjustment, and termination of TMIs. The ML solution entails developing a pipeline capable of predicting the necessity of a TMI (e.g., GS or GDP) along with its various parameters. For example, in the case of a GS, this includes the scope of the GS either in terms of distance from the destination airport or based on pre-defined airspace sectors. Here, scope refers to those regions and departing airports that are subject to the GS. In this paper, we concentrate on the issuance of GSs in the three major airports in the New York area — LaGuardia(LGA), John F. Kennedy International (JFK), and Newark Liberty International (EWR). We fuse traffic, weather and other relevant aviation data from years 2017 to 2019 to train and validate the ML models. In particular, we use the following datasets: •Terminal Aerodrome Forecast (TAF): meteorological forecasts specific to each airport, issued four times a day, covering predefined time periods. •TMI data: includes all GSs and GDPs along with their respective parameters. •Aviation System Performance Metrics (ASPM): includes traffic related data such as aircraft delays, arrival, and departure rates. •Notices to Airmen (NOTAMs): utilized to extract runway closure data and manage interdependencies between terminals in close proximity. •Flight cancellation data •Airspace Flow Programs (AFP): includes information on flight airborne holdings caused by TMIs. The data preprocessing entails transforming ASPM, TMI, AFP, NOTAMs, and weather data into an hourly format and consolidating all datasets by merging them based on date and time as the primary key. The TMI Adjuster framework comprises two parallel models: one dedicated to GS and a second model focused on GDP. As previously mentioned, our specific focus is on the GS model as a multi-classification problem. In this framework, each data point of the GS model input summarizes ten hours of data. Specifically, the data loader for the GS model generates the input and output of the model as follows: at a given time step, the input includes the actual traffic, weather, and TMI data from the two-hour window before the time step, alongside the weather forecast and scheduled traffic for the next 8 hours starting from the time step. Based on this information, the output of the GS model for each time interval consists of three dimensions. The first dimension represents a binary decision on whether there should be a GS in place for the next hour or not. The second dimension is related to the scope of the GS in the United States, and the third dimension is related to the scope of the GS in Canada (i.e., to determine if the GS impacts airports in Canada).One of the challenges with TMI modeling is the sparsity of TMI events, particularly regarding its scope. To address this challenge in the scope of the GS model output, we implement grouping. The GS scope for the US region is defined based on a list of centers that should be included when the GS is in place. With 20 centers in the US, we utilized historical data to group them into 4 categories. In particular, we summarized our historical data in a graph format where nodes represent centers, and link weights are defined based on the co-occurrence of centers in the scope parameter ofTMIs. By identified strongly connected components in this graph, we were able to partition the centers into four groups. We consider two model structures for the GS Model. Firstly, a hierarchical classification model [10], where the human decision-making for a GS is of hierarchical nature. The decision-maker first decides whether there is a need fora GS, and if the answer is yes, determines the scope. A hierarchical classification model organizes the problem into a class hierarchy, typically a tree or a Directed Acyclic Graph (DAG) structure, and considers the dependency of the decision in the previous step to the next component [10]. Here, we employ the local classifier per level approach, which involves training one multi-class classifier for each level of the class hierarchy. The second structure is the independent structure. In this setting, as the name suggests, we do not consider the dependency of the decisions in the different dimensions of the output of the model. Instead, for each dimension, we train a multi-class classifier independently. Table 1 summarizes GS model statistics for training, validation and testing. The table documents the effect of limiting data to the time steps when there was actually a TMI in place or when a TMI had just terminated. This resulted in a more balanced distribution of the GS class(GS positive class)versus “No GS”(GS negative class), which might help the training process. While JFK and LGA follow very similar distributions, with 40% and 42% GS positive class respectively, EWR has proportionally fewer GS incidents at 28%. Our subsequent phase involves evaluating the performance of both hierarchical structure and independent structure using different state-of-the-art multi-class classifier models such as Random Forest, Decision Trees, K-nearest Neighbors, and Logistic Regression and forecast the duration and scope of the GSs.

Farzan Masrour Shalmani↗
NASA NTRS2018

Towards an Enhanced Droplet Activation Scheme for Multi-Moment Bulk Microphysics Schemes

Initial droplet spectra produced upon activation impact the ensuing chain of microphysical processes andtherefore play a crucial role in cloud evolution. This work re-examines dependencies of newly formed clouddroplet size distribution (CDSD) characteristics on environmental and aerosol properties via parcel model simulationsthat serve as the basis for a multi-moment bulk microphysics droplet activation scheme suitable for acloud-resolving model (CRM). It is found that applying a fixed size threshold to define activated droplets versusemploying physical considerations can lead to erroneous activation and overly broad CDSDs for high aerosolconcentration and weak updraft conditions. Aerosol distributions characterized by larger median sizes and/orincreased solubility can result in greater activated droplet numbers, whereas impacts of these parameters onCDSD spectral width depend on both aerosol number concentration and updraft velocity. An expansion of theactivation scheme to include CDSD spectral width is proposed to aid efforts to extend high-order momentprediction to cloud droplet categories in CRMs as well as better represent variability in the activation process onthe cloud scale.simulations to investigate the regime dependence of the relative dispersion(d)1 of newly activated CDSDs, where d is the ratio of dropletradius standard deviation (σ) to the mean radius (r ). C16 demonstratedthat increasing Na resulted in increasing (decreasing) d values via reducedcondensational narrowing (spectral broadening) rates within theAL (UL) regime, with d values peaking in the TR regime. Their findingssuggest a similar regime dependence for d as R09 noted for Nc and helpexplain reportedly conflicting relationships between Na and CDSDspectral characteristics (cf. Hudson and Noble, 2014; Liu et al., 2014),although the applicability of these results within bulk microphysicalschemes was not addressed.Simulating aerosol-cloud interactions with CRMs employing bulkmicrophysics requires that the scheme minimally predict two CDSDparameters, namely mass and number concentrations, and represent thedroplet activation process. Various activation schemes aim to determineNc from aerosol and environmental properties and include analyticalexpressions (e.g., Abdul-Razzak et al., 1998; Morrison et al., 2005) aswell as lookup tables (LUTs) based on detailed parcel model calculations(e.g., Saleeby and Cotton, 2004, hereafter SC04; Segal and Khain,2006; Thompson and Eidhammer, 2014). Expressions to diagnose CDSDspectral width from Nc (Grabowski, 1998; Liu et al., 2006; Morrison andGrabowski, 2007) or cloud water content (Geoffroy et al., 2010) havealso been developed, although more robust methods to obtain CDSDspectral width upon activation are presently lacking. This latter point isrelevant for triple-moment (3 M) bulk microphysics that aim to predictdistribution spectral width alongside number and mass concentrations(e.g., Loftus et al., 2014; Milbrandt and Yau, 2005).The current work extends the findings of C16 to the current LUTbasedaerosol activation scheme used in the Regional AtmosphericModeling System (RAMS) (Cotton et al., 2003; SC04; Saleeby and vanden Heever, 2013, hereafter SvdH13) and additionally examinesaerosol size and solubility impacts on newly activated CDSD properties.Because early cloud development processes such as condensationalgrowth, evaporation, and droplet self-collection depend on and impactCDSD spectral width (Hudson and Yum, 1997; Seifert and Beheng 2001;Lu and Seinfeld, 2006; Igel and van den Heever, 2017), an expansion ofthe activation LUTs to include CDSD spectral width is proposed as apreliminary step for extending 3M prediction to CDSDs in CRMs forimproved simulations of aerosol-cloud interactions.2. MethodologyThe current RAMS two-moment microphysics module determinesthe fractional number of aerosol particles that activate to cloud dropletsfrom five-dimensional LUTs based on model predicted air temperature(T), w, Na, and the geometric median radius (rg) and soluble fraction (ε)of the aerosol size distribution (SvdH13). These LUTs are created offlineusing a one-dimensional Lagrangian adiabatic parcel model (Feingoldand Heymsfield, 1992; Heymsfield and Sabin, 1989; SC04) to simulateexplicit droplet activation and initial CDSD growth for a range of ambientatmospheric conditions [T, w] and binned lognormal aerosol sizedistributions given by= ⎡⎣ ⎢− ⎤⎦ ⎥N r Nr π σr rσ( )2 lnexp[ln( / )]2(ln )aggg22 (1)where r is the dry aerosol particle bin radius and σg is the geometricstandard deviation of the distribution. As the parcel model simulationsfocus on the activation process, other processes such as coalescence,sedimentation, and mixing are not considered. Details of the parcelmodel can be found in SC04 and SvdH13, and only a brief description isprovided here. At the onset of parcel model calculations, the initiallydry aerosol particles in all bins first deliquesce and reach theirequilibrium diameters in a sub-saturated environment based on theKöhler equation for solution droplets. The parcel is then lifted at a fixedupward velocity w, and particle growth by vapor diffusion, along withconcurrent changes in the ambient environment, are iteratively computedusing the Variable-coefficient Ordinary Differential Equation(VODE) solver (Brown et al., 1989). The time resolution of these calculationsis determined within the VODE solver, and the frequency atwhich the solver is called is controlled by a longer model time stepbased on fixed upward parcel displacement increments (Δz) at thespecified w (Δt=Δz/w). Model calculations proceed until the parcelreaches a height 50m beyond the level of maximum saturation ratio(Smax) or total parcel displacement exceeds 2 km. Upon model termination,Smax and the fractional number of aerosols (factv) resulting innewly formed cloud droplets, defined as particles having diameters of atleast 2 μm, are cataloged in the LUTs according to the specified T, w, Na,rg, and ε parameter values.A critical point regarding the creation of these LUTs is the use of afixed minimum diameter (Dmin) to define cloud droplets in the parcelmodel, which can produce erroneous CDSD characteristics, particularlywithin the UL regime. For aerosol distributions with large rg valuesunder low SS conditions, for example, deliquesced aerosols within thelarge tail of the distribution can exceed 2 μm in diameter yet remainunactivated as ‘haze’ particles (Levin and Cotton, 2009; McFigganset al., 2006). For this study, aerosol particles activate to cloud dropletsbased on the critical diameter Dcrit as a function of parcel supersaturationratio (Sr) as in R09:D = σ MS RTρ83 ln( ) critsol wr w (2)where σsol is the surface tension of a solution droplet, Mw and ρw are themolar mass and density of liquid water, respectively, and R is theuniversal gas constant. Additionally, at relatively large w values withinthe AL regime, Nc stabilizes shortly after reaching supersaturation.However, parcel ascent and condensational growth continue beyondthe level of Smax, potentially causing additional narrowing of the CDSD.In the current work, model calculations terminate upon reaching Smaxas changes in Nc are negligible with continued ascent (Peng et al., 2007;R09).Parcel model simulations are performed to examine the sensitivitiesof CDSD characteristics to w, Na, rg, and ε, with the ranges for theseparameters listed in Table 1. Aerosols are assumed to be a mix of solubleand insoluble material of equal density, specified by ε, where fullysoluble aerosols correspond to ammonium sulfate with hygroscopicityparameter κ=0.61 (Petters and Kreidenweis, 2007). FollowingSvdH13, aerosol geometric standard deviation is fixed at σg=1.8, andaerosol distributions (Eq. 1) are partitioned into 100 logarithmicallyspacedbins spanning a size range specific to each rg value. For all simulations,Δz=1 m, and initial values of relative humidity, air temperatureand pressure are set to RH=0.99, T=10 °C and p=900 hPa,respectively.

Loftus, Adrian M.↗
NASA NTRSDate not supplied

Monitoring Airspace Complexity and Determining Contributing Factors

The national airspace has evolved over many years to accommodate increased traffic demand [1] while simultaneously maintaining one of the safest forms of transportation [2], [3]. One of the reasons for this success is the ability of the system and the operators to adapt and accommodate to situations that routinely disrupt optimal operations. These situations may include: adverse weather, delays, early arrivals, equipment outages, and other factors that are outside the operators ability to control. These factors can lead to states where automation is unable to properly handle these issues and therefore air traffic controllers and pilots have to intervene, ultimately increasing communication between operators resulting in higher workload. As controller workload increases to handle sub-optimal operating conditions this can be viewed as an increase in complexity. The reasoning for this is because humans are now required to make tactical decisions in response to external factors, resulting in a departure from the strategic plan where operations would be more efficiently managed. Human operators control airspace complexity under rigid regulations that are constantly changing. The airspace is divided into sectors and the number of aircraft assigned to each controller is limited for safe handling. There has been past work that devised airspace complexity metrics in commercial aviation and related these metrics to controller workload (e.g., [4],[5]). The upper bounds on the system load are pre-determined. Such bounds on complexity make for a safe system, but the system cannot scale and adapt to autonomous, dense, and heterogeneous traffic, including the many types of Unmanned Aerial Vehicles (UAVs) envisioned to be added to the operations. We hypothesize that, as traffic density and heterogeneity grow, and other key metrics change, there will be phase transitions at which the way traffic should be managed changes significantly [6]. We offer a method for in-time detection of contributing factors that lead to phase transitions, characterized by increased complexity. To the best of our knowledge, there is no tool similar to our proposed effort that identifies such contributing factors or precursor patterns. To define the scope we are proposing to measure complexity from the viewpoint of the Terminal Radar Approach Control Facilities (TRACON) controller’s perspective. In particular we are analyzing arrivals into KSFO. With safety as the top concern for airspace operators, it is important to recognize that as density and heterogeneity grow, the focus of the system will change. Times of the day when the airspace has low density and heterogeneity, the flights will follow more efficient paths where the aircraft move on established routes that are more or less directly to the destination. However, when density and heterogeneity increases, the system will begin changing focus to avoiding conflicts and collisions and route the flights in a more flexible way. Higher flexibility requires more communication and coordination between controllers and pilots which the current automation is unable to handle. This paper proposes a novel approach that monitors airspace complexity at multiple scales, uses a Machine Learning-based tool that predicts when operations will transition to a regime of greater complexity, and identifies actions that can reduce the complexity while still maintaining efficient and safe operations. We demonstrate our proposed approach using data from multiple complementary sources. This includes, but is not limited to: historical aircraft surveillance data from NASA’s Sherlock Data Warehouse [7], METAR weather data, and airport configuration data from Aviation System Performance Metrics (ASPM). The surveillance data flight paths are sampled at a variable sample rate — increasing as the aircraft approaches the airport. This is due to how Sherlock manages flight track stitching between different radar facilities which have different sampling rates. The weather and performance data are logged at defined intervals throughout the day at a courser refresh rate. In addition to the logged data and metrics, we leverage pre-defined Standard Terminal Arrival Routes (STARs) procedures to characterize the path of each flight. Each flight files for one of these routes in the flight plan well before entering the terminal airspace, and approximately follows the route until it leaves the STAR, typically on the final fix of a runway transition. However, most flights do not always fly the full STAR procedure to completion [8], but the majority do adhere to the fixes within the common route of the procedure. Our approach leverages fixes in the common route of each of the STARs to build a reference path to the airport. This allows us to characterize the flight paths in what we are defining as the “maneuvering area” (the airspace between the STAR and before the flight is lined up on the runway’s final approach) to determine how off nominal the flights are to calculate its complexity score. Determining airspace complexity is a concept that does not have a concrete answer. In designing this metric, we consider what increases the workload for the air traffic controllers. Consequently more specialized vectoring maneuvers results in higher workload. Accordingly, we start with a theory: each flight has a direct path it takes from the STAR’s common route to the final approach’s outer marker fix for the flight’s landing runway. It is important to note that the direct path is only used as a reference. If the majority of the flights have a large consistent offset as compared to other routes it does not necessarily mean that those flights have higher complexity. We are merely building a distribution based on this direct path for that particular STAR and runway pair to determine the normal mode of operations for that route. Flights that are in the upper tail of these distributions will result in higher complexity scores and flights that fly in the median will represent the normal mode of operations and therefore will have lower complexity scores. Since flights following each STAR route take different paths to the airport, we have a different distribution for each STAR route and therefore can model these distributions to compute a complexity score from their respective normalized distributions. To evaluate the effectiveness of our proposed airspace complexity metric we will compare against an established approach based on trajectory clustering [9]. This unsupervised learning technique consists of the following steps: (1) identify the general maneuvering areas (waypoints) by performing $\kappa$-means or DBSCAN clustering on locations where aircraft frequently turn based on the surveillance radar track data, (2) map flight trajectories onto sequences of waypoints, and (3) cluster the sequences based on their common subsequences. From a high-level perspective, this baseline model learns nominal operations in the airspace through the sequence of waypoints that are representative of where aircraft change direction and defines deviations from the nominal operations as “complex.” Therefore, more deviations from the nominal operations correspond to higher complexity values. For our validation, we re-implemented this technique and tune model hyper-parameters to correctly detect waypoints for the arrival traffic into the San Francisco bay area. We will compute the complexity measure over a one-year period using our proposed technique as well as the baseline. Our validation will be based on each technique’s ability to detect a set of undesirable outcomes (e.g., go-arounds, holding patterns, average time in the airspace, etc.). Since our current complexity metric is derived from the offset from the direct reference path, it’s important to understand what causes these offsets. In many of the flights with high offset distance, flights performing holding patterns and S turns can be observed. These maneuvering tactics are utilized to add distance between the aircraft and the destination runway to prevent multiple flights from having conflicting arrival times. In order to predict a rise in complexity (or the precursor to complexity), it’s necessary to be able to identify these potential conflicts (which in turn, result in higher offsets). To do this, we define a “representative flight” for each STAR route and runway pair. This flight is approximately the path the flight would take if there was a clear path with no other flights in the airspace — including the time remaining to the airport. We first identify the flights for a given STAR runway pair using the offset to the reference path distributions that fall between the 44-55 percentiles. This yields the flights that conform to the most normal mode of operation. Each of these flights is partitioned based on the percent complete from the entry point into the maneuvering areas from 0\% – 100\% complete. Then for each percent “bin”, we take the median value of the flight’s latitude/longitude coordinates, airspeed, and (non causal) time remaining to the airport to construct a lookup table for each percent complete bin on a given route. As a flight enters the maneuvering area, we can find the estimated arrival time of a flight to the airport by finding the closest point to the representative path’s percent complete bin (relative to the flight’s current position at any snapshot in the airspace) and therefore retrieve the corresponding remaining time left on the “representative path”. We assume that the flight will follow the representative path to completion when deriving these estimates. We can then compare these estimated arrival times against other flights for the same snapshot in time to identify potential conflicts. If more flights are estimated to arrive within a tolerance window than there are runways available, then we have a potential conflict. We can use this derived measure along with other factors expected to add disruption to the operation such as weather and runway configuration changes as an input to machine learning tools to detect precursors that increases in our complexity measure. This novel method will assist in uncovering insights into the contributing factors that lead to increased complexity that may allow for in-time responses to avoid reaching a high complexity state in the airspace.

complexity↗