Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Instantaneous Photosynthetically Available Radiation (IPAR) prediction models based on Neural Network for ocean waters.

Instantaneous photosynthetically available radiation (IPAR) at the ocean surface and its vertical profile below the surface play a critical role in models to calculate net primary productivity of marine phytoplankton. In this work, we report two IPAR prediction models based on neural network (NN) approach, one for open ocean and the other for coastal waters. These models are trained, validated, and tested using a large volume of synthetic datasets for open ocean and coastal waters simulated by a radiative transfer model. Our NN models are designed to predict IPAR under a large range of atmospheric and oceanic conditions. The NN models can compute subsurface IPAR profile very accurately up to euphotic zone depth. The root mean square errors associated with the diffuse attenuation coefficient of IPAR are less than 0.011 𝑚−1 and 0.036 𝑚−1 for open ocean and coastal waters respectively. The performance of the NN models is better than presently available semi analytical models, with significant superiority in coastal waters.

PACE↗
NASA NTRSDate not supplied

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗
NASA NTRSDate not supplied

FloodPlanet: High-Resolution Commercial Imagery for Training and Validation of Deep Learning-Based Models of Inundation Extent

Flooding events are becoming increasingly frequent worldwide and are known to cause extensive damage. Public optical and radar satellite imagery can be used to detect large areas of inundation in rural areas, however, long revisit times and coarse spatial resolution limit applications for short-lived events and urban areas. Commercial constellations such as those operated by Planet offer increased spatial and temporal resolution and can supplement mapping efforts to provide more information to disaster response, relief, and mitigation efforts. Deep learning requires high quality labeled data for training across coincident sensors. The FloodPlanet dataset presented here contains labeled surface water for 18 events across the world based on Planetscope imagery with coincident Harmonized Landsat Sentinel-2 ( HLS) or Sentinel-1 and builds upon the previously existing Sen1Floods11, xBD, and NASA Sentinel-1 datasets. Sen1Floods11 includes 4,831 512x512 pixel overlapping tiles of coincident Sentinel-1 and Sentinel-2 data observing 11 flood events across the world from 2017-2019. The dataset contains a combination of automated and hand-labeled surface water for use in training and validation of inundation modeling efforts. The xBD dataset identifies flood-damaged buildings and indicates the scale of damage to each (none, minor, moderate, and major) from four flood events which occurred in the United States, India, Nepal, and Bangladesh from the same time period. The NASA dataset contains hand-labeled water bodies observed in Sentinel-1 imagery during five flood events within the 2017-2019 period. The effort presented here utilizes observations from these previously investigated flood events to generate labels of surface water at the 3-5m spatial resolution provided by Planetscope and facilitate the comparison between public and commercial data. A data pipeline was built which uses clustering algorithms to pick the most suitable overlapping chips between the public data and PlanetScope data for manual labeling. Labels were created manually using NASA’s ImageLabeler tool and include areas of high- and low-confidence water. The high confidence designation is reserved for areas of open, unobstructed water while low confidence is used for areas of suspected water beneath vegetation, clouds, or cloud shadows. Expected to be released in late 2022, the FloodPlanet dataset will include tiled imagery with a unique ID for each 1024x1024 pixel tile, 7 bands of HLS data, and high- and low-confidence flood labels in both shapefile and tiff formats. The authors will follow Spatial Temporal Access Catalog (STAC) guidelines to release FloodPlanet on the Radiant Earth ML hub, which hosts public datasets for machine learning.

Alexander Melancon↗
NASA NTRSDate not supplied

A Machine Learning Approach to Improve Air Traffic Management Initiatives

Collaborating closely with commercial air carriers and related organizations, the Federal Aviation Administration(FAA) regulates air traffic and ensures the safety and efficiency of air operations. Air traffic controllers make strategic decisions, such as delaying, rerouting, or canceling flights, partly based on guidance provided by the FAA’s Air TrafficControl System Command Center (ATCSCC). The guidance includes, among other things, control measures known asTraffic Management Initiatives (TMIs) designed to enhance safety and improve operational efficiency. TMIs play a crucial role in managing the demand and capacity within the U.S. National Airspace System (NAS). Two major TMIs that are routinely used (primarily to mitigate the adverse effects of bad weather) are Ground Delay Programs (GDPs) andGround Stops (GSs). In a GDP, flights destined for airports facing thunderstorm activity experience delays at their origin airports. This proactive approach minimizes the risk of routing aircraft through hazardous weather conditions and also replaces (fuel burning) airborne delays with ground delays. In a GS, a temporary restriction is imposed on the departure or arrival of aircraft at a specific airport or within a designated airspace. Although other TMIs (e.g., miles-in-trail) are also implemented as part of (air) traffic flow management in the NAS, the focus of this work is on GDPs and GSs. Since TMIs, by design, lead to flight delays or cancellations, it is crucial to put in place the right set of parameters(e.g., scope and duration of the GDP). For example, when the end time of a GDP extends beyond what is necessary, it imposes unnecessary delays on departing flights. This situation could occur as a result of inaccurate prediction of the(required) duration of the GDP based on the weather forecast. On the other hand, if a GDP ends prematurely before the underlying capacity constraints are resolved at the destination airport, it may result in airborne holding. The delicate balance lies in matching the termination of the GDP precisely with the resolution of capacity constraints, avoiding both the imposition of unnecessary ground delays and the need for airborne holding due to premature program termination.Failing to specify the right parameters for TMIs also leads to flight delays, creating a significant obstacle in managing the increasing traffic volumes causing increased work load for the controllers. To address this issue, we propose the integration of Machine Learning (ML) models in the traffic flow management(TFM) pipeline. In current operations, decisions are made by human experts based on extensive training, historical patterns, available traffic and weather data. Since we have an abundance of data from past events that tell us the likely impact of various TMIs, by ingesting historical data, properly trained ML models can offer valuable insights and aid human decision-making. With the FAA increasingly exploring advanced analytics, ML emerges as a focal point for enhancing TFM within the National Airspace System (NAS). As a first step, this study aims to provide traffic controllers with decision-making support for the issuance and adjustment of TMIs. Data analytics and machine learning have been previously employed to address some of the challenges associated with TMIs. Numerous studies have concentrated on various facets of TMI issuance, exploring factors influencing TMI parameters, including arrival rate, airport capacity, and delay prediction. For example, using weather forecasts, several statistical methods were used to produce probabilistic capacity profiles which in conjunction with deterministic models provided insights into the GDP planning process [1–4]. The downside of using deterministic models is that they rely on fixed inputs and predetermined rules, which lack the ability to account for the inherent uncertainty and variability present in real-world scenarios. In a separate series of studies, researchers aimed to predict the occurrences of GDPs and GSs. The majority of these studies utilized various supervised learning methods, including Decision Trees, Naive Bayes, Support VectorMachines, and Random Forests to analyze the influence of weather conditions and arrival demand on TMI incidents[5–8]. However, these studies primarily focused on predicting the incidence of TMIs without explicitly addressing the scope of TMIs, including their duration and their geographical coverage. Furthermore, the emphasis of these studies was largely on GDPs, given their higher frequency and longer duration when compared to GSs. A limited number of studies focused on predicting the parameters of TMIs, specifically addressing their duration and extent. In one such study focusing on optimizing the TMI parameters at San Francisco International Airport (SFO),the authors utilized a probabilistic forecast of fog [9]. They simulated various capacity scenarios based on the (fog)burn-off forecasts, selecting GDP parameters that minimized airborne and overall ground delays. However, this approach exclusively emphasizes stratus (fog) burn-off as the primary determinant of GDP and GS, neglecting other influential factors like severe weather events, runway closures, lower capacity than traffic demand, and other important variables. Given the complexity of predicting the TMI and determining its scope, we seek a more holistic approach. We aim to consider all significant factors that could impact TMIs and their parameters. What sets this research apart is the fusion of all data sources relevant to the issuance and adjustment of TMIs and it represents the first comprehensive attempt to optimize TMIs in this manner. Since this comprehensive solution involves various aspects, we break down the problem into smaller components and input all parameters into a unified model called the “TMI Adjuster”. Figure 1 shows the overall framework and the list of datasets used in each model. The objective of the TMI Adjuster module is to deliver reliable, consistent and expedited recommendations for the progression, adjustment, and termination of TMIs. The ML solution entails developing a pipeline capable of predicting the necessity of a TMI (e.g., GS or GDP) along with its various parameters. For example, in the case of a GS, this includes the scope of the GS either in terms of distance from the destination airport or based on pre-defined airspace sectors. Here, scope refers to those regions and departing airports that are subject to the GS. In this paper, we concentrate on the issuance of GSs in the three major airports in the New York area — LaGuardia(LGA), John F. Kennedy International (JFK), and Newark Liberty International (EWR). We fuse traffic, weather and other relevant aviation data from years 2017 to 2019 to train and validate the ML models. In particular, we use the following datasets: •Terminal Aerodrome Forecast (TAF): meteorological forecasts specific to each airport, issued four times a day, covering predefined time periods. •TMI data: includes all GSs and GDPs along with their respective parameters. •Aviation System Performance Metrics (ASPM): includes traffic related data such as aircraft delays, arrival, and departure rates. •Notices to Airmen (NOTAMs): utilized to extract runway closure data and manage interdependencies between terminals in close proximity. •Flight cancellation data •Airspace Flow Programs (AFP): includes information on flight airborne holdings caused by TMIs. The data preprocessing entails transforming ASPM, TMI, AFP, NOTAMs, and weather data into an hourly format and consolidating all datasets by merging them based on date and time as the primary key. The TMI Adjuster framework comprises two parallel models: one dedicated to GS and a second model focused on GDP. As previously mentioned, our specific focus is on the GS model as a multi-classification problem. In this framework, each data point of the GS model input summarizes ten hours of data. Specifically, the data loader for the GS model generates the input and output of the model as follows: at a given time step, the input includes the actual traffic, weather, and TMI data from the two-hour window before the time step, alongside the weather forecast and scheduled traffic for the next 8 hours starting from the time step. Based on this information, the output of the GS model for each time interval consists of three dimensions. The first dimension represents a binary decision on whether there should be a GS in place for the next hour or not. The second dimension is related to the scope of the GS in the United States, and the third dimension is related to the scope of the GS in Canada (i.e., to determine if the GS impacts airports in Canada).One of the challenges with TMI modeling is the sparsity of TMI events, particularly regarding its scope. To address this challenge in the scope of the GS model output, we implement grouping. The GS scope for the US region is defined based on a list of centers that should be included when the GS is in place. With 20 centers in the US, we utilized historical data to group them into 4 categories. In particular, we summarized our historical data in a graph format where nodes represent centers, and link weights are defined based on the co-occurrence of centers in the scope parameter ofTMIs. By identified strongly connected components in this graph, we were able to partition the centers into four groups. We consider two model structures for the GS Model. Firstly, a hierarchical classification model [10], where the human decision-making for a GS is of hierarchical nature. The decision-maker first decides whether there is a need fora GS, and if the answer is yes, determines the scope. A hierarchical classification model organizes the problem into a class hierarchy, typically a tree or a Directed Acyclic Graph (DAG) structure, and considers the dependency of the decision in the previous step to the next component [10]. Here, we employ the local classifier per level approach, which involves training one multi-class classifier for each level of the class hierarchy. The second structure is the independent structure. In this setting, as the name suggests, we do not consider the dependency of the decisions in the different dimensions of the output of the model. Instead, for each dimension, we train a multi-class classifier independently. Table 1 summarizes GS model statistics for training, validation and testing. The table documents the effect of limiting data to the time steps when there was actually a TMI in place or when a TMI had just terminated. This resulted in a more balanced distribution of the GS class(GS positive class)versus “No GS”(GS negative class), which might help the training process. While JFK and LGA follow very similar distributions, with 40% and 42% GS positive class respectively, EWR has proportionally fewer GS incidents at 28%. Our subsequent phase involves evaluating the performance of both hierarchical structure and independent structure using different state-of-the-art multi-class classifier models such as Random Forest, Decision Trees, K-nearest Neighbors, and Logistic Regression and forecast the duration and scope of the GSs.

Farzan Masrour Shalmani↗
NASA NTRSDate not supplied

Benchmarking Computational Tools for Calling SNPs and Indels in Complex Microbial Populations

The NASA BioNutrients missions seek to understand the suitability of microorganisms for bioproduction during space flight. One topic of interest is the stability of microbial genomes during long-term ambient storage and subsequent rehydration and growth. To address these questions, samples from 8 species were flown to ISS for 5 years of desiccated storage at ambient temperature (Stasis Packs) and 2 species were packaged along with powdered media inside a bioreactor system to allow hydration and growth in microgravity (Production Packs). For both systems, Whole Genome Sequencing (WGS) of the DNA extracted from the returned samples and paired ground controls will be conducted to identify changes in genome stability due to time, storage conditions and growth in space. Across the technical replicates, ground controls, 10 timepoints, and multiple experimental conditions, ~300 samples have been selected for initial analysis with WGS sequencing to 100x coverage. A flexible and resource efficient mutation calling pipeline is needed to process this large dataset and allow for comparisons between species. Many bioinformatics tools for calling Indels and Single Nucleotide Variants (SNVs) are designed for use with pure isolates, where true variations from the reference genome are expected to dominate the reads aligning to the location of mutation. In contrast, DNA from the Stasis Pack (SP) samples was collected directly after recovery from desiccated storage and the Production Pack (PP) samples were collected after fermentation. In this context, reads with mutations are expected to be less frequent than reads that align with the reference genome, as each sample will include multiple lines of cells. Thus, BioNutrients samples are expected to be similar to samples from cancer cell or “pooled” sequencing approaches. In preparation for the analysis of the BioNutrients samples, we have tested three mutation calling tools (GATK for Microbes, BreSeq and DiscoSNP) designed for complex samples. A challenge of validating mutation identification pipelines is a lack of “Ground Truth” datasets, especially for complex samples. To compare these three tools, we sought to identify mutations in pre-existing WGS data collected from populations of Chlamydomonas reinhardtii that were exposed to UV mutagenesis and growth in LEO as part of the Space Algae-1 mission. Here we present a summary of these tools against the analysis originally conducted using the CRISP tool. Critical metrics are compared such as runtime, the number of SNPs, the number and size of Indels, and patterns of transversion and transitions identified by each tool are reported. By sharing these benchmarking results collected in support of the BioNutrients mission, we aim to guide others seeking to identify SNVs in similarly complex microbial samples.

Biology↗
NASA NTRS2011

Validating LES for Jet Aeroacoustics

Engineers charged with making jet aircraft quieter have long dreamed of being able to see exactly how turbulent eddies produce sound and this dream is now coming true with the advent of large eddy simulation (LES). Two obvious challenges remain: validating the LES codes at the resolution required to see the fluid-acoustic coupling, and the interpretation of the massive datasets that are produced. This paper addresses the former, the use of advanced experimental techniques such as particle image velocimetry (PIV) and Raman and Rayleigh scattering, to validate the computer codes and procedures used to create LES solutions. This paper argues that the issue of accuracy of the experimental measurements be addressed by cross-facility and cross-disciplinary examination of modern datasets along with increased reporting of internal quality checks in PIV analysis. Further, it argues that the appropriate validation metrics for aeroacoustic applications are increasingly complicated statistics that have been shown in aeroacoustic theory to be critical to flow-generated sound, such as two-point space-time velocity correlations. A brief review of data sources available is presented along with examples illustrating cross-facility and internal quality checks required of the data before it should be accepted for validation of LES.

Bridges, James↗
NASA NTRSDate not supplied

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗
NASA NTRS2021

Measurements of Rainfall Rate, Drop Size Distribution, and Variability at Middle and Higher Latitudes: Application to the Combined DPR-GMI Algorithm

The Global Precipitation Measurement mission is a major U.S.–Japan joint mission to understand the physics of the Earth’s global precipitation as a key component of its weather, climate, and hydrological systems. The core satellite carries a dual-precipitation radar and an advanced microwave imager which provide measurements to retrieve the drop size distribution (DSD) and rain rates using a Combined Radar-Radiometer Algorithm (CORRA). Our objective is to validate key assumptions and parameterizations in CORRA and enable improved estimation of precipitation products, especially in the middle-to-higher latitudes in both hemispheres. The DSD parameters and statistical relationships between DSD parameters and radar measurements are a central part of the rainfall retrieval algorithm, which is complicated by regimes where DSD measurements are abysmally sparse (over the open ocean). In view of this, we have assembled optical disdrometer datasets gathered by research vessels, ground stations, and aircrafts to simulate radar observables and validate the scattering lookup tables used in CORRA. The joint use of all DSD datasets spans a large range of drop concentrations and characteristic drop diameters. The scaling normalization of DSDs defines an intercept parameter N(W), which normalizes the concentrations, and a scaling diameter D(m), which compresses or stretches the diameter coordinate axis. A major finding of this study is that a single relationship between N(W) and D(m), on average, unifies all datasets included, from stratocumulus to heavier rainfall regimes. A comparison with the N(W)–D(m) relation used as a constraint in versions 6 and 7 of CORRA highlights the scope for improvement of rainfall retrievals for small drops (D(m) < 1 mm) and large drops (D(m) > 2 mm). The normalized specific attenuation–reflectivity relationships used in the combined algorithm are also found to match well the equivalent relationships derived using DSDs from the three datasets, suggesting that the currently assumed lookup tables are not a major source of uncertainty in the combined algorithm rainfall estimates.

Viswanathan Bringi↗
NASA NTRS2011

Validating LES for Jet Aeroacoustics

Engineers charged with making jet aircraft quieter have long dreamed of being able to see exactly how turbulent eddies produce sound and this dream is now coming true with the advent of large eddy simulation (LES). Two obvious challenges remain: validating the LES codes at the resolution required to see the fluid-acoustic coupling, and the interpretation of the massive datasets that result in having dreams come true. This paper primarily addresses the former, the use of advanced experimental techniques such as particle image velocimetry (PIV) and Raman and Rayleigh scattering, to validate the computer codes and procedures used to create LES solutions. It also addresses the latter problem in discussing what are relevant measures critical for aeroacoustics that should be used in validating LES codes. These new diagnostic techniques deliver measurements and flow statistics of increasing sophistication and capability, but what of their accuracy? And what are the measures to be used in validation? This paper argues that the issue of accuracy be addressed by cross-facility and cross-disciplinary examination of modern datasets along with increased reporting of internal quality checks in PIV analysis. Further, it is argued that the appropriate validation metrics for aeroacoustic applications are increasingly complicated statistics that have been shown in aeroacoustic theory to be critical to flow-generated sound.

Bridges, James↗
NASA NTRS2012

The Re-Analysis of Ozone Profile Data from a 41-Year Series of SBUV Instruments

In this study we present the validation of ozone profiles from a number of Solar Back Scattered Ultra Violet (SBUV) and SBUV/2 instruments that were recently reprocessed using an updated (Version 8.6) algorithm. The SBUV dataset provides the longest available record of global ozone profiles, spanning a 41-year period from 1970 to 2011 (except a 5-year gap in the 1970s) and includes ozone profile records obtained from the Nimbus-4 BUV and Nimbus-7 SBUV instruments, and a series of SBUV(/2) instruments launched on NOAA operational satellites (NOAA 09, 11, 14, 16, 17, 18, 19). Although modifications in instrument design were made in the evolution from the BUV instrument to the modern SBUV(/2) model, the basic principles of the measurement technique and retrieval algorithm remain the same. The long term SBUV data record allows us to create a consistent, calibrated dataset of ozone profiles that can be used for climate studies and trend analyses. In particular, we focus on estimating the various sources of error in the SBUV profile ozone retrievals using independent observations and analysis of the algorithm itself. For the first time we include in the metadata a quantitative estimate of the smoothing error, defined as the error due to profile variability that the SBUV observing system cannot inherently measure. The magnitude of the smoothing error varies with altitude, latitude, season and solar zenith angle. Between 10 and 1 hPa the smoothing errors for the SBUV monthly zonal mean retrievals are of the order of 1 %, but start to increase above and below this layer. The largest smoothing errors, as large as 15-20%, were detected in in the troposphere. The SBUV averaging kernels, provided with the ozone profiles in version 8.6, help to eliminate the smoothing effect when comparing the SBUV profiles with high vertical resolution measurements, and make it convenient to use the SBUV ozone profiles for data assimilation and model validation purposes. The smoothing error can also be minimized by combining layers of data, and we will discuss recommendations for this approach as well. The SBUV ozone profiles have been intensively validated against satellite profile measurements obtained from the Microwave Limb Sounders (MLS) (on board the UARS and AURA satellites), Stratospheric Aerosol and Gas Experiment (SAGE) and Michelson Interferometer for Passive Atmospheric Sounding (MIPAS). Also, we compare coincident and collocated SBUV ozone retrievals with observations made by ground-based instruments, such as microwave spectrometers, lidars, Umkehr instruments and balloon-borne ozonosondes. Finally, we compare the SBUV ozone profiles with output from the NASA GSFC GEOS-CCM model. In the stratosphere between 25 and 1 hPa the mean biases and standard deviations are within 5% for monthly mean ozone profiles. Above and below this layer the vertical resolution of the SBUV algorithm decreases and the effects of vertical smoothing should be taken into account. Though the SBUV algorithm has a coarser vertical resolution in the lower stratosphere and troposphere, it is capable of precisely estimating the integrated ozone column between the surface and 25 hPa. The time series of the tropospheric - lower stratospheric ozone column derived from SBUV agrees within 5% with the corresponding values observed by an ensemble of ozone sonde stations in North Hemisphere. Drift of the ozone time series obtained from each SBUV(/2) instrument relative to ground based and satellite measurements are evaluated and some features of individual SBUV(l2) instruments are discussed. In addition to evaluating individual instruments against independent observations, we also focus on the instrument to instrument consistency in the series. Overall, Version 8.6 ozone profiles obtained from two different SBUV(l2) instruments compare within a couple of percent during overlap periods and are consistently varying in time, with some exceptions. Some of the noted discrepancies might bssociated with ozone diurnal variations, since the difference in the local time of the observations for a pair of SBUV(l2) instruments could be several hours. Other issues include the potential short-term drift in measurements as the instrument orbit drifts, and measurements are obtained at high solar zenith angles (>85 ). Based on the results of the validation, a consistent, calibrated dataset of SBUV ozone profiles has been created based on internal calibration only.

Kramarova, Natalya↗
NASA NTRSDate not supplied

An Investigation Into Transecting Satellites in Future Space Traffic Management Scenarios

The number of satellites expected to populate the near-Earth space environment is set to dramatically increase in the coming decade as new large constellations are approved and deployed. Current strategies for placing new batches of these satellites on orbit often involve launching into an initial orbit, and then performing apogee raising maneuvers to reach a target altitude. Similarly, end-of-life planning for these constellation satellites can consist of de-orbit burns that lower perigee to permit disposal via re-entry. Both the raising and de-orbiting maneuvers can result in the individual satellites traveling in high-eccentricity orbits that have the potential to transect other spacecraft trajectories. While individual large constellations may be able to coexist in separate altitude and inclination bands, having thousands of satellites moving between these bands as new satellites are replaced and old ones are removed could pose additional collision risks. Similar concerns have been raised regarding the impact that large numbers of university-class CubeSats might have in terms of their overall collision risk, especially as these satellites typically do not have propulsion systems for active maneuvering. To assess the impact that transecting satellites might have to future space traffic management strategies, this study explored a variety of future realistic scenarios using a high-fidelity simulation tool. The model can simulate the orbit of tens of thousands of resident space objects (RSOs) simultaneously, to include active satellites, debris, rocket bodies, or even future hypothetical scenarios, using a realistic force model that incorporates non-spherical gravity, atmospheric drag, solar radiation pressure, and more. As the model is run forward in time, various statistics and meta-data are gathered on any predicted conjunction event, providing insight into the nature and frequency of potential collisions, e.g., what size are the two satellites, who operates the satellites, are they active or passive objects, etc. Additional customization is available in terms of how probability of collision is computed, and how the probability ellipsoids and screening volumes are determined. The simulation tool also allows for rule-based maneuvers for active satellites, e.g, given an advance conjunction “warning,” one or both of the satellites can maneuver to a safe distance. A wide range of maneuvers can be implemented using impulsive or low-thrust methods, and the latencies can also be varied, e.g., using maneuver lead times of 48 hours, 24 hours, or 12 hours. Validation of the simulation results is performed against current and historical datasets available, to include comparisons to prior conjunction data messages (CDMs), object properties (mass, volume, etc.), and two-line-element records from both public and internal sources. Using the simulation environment, an assessment on the general risks that transecting satellites might pose for hypothetical future space object environments will be presented. This will involve the simulation of approximately 50,000 new large constellation satellites, in addition to the existing catalog of approximately 20,000 known resident space objects (RSOs), over propagation periods of one month to one year. A description of the simulation methodologies, scenarios evaluated, and validation methods will also be presented, as well as a preliminary assessment of the effectiveness of several candidate maneuver strategies that have the potential to reduce collision risk between active satellites.

Brian Gunter↗
NASA NTRSDate not supplied

Providing Satellite-Assisted Particulate Matter (SAPM) Estimates for the Models, In situ, and Remote sensing of Aerosols (MIRA) Working Group

The Models, In situ, and Remote sensing of Aerosols (MIRA) Working Group is an international forum that promotes collaboration amongst researchers of these three atmospheric aerosol communities. MIRA currently consists of a collection of five interdisciplinary and independently funded Topic groups with focused goals and generally involve requests for additional scientific datasets. Participants of the MIRA Satellite-Assisted Particulate Matter (SAPM) Topic group study particulate matter with diameters smaller than 2.5 microns (PM2.5), because of its substantial role in air pollution and the resulting negative impacts on human health. SAPM seeks to provide intercomparisons of different methods and techniques for obtaining surface PM2.5 proxies using spaceborne passive and active remote sensors, aerosol models, and in situ observations. The ultimate motivation of SAPM is to provide greater PM2.5 coverage than in situ ground stations, which are limited in some areas of the contiguous United States and large regions throughout the globe. In this poster presentation, we provide an overview of the PM2.5 estimation techniques applied by current SAPM team members, as well as the strengths and limitations of each technique. These approaches include spaceborne lidar (Cloud-Aerosol Lidar with Orthogonal Polarization) only, combined spaceborne lidar (Cloud Aerosol Transport System) and a model (Goddard Earth Observing System), and using aerosol optical depth (AOD) from a spaceborne passive remote sensor (Moderate Resolution Imaging Spectroradiometer) to explore city trends in AOD and relate those to city trends in PM2.5. Also in this poster presentation, we highlight results of our SAPM study of India, a country characterized by high levels of PM2.5 concentrations. We show the temporal and spatial variability of PM2.5 over India derived using various approaches and validation with ground-based in situ PM2.5 observations. The SAPM Topic group actively seeks additional collaborators, including those working with in situ aerosol measurements, and is interested in aerosol datasets to improve and/or validate the PM2.5 estimates.

Travis D Toth↗
NASA NTRS2004

Relationship between Precipitating Convection and Easterly Wave Dynamics in the Western Central Pacific

The main proposed goal of this research was a synthesis of radiosonde and radar time series from the TRMM validation experiment KWAJEX (Jul. 23 - Sep. 14 1999) with satellite datasets and forecast model based analyses, in order to characterize synoptic-scale disturbances passing through the Kwajalein (9 deg N 168 deg W) region on the north edge of the central Pacific ITCZ. The Sobel et al. paper summarizes our methodology and findings. A classic paper of Reed and Recker had documented the steady pulse of easterly waves modulating meridional wind, clouds and precipitation in and west of this region in a set of observations in boreal fall. Our study found easterly waves were much less organized and intense during KWAJEX, and only weakly correlated with daily area-averaged radar-derived precipitation and IR brightness temperature. Instead, we focused on three disturbances associated with the highest daily-averaged rainfall amounts during the period. We found by looking at NCEP reanalyses that only one was an easterly wave, while the other two corresponded to an equatorial Kelvin wave and a mixed Rossby-gravity wave, respectively. The contrast with Reed and Recker may be sampling variability, but the timing of KWAJEX, earlier in the year, and during suppressed (weak La Nina) conditions may also contribute to our different conclusions.

Bretherton, Christopher S.↗
NASA NTRS2004

Retrieval and Validation of Cirrus Cloud Properties with the Far-Infrared Sensor for Cirrus (FIRSC) During CRYSTAL-FACE

This grant supported the principal investigator's analysis of data obtained during CRYSTAL-FACE by two submillimeter-wave radiometers: the Far-Infrared Sensor for Cirrus (FIRSC) and the Conical Scanning Submillimeter-wave Imaging Radiometer (CoSSIR). The PI led the overall FIRSC investigation, though Co-I Michael Vanek led the instrument component at NASA Langley. The overall CoSSIR investigation was led by James Wang at NASA Goddard, but the cirrus retrieval and validation was performed at the University of Colorado. The goal of this research was to demonstrate the submillimeter-wave cirrus cloud remote sensing technique, provide retrievals of ice water path (IWP) and median mass particle diameter (D(sub me)), and perform validation of the cirrus retrievals using other CRYSTAL-FACE datasets.

Evans, K. Franklin↗
NASA NTRS2020

Validation of Carbon Trace Gas Profile Retrievals from the NOAA-Unique Combined Atmospheric Processing System for the Cross-Track Infrared Sounder

This paper provides an overview of the validation of National Oceanic and Atmospheric Administration (NOAA) operational retrievals of atmospheric carbon trace gas profiles, specifically carbon monoxide (CO), methane (CH4) and carbon dioxide (CO2), from the NOAA-Unique Combined Atmospheric Processing System (NUCAPS), a NOAA enterprise algorithm that retrieves atmospheric profile environmental data records (EDRs) under global non-precipitating (clear to partly cloudy) conditions. Vertical information about atmospheric trace gases is obtained from the Cross-track Infrared Sounder (CrIS), an infrared Fourier transform spectrometer that measures high resolution Earth radiance spectra from NOAA operational low earth orbit (LEO) satellites, including the Suomi National Polar-orbiting Partnership (SNPP) and follow-on Joint Polar Satellite System (JPSS) series beginning with NOAA-20. The NUCAPS CO, CH4, and CO2 profile EDRs are rigorously validated in this paper using well-established independent truth datasets, namely total column data from ground-based Total Carbon Column Observing Network (TCCON) sites, and in situ vertical profile data obtained from aircraft and balloon platforms via the NASA Atmospheric Tomography (ATom) mission and NOAA AirCore sampler, respectively. Statistical analyses using these datasets demonstrate that the NUCAPS carbon gas profile EDRs generally meet JPSS Level 1 global performance requirements, with the absolute accuracy and precision of CO 5% and 15%, respectively, in layers where CrIS has vertical sensitivity; CH4 and CO2 product accuracies are both found to be within ±1%, with precisions of ≈1.5% and ⪅0.5%, respectively, throughout the tropospheric column.

satellite cal/val; error analysis; greenhouse gase↗
NASA NTRS2021

Very High-Resolution Satellite-Derived Bathymetry and Habitat Mapping Using Pleiades-1 and ICESat-2

Accurate and reliable bathymetric data are needed for a wide diversity of marine research and management applications. Satellite-derived bathymetry represents a time saving method to map large shallow waters of remote regions compared to the current costly in situ measurement techniques. This study aims to create very high-resolution (VHR) bathymetry and habitat mapping in Mayotte island waters (Indian Ocean) by fusing 0.5 m Pleiades-1 passive multispectral imagery and active ICESat-2 LiDAR bathymetry. ICESat-2 georeferenced photons were filtered to remove noise and corrected for water column refraction. The bathymetric point clouds were validated using the French naval hydrographic and oceanographic service Litto3D® dataset and then used to calibrate the multispectral image to produce a digital depth model (DDM). The latter enabled the creation of a digital albedo model used to classify benthic habitats. ICESat-2 provided bathymetry down to 15 m depth with a vertical accuracy of bathymetry estimates reaching 0.89 m. The benthic habitats map produced using the maximum likelihood supervised classification provided an overall accuracy of 96.62%. This study successfully produced a VHR DDM solely from satellite data. Digital models of higher accuracy were further discussed in the light of the recent and near-future launch of higher spectral and spatial resolution satellites.

Bathymetry↗
NASA NTRSDate not supplied

Detection of CH 4 Hotspots from NASA’s GEOS Composition Analysis System

Recent research indicates that 8 to 12% of the global oil and gas production methane emissions could be attributed to ultra-emitters, which result in high concentration ‘hotspots’ near point sources. Identifying these emissions in near real time provides useful information to the policy makers and private industry, who are working to reduce their impact. To meet this need, scientists are increasingly analyzing satellite data from the TROPOspheric Monitoring Instrument (TROPOMI) instrument aboard ESA’s Sentinel 5-Precursor mission. While direct analysis of TROPOMI level 2 swath data has been successful in identifying some large emission events, identifying hotpots is challenging because of the imaging noise due to a variety of artifacts and limits in daily coverage. Here we explore possible methodologies to detect methane hotspots using a new, gap-filled, and temporally continuous methane product from NASA’s Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS), which assimilates column averaged methane mole fractions from the TROPOMI with capabilities to assimilate other remote sensing measurements. The CoDAS has been expanded from a heritage of stratospheric composition and carbon dioxide assimilation allowing for the support of regional modeling, validation with non-coincident operations, and merging variety of datasets. The current work mainly explores Observing System Simulation Experiments with methane GEOS simulations without assimilation to prepare the groundwork for further experiments with assimilated TROPOMI. First, known hotspots based on the known inventory are identified to demonstrate the capability of the system to point out emission hotspots. In the next step, a variety of machine learning techniques such as Self-Organizing Maps and Deep Learning are explored to automate detection of the plumes. Finally, a few approaches to quantify emissions from the identified hotspots are presented and are evaluated against the inventory. The effort is directed toward a future evaluation of the CoDAS based methane monitoring system’s ability to successfully detect and quantify hotspots.

Nikolay Balashov↗
NASA NTRSDate not supplied

Exercising Prediction Validation Methods for Analysis of Quiet Supersonic Overflight

En route noise certification procedures for quiet supersonic aircraft are in development under the International Civil Aviation Organization for a proposed standard that could enable civil supersonic overland flight. While these quiet supersonic aircraft do not exist yet, methods are being developed and evaluated using existing N-wave empirical datasets and low-boom simulation datasets. One potential aspect of future certification methods is the ability to use a validated prediction model to predict the certification noise level under reference day weather conditions. Methods to validate predictions, such as the two-sample t-test, Fisher’s combined probability test, two-sample Kolmogorov-Smirnov test, and equivalence testing, have been exercised and modified for this application. While some methods compare mean values, others compare values across the distribution, and a combination of methods can be used. The methods were applied to a subset of an N-wave dataset to demonstrate the applicability and identify potential areas for improvement. Atmospheric turbulence variability was included as a factor in these analyses through KZKFourier propagation simulations with parameters matching actual flights and weather conditions. Results are presented for six noise metrics (PL, ASEL, BSEL, DSEL, ESEL, and ISBAP), and plans to expand the analyses are discussed.

sonic boom↗