Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Optimizing a Small RNAseq Analysis Pipeline for NASA GeneLab Using Open-Source Tools and Libraries

Small RNA sequencing (small RNAseq) is a powerful tool for studying the regulation of gene expression in various organisms. Small RNAseq has been leveraged in space biology research to study how expression of small RNAs, e.g. micro RNAs (miRNAs), small interfering RNAs (siRNAs), and piwi-interacting RNAs (piRNAs), change upon exposure to the space environment. NASA GeneLab currently hosts small RNAseq raw data derived from space-relevant experiments on the Open Science Data Repository (OSDR). To maximize the accessibility of these data to the scientific community, in addition to hosting raw data, which is only interpretable by bioinformaticians, GeneLab plans to process all small RNAseq datasets and make those processed data available to the scientific community via the OSDR. In this study, we present the development of the GeneLab standardized pipeline for processing small RNAseq datasets. Using human, plant, and synthetic small RNAseq datasets, we interrogate various open-source software and publicly available databases to evaluate their accuracy and reproducibility in each step of the pipeline. For quality control and adapter detection and trimming, we evaluated TrimGalore!, FASTX, SeqKit, and DNApi methods to optimize alignment to reference genomes. We compared BWA, Bowtie, and Bowtie2 to determine the optimal alignment tool. For each alignment tool we also assessed various reference databases, including Ensembl reference genomes and different types of small RNA reference databases, including genome, hairpin, and miRNA references from the miRbase and MirGeneDB databases. To quantify the aligned data, we compared SAMtools, HTSeq, and RSEM for counting alignment events from each alignment tool used. Finally, we evaluated various tools, including DESeq2 and EdgeR, for data normalization and subsequent differential expression analysis. We will present the results from our comparative analyses for each pipeline step and propose a consensus pipeline for processing small RNAseq data derived from various organisms exposed to the space environment.

SmallRNAseq, NASA GeneLab, quality control, adapte↗
NASA NTRSDate not supplied

Enhancements to Linear Stability-Based, CFD-integrated Transition Prediction for High-Speed Flows

Combining linear stability calculations with computational fluid dynamics (CFD) simulations has great potential for the automated modeling of high-speed flows, especially when adequate information about the configuration and the disturbance environment is available. However, a significant impediment to the applicability of this technique is the lack of an efficient method to calculate the crucial amplification ratio corresponding to the onset of transition in hypersonic flows. This ratio, also known as the "transition N-factor," is dependent upon the freestream disturbance environment as well as the surface properties of the test article. In response to the need for an engineering solution to predict the transition N-factor within conventional hypersonic wind tunnels, this paper presents a data-driven correlation that expands the existing correlations from straight circular cones with a narrow range of half angles to a broader array of axisymmetric configurations. Furthermore, when tested against a chosen dataset that was not used in its calibration, the suggested correlation shows good predictive accuracy with an RMS error of only 6.9%. Although similar accuracy may also be achieved via existing correlations based on similar datasets, predictions based on the proposed correlation have the advantage of not requiring an extensive amount of configuration-specific data. Practical applications often have access to the input parameters needed for this correlation, such as the freestream disturbance intensity, Mach number, and body-based slenderness Reynolds number. Additionally, this correlation outperforms the traditional assumption of a constant N-factor, particularly for configurations with blunted nose geometries. The development of this correlation is grounded in an extensive dataset encompassing conical models with body half-angles varying between 5 degrees and 16 degrees, Mach numbers ranging from 5 to 14, and nosetip-based Reynolds numbers approaching the transition reversal limit for blunt-nosed cones.

CFD↗
NASA NTRSDate not supplied

Transcriptomics Processing Pipelines for Space Biology: An Open Source and Consensus-Driven Approach

Transcriptomics holds significant value in elucidating the relationship between gene expression, experimental factors, biological factors, and various types of omics data. Enhancing our understanding of these connections is paramount for foundational biology, which plays a pivotal role in devising solutions for challenges pertinent to both space travel and terrestrial life. The NASA GeneLab project, part of the Open Science Data Repository (OSDR.nasa.gov), seeks to accelerate space biology research through cataloging and democratizing ‘omics data, including transcriptomics. Since raw omics data are largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community via the Open Science Analysis Working Groups (AWGs) to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data have greater immediate value to diverse users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. As of June 2023, transcriptomics studies comprise over half of GeneLab datasets hosted on the OSDR, including data from bulk RNA-seq and Affymetrix or Agilent 1-Channel DNA microarray assays. In collaboration with the AWGs, GeneLab developed consensus processing pipelines for these transcriptomics data types that includes quality control, background correction (microarray only), data normalization and quantification, culminating in the detection and annotation of differentially expressed genes. The work presented here describes Nextflow implementations of GeneLab’s consensus transcriptomics pipelines that automates and accelerates processing of these datasets. In addition to the core data processing, these workflows also include raw data staging and a robust verification and validation program to identify errors in real-time, stop additional downstream computation, and preserve computational resources. These workflows are used to generate GeneLab processed data hosted on the OSDR, and are publicly available as open source software for others to use at: https://github.com/nasa/GeneLab_Data_Processing.

Jonathan Oribello↗
NASA NTRSDate not supplied

Exercising Prediction Validation Methods for Analysis of Quiet Supersonic Overflight

En route noise certification procedures for quiet supersonic aircraft are in development under the International Civil Aviation Organization for a proposed standard that could enable civil supersonic overland flight. While these quiet supersonic aircraft do not exist yet, methods are being developed and evaluated using existing N-wave empirical datasets and low-boom simulation datasets. One potential aspect of future certification methods is the ability to use a validated prediction model to predict the certification noise level under reference day weather conditions. Methods to validate predictions, such as the two-sample t-test, Fisher’s combined probability test, two-sample Kolmogorov-Smirnov test, and equivalence testing, have been exercised and modified for this application. While some methods compare mean values, others compare values across the distribution, and a combination of methods can be used. The methods were applied to a subset of an N-wave dataset to demonstrate the applicability and identify potential areas for improvement. Atmospheric turbulence variability was included as a factor in these analyses through KZKFourier propagation simulations with parameters matching actual flights and weather conditions. Results are presented for six noise metrics (PL, ASEL, BSEL, DSEL, ESEL, and ISBAP), and plans to expand the analyses are discussed.

sonic boom↗
NASA NTRSDate not supplied

Flood Detection with Synthetic Aperture Radar: A Case Study of Houston, Texas Following Hurricane Harvey (2017) using C- and X-Band Observations

Hurricane Harvey produced record-breaking rainfall of up to 60 inches resulting in extensive flooding in Houston, Texas, in late August and early September of 2017. The slow forward motion of the storm following landfall left much of the area unobservable to optical remote sensing instruments for several days due to cloud cover. The active nature of Synthetic Aperture Radar (SAR) instruments allows for observations through clouds, which can supplement efforts to estimate hurricane-induced flood impacts. A growing fleet of SAR constellations has helped lower the latency of imagery following a hurricane, allowing for more timely detections of flooding to help support emergency response efforts. In this study, we leverage publicly available C-band SAR observations from the European Space Agency’s Sentinel-1B (S1B) satellite, collected on 30 August, and X-band SAR imagery collected on 1 September by the Airbus TanDEM-X (TDX) satellite made available through the NASA Commercial Smallsat Data Acquisition (CSDA) program. For each dataset, one co-polarized, StripMap, Radiometric Terrain Corrected (RTC) image was used to create a binary water/no water classification map by referencing permanent water in the Cropland Data Layer (CDL) dataset to determine thresholds. A validation dataset of randomly distributed “ground truth” points was generated using optical imagery from PlanetScope on 31 August, where the domain had relatively little cloud cover. We found that the S1B- and TDX-derived open water maps achieved overall accuracies of 94.17% and 91.57%, respectively. The variation in performance is attributed to both the penetrative abilities of C- and X-band SAR wavelengths in vegetated areas and the increased spatial resolution of the commercial SAR (~3 m) over Sentinel-1 (30 m). While publicly available Sentinel-1 observations are commonly relied upon in response and recovery efforts, these results suggest that including commercial X-band SAR imagery could be beneficial by providing both increased spatial resolution and more frequent revisits when deriving post-event flood mapping products.

Alexander M Melancon↗
NASA NTRSDate not supplied

Climatology of Global Precipitation Measurement Mission Precipitation Regimes and Implications for Global Estimates of Vertical Winds

The Global Precipitation Measurement (GPM) mission Validation Network (VN) framework leverages over 118 ground-based polarimetric Doppler radars to validate a large subset of precipitation measurements and retrievals from the GPM Dual-frequency Precipitation Radar (DPR). Recently, GPM DPR reflectivity profiles within the VN have been classified according to their convective regime using unsupervised machine learning techniques. The archetypal regimes are stratiform, convective, mixed stratiform-convective (e.g., transition regions), and “other” (e.g., peripheral regions of light precipitation). Subcategories within these four primary regimes vary according to the characteristic depth of included reflectivity profiles, resulting in 12 main GPM DPR precipitation profile categories. Polarimetry of ground-based Doppler radars in the VN offers additional insights into the types of precipitation, while pairs of radars positioned near each other enable retrieval of vertical winds via dual-Doppler analysis. Geometrically matched to the DPR reflectivity profiles in the GPM VN, these ground-based data and retrievals contribute more detailed characterization of the distinct kinematic and microphysical structures associated with each of the 12 DPR precipitation regimes. DPR reflectivity profiles linked with wind in the VN are restricted to GPM overpasses of proximal radar pairs that allow dual-Doppler analysis. Although a limited subset of DPR profiles in the VN are matched with vertical motion, agreement between the reflectivity structures paired with wind data and those of the greater DPR dataset in the VN suggest that estimates of vertical motion may be inferred in regions without ground-based measurements. We present a climatology of the 12 convective regimes identified within the DPR VN dataset as well as early efforts to estimate the kinematic and microphysical structures of precipitation profiles within the greater GPM DPR dataset by applying machine learning techniques. Precipitation data paired with global estimates of vertical winds from these efforts offer early insight to and support upcoming missions to retrieve convective mass flux, including the Investigation of Convective Updrafts (INCUS) in the Tropics and the global Atmosphere Observing System (AOS).

Precipitation↗
NASA NTRSDate not supplied

Improving Data Discovery, Analysis, and Visualizations With Cloud-Based User Services

The Global Hydrometeorology Resource Center (GHRC) Distributed Active Archive Center (DAAC) is one of 12 DAACs managed by the United States National Aeronautics and Space Administration (NASA) Earth Science Data and Information System (ESDIS) project [1]. GHRC and the other DAACs are designed to process, archive, document, and distribute NASA Earth-observing data, ranging from satellite missions to field campaigns [2]. A major goal of the DAACs is to enable science with these data. Science enabling can be difficult as datasets can be very large, use multiple formats, come from numerous platforms, and require three-dimensional visualization. GHRC is using its expertise with cloud-based technologies to develop open source and open science tools to empower users to explore, coincidentally visualize, and analyze multiple datasets. Being open source, the user community can develop visualizations for their own datasets. This presentation will expand on this objective and highlight the capabilities available to the international community now.

GHRC↗
NASA NTRSDate not supplied

Making NASA GES DISC Level 2 Data GIS Analysis Ready

There are many valuable data hosted by NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) for GIS applications in the areas of extreme weather events, climatic anomaly, and public health. However, using NASA Earth Science Data poses some challenges for GIS users. Many of these users are not experts in Earth Observation and have little knowledge about NASA's Earth science data. In the GIS community, GeoTiff is the most widely used raster format, whereas NASA's data is primarily in complex multidimensional netCDF and HDF formats. This complexity makes it difficult for GIS users, especially those who are unfamiliar with these formats. Although GIS software like ArcGIS has made progress in processing multidimensional netCDF data, certain issues still remain, particularly with level 2 data. In this study, we use TROPSpheric Monitoring instrument (TROPOMI) level 2 data as an example to demonstrate how to make such data GIS analysis ready. The process involves: 1. Creating a feature layer from the TROPOMI level 2 data. 2. Converting the feature layer to a gridded raster dataset. 3. Mosaicking gridded raster datasets into a raster dataset covering the entire desired extent. 4. Generating a symbology with a GIBS-specific style that aligns with the visual standards and requirements of GIBS. 5. Publishing image services. By performing these preprocessing and transformation steps, NASA level 2 data can be made compatible and ready for use within GIS software for various spatial analysis and visualization tasks.

Geographic Information System↗
NASA NTRS2023

Towards an Indian Land Data Assimilation System (ILDAS): A Coupled Hydrologic-Hydraulic System for Water Balance Assessments

Effective management of water resources requires reliable estimates of land surface states and fluxes, including water balance components. But most land surface models run in uncoupled mode and do not produce river discharge at catchment scales to be useful for water resources management applications. Such integrated systems are also rare over India where hydrometeorological extremes have wreaked havoc on the economy and people. So, an Indian Land Data Assimilation System (ILDAS) with a coupled land surface and a hydrodynamic model has been developed and driven by multiple meteorological forcings (0.1°, daily) to estimate land surface states, channel discharge, and floodplain inundation. ILDAS benefits from an integrated framework as well as the largest suite of observation records collected over India and has been used to produce a reanalysis product for 1981–2021 using four forcing datasets, namely, Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2), Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS), ECMWF’s ERA-5, and Indian Meteorological Department (IMD) gridded precipitation. We assessed the uncertainty and bias in these precipitation datasets and validated all major components of the terrestrial water balance, i.e., surface runoff, soil moisture, terrestrial water storage anomalies, evapotranspiration, and streamflow, against a combination of satellite and in situ observation datasets. Our assessment shows that ILDAS can represent the hydrological processes reasonably well over the Indian landmass with IMD precipitation showing the best relative performance. Evaluation against ESA-CCI soil moisture shows that MERRA-2 based estimates outperform the others, whereas ERA-5 performs best in simulating evapotranspiration when evaluated against MODIS ET. Evaluations against observed records show that CHIRPS-based estimates have the highest performance in reconstructing surface runoff and streamflow. Once operational, this system will be useful for supporting transboundary water management decision making in the region.

Indian Land Data Assimilation System (ILDAS)↗
NASA NTRSDate not supplied

Enhancements to Linear Stability-Based, CFD-integrated Transition Prediction for High-Speed Flows

Combining linear stability calculations with computational fluid dynamics (CFD) simulations has great potential for the automated modeling of high-speed flows, especially when adequate information about the configuration and the disturbance environment is available. However, a significant impediment to the applicability of this technique is the lack of an efficient method to calculate the crucial amplification ratio corresponding to the onset of transition in hypersonic flows. This ratio, also known as the "transition N-factor," is dependent upon the freestream disturbance environment as well as the surface properties of the test article. In response to the need for an engineering solution to predict the transition N-factor within conventional hypersonic wind tunnels, this paper presents a data-driven correlation that expands the existing correlations from straight circular cones with a narrow range of half angles to a broader array of axisymmetric configurations. Furthermore, when tested against a chosen dataset that was not used in its calibration, the suggested correlation shows good predictive accuracy with an RMS error of only 6.9%. Although similar accuracy may also be achieved via existing correlations based on similar datasets, predictions based on the proposed correlation have the advantage of not requiring an extensive amount of configuration-specific data. Practical applications often have access to the input parameters needed for this correlation, such as the freestream disturbance intensity, Mach number, and body-based slenderness Reynolds number. Additionally, this correlation outperforms the traditional assumption of a constant N-factor, particularly for configurations with blunted nose geometries. The development of this correlation is grounded in an extensive dataset encompassing conical models with body half-angles varying between 5 degrees and 16 degrees, Mach numbers ranging from 5 to 14, and nosetip-based Reynolds numbers approaching the transition reversal limit for blunt-nosed cones.

CFD↗
NASA NTRSDate not supplied

Assessment of Long-term Trends in the Collection 4 Total Ozone Record from the Ozone Monitoring Instrument

Long-term changes in total ozone affect the amount of harmful UV radiation reaching Earth’s surface and reflect progress made towards recovery of stratospheric ozone. Satellite total ozone data are also used to estimate long-term trends in tropospheric ozone, a reactive and potent greenhouse gas, by subtracting the stratospheric column timeseries from that of total ozone. For these scientific applications, the long-term stability should be better than 1%. Left unchecked, instrument calibration drift can produce a trend of this magnitude or greater. NASA has produced nearly twenty years of total ozone data from the Ozone Monitoring Instrument (OMI) using the Total Ozone Mapping Spectrometer (TOMS) algorithm. The drift in the OMI instrument as monitored by ice radiance calibration has been relatively slow, but it has reached a level of ~3% over the mission lifetime. This drift was corrected in the recently released Collection 4 OMI calibrated radiances, updating the Collection 3 calibration released in 2006. We have reprocessed the OMI total ozone record using the Collection 4 calibration and updates to the TOMS algorithm. We summarize these changes and evaluate their impact by comparing to the previous Collection 3 OMI dataset, the Suomi NPP Ozone Mapping and Profiler Suite Nadir Mapper (OMPS-NM) and Solar Backscatter UV (SBUV) Merged Ozone Dataset (MOD) total ozone records and other independent satellite total ozone datasets. Climatological radiance residuals from OMI and OMPS-NM are calculated and compared to investigate differences in spectral calibration that can cause drifts in long-term total ozone trends. We also analyze the tropospheric ozone record produced using the Collection 4 OMI total ozone and stratospheric column ozone from MLS. Collection 3 OMI data processed with the TOMS algorithm show a positive drift relative to other satellite and ground-based data of 1-2 DU per decade. Initial results show that this drift is reduced in Collection 4 OMI, due to the updated OMI calibration. In this work we will quantify the improvements in Collection 4 OMI relative to independent data sources at both the ozone and radiance level

Collection 4 OMI Total Ozone↗
NASA NTRS2024

Rediscovering Apollo Biomedical Data to Support Artemis: The Apollo Records Synthesis Project

With the first crewed missions of the Artemis Program on the horizon, including the return of humans to another planetary surface, the space medicine and research communities have a renewed interest in buying down risk on these missions using historic Apollo datasets. Archivists with NASA’s Life Sciences Data Archive (LSDA) and epidemiologists with the Lifetime Surveillance of Astronaut Health (LSAH) are collaborating on a project aiming at improving access to historic datasets from the Apollo Program. The Apollo Records Synthesis Project (ARSP) seeks to expand the available historic biomedical knowledge base by examining physical records located across a wide range of collections, including examples such as pre-flight and post-flight physicals, lab reports, and handwritten flight surgeon and biomedical engineer logs from Apollo missions. The ARSP team has been able to identify several previously undocumented sources of biomedical information from Apollo missions. In the future, the team will modernize record storage and accessibility of these resources using digitization and natural language processing. This poster will discuss the progress of the project, give context to the dual research-clinical care nature of the records, and highlight the challenges and opportunities in using data from historical records. This poster will also provide information on how researchers can request access to datasets from these records.

life sciences↗
NASA NTRSDate not supplied

The Impact of Assimilating Large Volumes of GNSS Radio Occultation Observations from Spire’s Commercial Constellation into NASA’s GEOS

The upcoming retrospective analysis for the 21st century (R21C) reanalysis product from NASA will include the full dataset of GNSS Radio Occultation (RO) observations collected by Spire with their constellation of smallsats. The Spire RO dataset, which was purchased by NASA for its Commercial Smallsat Data Acquisition (CSDA) archive, has global coverage and includes approximately 6 thousand RO profiles per day during 2019 increasing to nearly 20 thousand in 2022-2023. This more than doubles the volume of RO profiles from all other routinely assimilated RO missions combined during 2023. The increase in the number of RO profiles available is particularly important in the extratropics as the next largest RO constellation, the state-of-the-science Formosa Satellite Mission 7 (FORMOSAT-7)/Constellation Observing System for Meteorology, Ionosphere and Climate (COSMIC-2) mission (hereafter COSMIC-2), is focused on the Tropics and only provides approximately 4 thousand RO profiles per day. The large number of observations in the Spire RO dataset have great potential to improve analyses and forecasts of the Earth’s atmosphere produced by numerical weather prediction systems. Their impact is assessed through numerical experiments using NASA’s Global Earth Observing System (GEOS) Atmospheric Data Assimilation System (ADAS) with and without the observations from the COSMIC-2 mission. The ability of the Spire RO observations to make up for the omission of the RO observations from COSMIC-2 is directly assessed over the tropics and the impact of Spire over the extratropics is compared to that of the available RO missions that sample over this region. Finally, the quality of the Spire RO observations is compared to that of the routinely assimilated RO missions using Forecast Sensitivity-based Observation Impact (FSOI).

Michael J. Murphy↗
NASA NTRSDate not supplied

The Impact of Assimilating Large Volumes of GNSS Radio Occultation Observations from Spire’s Commercial Constellation into NASA’s GEOS

The upcoming retrospective analysis for the 21st century (R21C) reanalysis product from NASA will include the full dataset of GNSS Radio Occultation (RO) observations collected by Spire with their constellation of smallsats. The Spire RO dataset, which was purchased by NASA for its Commercial Smallsat Data Acquisition (CSDA) archive, has global coverage and increases in number from approximately 6 thousand RO profiles per day during 2019 to approximately 20 thousand in 2022-2023. This more than doubles the volume of RO profiles from all other routinely assimilated RO missions combined during 2022. The increase in the number of RO profiles available is particularly important in the extratropics as the next largest RO constellation, the state-of-the-science Formosa Satellite Mission 7 (FORMOSAT-7)/Constellation Observing System for Meteorology, Ionosphere and Climate (COSMIC-2) mission (hereafter COSMIC-2), is focused on the Tropics and only provides approximately 4 thousand RO profiles per day. The large number of observations in the Spire RO dataset have great potential to improve analyses and forecasts of the Earth’s atmosphere produced by numerical weather prediction systems. Their impact is assessed through numerical experiments using NASA’s Global Earth Observing System (GEOS) Atmospheric Data Assimilation System (ADAS) with and without the observations from the COSMIC-2 mission. The ability of the Spire RO observations to make up for the omission of the RO observations from COSMIC-2 is directly assessed over the tropics and the impact of Spire over the extratropics is compared to that of the available RO missions that sample over this region. Finally, the quality of the Spire RO observations is compared to that of the routinely assimilated RO missions using Forecast Sensitivity-based Observation Impact (FSOI).

Michael J. Murphy↗
NASA NTRSDate not supplied

Insights into Long-Term Global Precipitation from IMERG and GPCP

Multiple satellite-based datasets provide estimates of the long-term record of global precipitation. Each necessarily includes both the real atmospheric behavior and a collection of artifacts driven by the input data sources and design choices in the retrievals and dataset construction. For this presentation, the Integrated Multi-satellitE Retrievals for GPM (IMERG) products from the Global Precipitation Measurement (GPM) mission’s U.S. Science Team are designed as a modern High-Resolution Precipitation Product (HRPP), while the Global Precipitation Climatology Project’s (GPCP) products are designed as a modern Climate Data Record (CDR). Although they share some common input data sources, the computational process for each is rather different. Comparing the precipitation estimates from each algorithm gives us insights into likely artifacts and the natural variations that are common to both. The goal of an HRPP is to give the best estimate of precipitation at each time step in the dataset, generally meaning that “all possible available” data are used. In contrast, the CDR is intended to provide a precipitation record that has relatively homogeneous statistics, necessary for climate analysis. Each analysis strives for both goals, of course, but this means that the HRPP uses the disparate collection of satellites whose statistics don’t quite match the ideal record, while the CDR is computed from fewer satellites that provide a relatively homogeneous set of precipitation statistics. This presentation employs the current versions of the IMERG and GPCP products, V07B and V3.2, respectively. A variety of analyses have demonstrated that IMERG has more artifacts, as expected, which tend to result from changes in the source of intercalibration for the various input satellites, namely the Combined Radar-Radiometer Algorithm using TMI and PR during the TRMM era and using GMI and DPR-Ku during the GPM era. As well, a shift occurs when the altitudes of the TRMM and GPM satellites change as a result of orbit boosts. For the most part the mean precipitation shows good continuity across these boundaries, but there are noticeable changes in the respective histograms. The latter has taken on more importance in recent years due to increased scrutiny on extremes which implicitly focus on the upper end of the precipitation histograms. The GPCP product is more homogeneous, with only one major change in calibrator, transitioning from the SSMI series of satellites to the SSMIS series of satellites in 2009. The GPCP analysis does a good job of minimizing artifacts in the means at this boundary, while the histograms show a smaller, but still noticeable shift in the histograms, a result that is similar to data boundaries in IMERG. The GPCP Daily, which is a month-by-month rescaling of the daily accumulated IMERG Final product, shows more consistency than the equivalent daily IMERG, but inherits the histogram shifts from IMERG. Given this overlay of artifacts, there is enough consistency between the products to illustrate some important long-term variations, including interannual variations, not all of which are easily attributable to ENSO events, and trends that are large regionally, but comparatively small when averaged across the globe.

precipitation↗
NASA NTRSDate not supplied

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗
NASA NTRSDate not supplied

Enhancing Air Traffic Control Planning with Automatic Speech Recognition

The decisions made during the Federal Aviation Administration Air Traffic Control System Command Center's planning teleconferences hold significant sway over the National Airspace System. Held every two hours, these teleconferences convene air traffic managers and stakeholders from across the nation to discuss airspace conditions, weather, and constraints, leading to the formulation and adjustment of traffic management initiatives. Given the critical nature of these decisions, the need for accurate and efficient record-keeping is paramount. In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. While traditional applications focus on transcribing air traffic control communication, this paper explores a unique application of automatic speech recognition by converting the audio from planning teleconferences into text transcriptions. This innovative approach addresses key challenges in the field, presenting potential benefits for quality assurance, real-time participation, and downstream natural language processing tasks. A notable breakthrough in the machine learning community, namely the transformer neural network architecture, forms the backbone of the proposed solution in this paper. The transformer architecture's role in this research represents a paradigm shift in the efficiency of automatic speech recognition models. By reducing the amount of in-domain training data required, this architecture allows for the fine-tuning of such models like Whisper, originally pretrained on vast English speech datasets. The adaptability of the transformer architecture proves invaluable in capturing the nuances of aviation terminology and specific language used in planning teleconferences. Leveraging the Whisper model as a baseline, our research details the fine-tuning and validation using a dataset comprising 20 hours of meticulously transcribed planning teleconferences. Notably, the baseline pretrained Whisper model exhibited a word error rate of 18.77%. Through the fine-tuning process, the model achieved a substantial improvement, demonstrating an impressive performance with a reduced word error rate of 6.82%. This substantial decrease in WER not only highlights the effectiveness of the transformer architecture but also emphasizes the practical advancements achieved through the application of automatic speech recognition in this specific domain. The utilization of automatic speech recognition in planning teleconferences in this work introduces several novelties. Firstly, the creation of text transcriptions offers a valuable tool for quality assurance and facilitates the efficient review of teleconferences. This is an important aspect of the proposed solution, given the time-sensitive and high-stakes nature of decisions made during these meetings. Furthermore, text-searchable transcriptions provide a streamlined approach for locating and validating critical information, potentially saving hours of manual effort in searching through audio recordings. Moreover, our research identifies a key use case for external facilities and stakeholders. In situations where attendance at the planning teleconference is not feasible, having access to text transcriptions in real-time or shortly after the teleconference ends, proves to be a time-saving and informative resource. This feature enhances collaboration and ensures that stakeholders can stay abreast of important discussions and decisions even in their absence. Despite the efficiency gains facilitated by the transformer architecture in automatic speech recognition technology, it is essential to acknowledge the human factors in data creation. Subject matter experts play a crucial role in accurately transcribing planning teleconferences due to the specificity and complexity of the information discussed. The research dataset, consisting of 20 hours of transcribed planning teleconferences, forms the foundation for fine-tuning and validating the Whisper model. The achieved word error rate of 6.82% demonstrates promising advancements, particularly in recognizing essential aviation terminology within the teleconferences. In conclusion, this paper presents a comprehensive exploration of the application of automatic speech recognition in Air Traffic Control System Command Center planning teleconferences, leveraging the transformer architecture for enhanced efficiency. The novel contributions lie in the improved accessibility of decision-making records, real-time participation opportunities for external stakeholders, and the potential for downstream natural language processing advancements. As the aviation industry continues to evolve, the integration of automatic speech recognition technologies holds the promise of revolutionizing decision-making processes and contributing to the overall safety and efficiency of air traffic management.

ATM↗
NASA NTRSDate not supplied

GeoAI advances in specific landform mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation. References: Arundel, Samantha T., Wenwen Li, and Sizhe Wang. 2020. “GeoNat v1.0: A Dataset for Natural Feature Mapping with Artificial Intelligence and Supervised Learning.” Transactions in GIS 24 (3): 556–72. https://doi.org/10.1111/tgis.12633. Arundel, Samantha T, and Gaurav Sinha. 2018. “Validating GEOBIA Based Terrain Segmentation and Classification for Automated Delineation of Cognitively Salient Landforms BT - Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017).” In Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017), Lecture Notes in Geoinformation and Cartography, edited by Paolo Fogliaroni, Andrea Ballatore, and Eliseo Clementini, 9–14. Cham: Springer International Publishing. Arundel, Samantha T., Gaurav Sinha, Wenwen Li, David P. Martin, Kevin G. McKeehan, and Philip T. Thiem. 2023. “Historical Maps Inform Landform Cognition in Machine Learning.” Abstracts of the ICA 6 (August): 1–2. https://doi.org/10.5194/ica-abs-6-10-2023. Evans, Ian S. 2012. “Geomorphometry and Landform Mapping: What Is a Landform?” Geomorphology 137 (1): 94–106. https://doi.org/10.1016/j.geomorph.2010.09.029.

machine learning↗