Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Supervised Machine Learning Approach for Classifying Earth Science Publications

The data collections archived and distributed by the GES DISC NASA data center are widely utilized for various Earth Science studies. As these collections are created, many research works are published regarding these collections' algorithms, their validation, and their applications. As NASA data centers collect these publications for public use, it is helpful to categorize them based on how they relate to their associated datasets. Specifically, whether the publication linked to the GES DISC dataset is using it for applicational research, describing the algorithm used for the dataset creation, validating the dataset, or providing a general overview of the data collection. Currently, this process requires simple manual labeling, and as such, it may be possible to solve via automation. To approach this problem, machine learning classifiers were developed to predict a publication's category. Manually labeled publications were used as the training data for the supervised machine learning algorithms, specifically Random Forest and Multinomial Naïve Bayes. After balancing the dataset and implementing the Multinomial Naïve Bayes algorithm, the classification accuracy achieved was substantially higher than the baseline accuracy, thus significantly improving the efficiency of publication labeling.

Rohan Dayal↗

Creating a Repository of Publication Citations for a Data Center

Tracking dataset citations in scientific publications provide multiple benefits: obtaining citation indices for quantitative evaluation of the dataset scientific impact, learning about dataset usage in applied sciences, credits to dataset creators, datasets co-citation relationships and many more.

Infometrics↗

Spectrally Simplified Approach for Leveraging Legacy Geostationary Oceanic Observations

The use of multispectral geostationary satellites to study aquatic ecosystems improves the temporal frequency of observations and mitigates cloud obstruction, but no operational capability presently exists for the coastal and inland waters of the United States. The Advanced Baseline Imager (ABI) on the current iteration of the Geostationary Operational Environmental Satellites, termed the R Series (GOES-R), however, provides sub-hourly imagery and the opportunity to overcome this deficit and to leverage a large repository of existing GOES-R aquatic observations. The fulfillment of this opportunity is assessed herein using a spectrally simplified, two-channel aquatic algorithm consistent with ABI wave bands to estimate the diffuse attenuation coefficient for photosynthetically available radiation, K(d)(PAR). First, an in situ ABI dataset was synthesized using a globally representative dataset of above- and in-water radiometric data products. Values of K(d)(PAR) were estimated by fitting the ratio of the shortest and longest visible wave bands from the in situ ABI dataset to coincident, in situ K(d)(PAR) data products. The algorithm was evaluated based on an iterative cross-validation analysis in which 80% of the dataset was randomly partitioned for fitting and the remaining 20% was used for validation. The iteration producing the median coefficient of determination (R2) value (0.88) resulted in a root mean square difference of 0.319 m−1, or 8.5% of the range in the validation dataset. Second, coincident mid-day images of central and southern California from ABI and from the Moderate Resolution Imaging Spectroradiometer (MODIS) were compared using Google Earth Engine (GEE). GEE default ABI reflectance values were adjusted based on a near infrared signal. Matchups between the ABI and MODIS imagery indicated similar spatial variability (R2 = 0.60) between ABI adjusted blue-to-red reflectance ratio values and MODIS default diffuse attenuation coefficient for spectral downward irradiance at 490 nm, K(d)(490), values. This work demonstrates that if an operational capability to provide- ABI aquatic data products was realized, the spectral configuration of ABI would potentially support a sub-hourly, visible aquatic data product that is applicable to water-mass tracing and physical oceanography research.

Advanced Baseline Imager↗

Spaceborne Passive-Microwave and Visible/IR Observations of Severe Weather: Leveraging Multiple Perspectives for Detection, Validation, and Climatologies

Severe weather phenomena not only are responsible for damages to property, infrastructure, and agriculture, they are also difficult to measure in-situ and have been associated with large errors and uncertainties in precipitation estimation that pose challenges to establishing the current climatology of severe storms and their future trend in a changing Earth system. Severe convection exhibits distinct signatures in remote-sensing datasets, where it is manifested as textured or overshooting cloud tops in visible/IR imagery, or resulting a prominent brightness temperature depression in passive-microwave imagery. These distinct deep convective signatures in spaceborne datasets have been leveraged to analyze severe thunderstorms, create climatologies, improve prediction, and provide a method of detection around the globe where traditional ground-based data may be inconsistent or unavailable. Visible/IR and passive-microwave instruments are powerful tools for detecting severe thunderstorms, however, these datasets exhibit key limitations when examined individually: passive-microwave channels have large footprint and exhibit non-uniform beam filling. The visible/IR instruments have fine horizontal resolution but are limited by their insensitivity to processes occurring below cloud top. We investigate the nearly simultaneous and colocated MODIS (visible/IR) and AMSR-E (passive-microwave) onboard the Aqua satellite to leverage both datasets together and assess the extent to which these datasets can be combined to improve severe thunderstorm detection. We pair passive microwave, IR, and visible signatures of severe convection with ground-based weather radar, severe weather reports, and environmental parameters defined by the MERRA-2 reanalysis to characterize potentially severe convective storms observed by Aqua MODIS and AMSR-E. We will discuss how MODIS and AMSR-E signatures may be used together to diagnose storm properties and processes, and how the interrelationships between the signatures varies seasonally and geographically.

Sarah D. Bang↗

Investigating the Response of Land-Atmosphere Interactions and Feedbacks to Spatial Representation of Irrigation in a Coupled Modeling Framework

The transport of water, heat, and momentum from the surface to the atmosphere is dependent in part on the 10 characteristics of the land surface. Together with the model physics, parameterization schemes, and parameters employed, land datasets determine the spatial variability in land surface states (i.e., soil moisture and temperature) and fluxes. Despite the importance of these datasets, they are often chosen out of convenience or regional limitations without due assessment of their impacts on model results. Irrigation is an anthropogenic form of land heterogeneity that has been shown to alter the land surface energy balance, ambient weather, and local circulations. As such, irrigation schemes are becoming more 15 prevalent in weather and climate models with rapid developments in dataset availability and parameterization scheme complexity. Thus, to address pragmatic issues related to modeling irrigation, this study uses a high-resolution, regional coupled modeling system to investigate the impacts of irrigation dataset selection on land-atmosphere (L-A) coupling using a case study from the Great Plains Irrigation Experiment (GRAINEX) field campaign. The simulations are assessed in the context of irrigated versus non-irrigated regions, subregions across the irrigation gradient, and sub-grid scale process 20 representation in coarser scale models. The results show that L-A coupling is sensitive to the choice of irrigation dataset and resolution and that the irrigation impact on surface fluxes and near surface meteorology can be dominant, conditioned on the details of the irrigation map (i.e., boundaries, heterogeneity, etc), or minimal. A consistent finding across several analyses was that even a low percentage of irrigation fraction (i.e., 4-16%) can have significant local and downstream atmospheric impacts (e.g., lower PBL height), suggesting that representation of boundaries and heterogeneous areas within irrigated 25 regions is particularly important for the modeling of irrigation impacts on the atmosphere in this model. When viewing the simulations presented here as a proxy for ‘ideal’ tiling in a Earth System Model scale gridbox, the results show that some ‘tiles’ will reach critical nonlinear moisture and planetary boundary layer (PBL) thresholds that could be important for clouds and convection, implying that heterogeneity resulting from irrigation should be taken into consideration in new sub-grid land-atmosphere exchange parameterizations.

Patricia Lawston-Parker↗

Comparison of Dust Optical Depth From Multi-Sensor Products and MONARCH (Multiscale Online Non-hydrostatic AtmospheRe CHemistry) Dust Reanalysis Over North Africa, the Middle East, and Europe

Aerosol reanalysis datasets are model-based, observationally constrained, continuous 3D aerosol fields with a relatively high temporal frequency that can be used to assess aerosol variations and trends, climate effects, and impacts on socioeconomic sectors, such as health. Here we compare and assess the recently published MONARCH (Multiscale Online Non-hydrostatic AtmospheRe CHemistry) high-resolution regional desert dust reanalysis over northern Africa, the Middle East, and Europe (NAMEE) with a combination of ground-based observations and space-based dust retrievals and products. In particular, we compare the total and coarse dust optical depth (DOD) from the new reanalysis with DOD products derived from MODIS (MODerate resolution Imaging Spectroradiometer), MISR (Multi-angle Imaging SpectroRadiometer), and IASI (Infrared Atmospheric Sounding Interferometer) spaceborne instruments. Despite the larger uncertainties, satellite-based datasets provide a better geographical coverage than ground-based observations, and the use of different retrievals and products allows at least partially overcoming some single-product weaknesses in the comparison. Nevertheless, limitations and uncertainties due to the type of sensor, its operating principle, its sensitivity, its temporal and spatial resolution, and the methodology for retrieving or further deriving dust products are factors that bias the reanalysis assessment. We, therefore, also use ground-based DOD observations provided by 238 stations of the AERONET (AErosol RObotic NETwork) located within the NAMEE region as a reference evaluation dataset. In particular, prior to the reanalysis assessment, the satellite datasets were evaluated against AERONET, showing moderate underestimations in the vicinities of dust sources and downwind regions, whereas small or significant overestimations, depending on the dataset, can be found in the remote regions. Taking these results into consideration, the MONARCH reanalysis assessment shows that total and coarse-DOD simulations are consistent with satellite- and ground-based data, qualitatively capturing the major dust sources in the area in addition to the dust transport patterns. Moreover, the MONARCH reanalysis reproduces the seasonal dust cycle, identifying the increased dust activity that occurred in the NAMEE region during spring and summer. The quantitative comparison between the MONARCH reanalysis DOD and satellite multi-sensor products shows that the reanalysis tends to slightly overestimate the desert dust that is emitted from the source regions and underestimate the transported dust over the outflow regions, implying that the model's removal of dust particles from the atmosphere, through deposition processes, is too effective. More specifically, small positive biases are found over the Sahara desert (0.04) and negative biases over the Atlantic Ocean and the Arabian Sea (−0.04), which constitute the main pathways of the long-range dust transport. Considering the DOD values recorded on average there, such discrepancies can be considered low, as the low relative bias in the Sahara desert (< 50 %) and over the adjacent maritime regions (< 100 %) certifies. Similarly, over areas with intense dust activity, the linear correlation coefficient between the MONARCH reanalysis simulations and the ensemble of the satellite products is significantly high for both total and coarse DOD, reaching 0.8 over the Middle East, the Atlantic Ocean, and the Arabian Sea and exceeding it over the African continent. Moreover, the low relative biases and high correlations are associated with regions for which large numbers of observations are available, thus allowing for robust reanalysis assessment.

Michail Mytilinaios↗

Evaluating the Feasibility of Data Simulation for Radiation Research: Estimating RBE Values for HZE Radiation

As the drive for deep space exploration intensifies, a comprehensive understanding of the health effects of radiation exposure becomes paramount to the future of human space flight. However, epidemiological data for radiation exposure, particularly to high-energy (HZE) ions, is limited, partially due to the financial and logistical costs of radiation studies. As an alternative, this study aims to assess the viability of data simulation strategies to accurately model potential study parameters prior to utilizing laboratory conditions. This study estimates a relative biological effectiveness (RBE) factor based on the solid tumor data for outbred mice provided by Edmundson et al. 2020. Excess relative risk (ERR) models for HZE-Fe ions and gamma radiation were estimated using Poisson regression with Weibull models to represent the background solid tumor hazard without radiation. RBE values were calculated from the ratio of the heavy ion linear slope to the gamma linear slope. The parameters from these models were then applied to simulate iterations of 300 datasets across HZE-Fe doses of 0.05, 0.2, 0.4, and 0.75 Gy; gamma radiation doses of 0.75, 2, and 3 Gy, as well as an unirradiated control group. Sample size per dose varied from 100-500 mice across simulations (800-4000 mice total per dataset). 1500 datasets were generated total (300 each for sample sizes 800, 1600, 3200, and 4000). For each dataset, ERR per radiation type and RBE for HZE-Fe were calculated. The RBE from the Edmondson data was calculated to be 5.55. The RBEs from the simulated data converged around this value across the increasing sample sizes. For n = 4000, the mean RBE across the 300 datasets was 5.71 (95% CI: 5.47-5.95). These results suggest that RBEs calculated from simulated data are credible. Based on this exploration, data simulation is a viable method of testing radiation studies. It provides a method of testing study assumptions and refining research questions prior to embarking on costly laboratory experiments.

Sneha Mehta↗

Optimizing Landsat Next Shortwave Infrared Bands for Crop Residue Characterization

This study focused on optimizing the placement of shortwave infrared (SWIR) bands for pixel-level estimation of fractional crop residue cover (f R ) for the upcoming Landsat Next mission. We applied an iterative wavelength shift approach to a database of crop residue field spectra collected in Beltsville, Maryland, USA (n = 916) and computed generalized two- and three-band spectral indices for all wavelength combinations between 2000 and 2350 nm, then used these indices to model field-measured f R . A subset of the full dataset with a Normalized Difference Vegetation Index (NDVI) < 0.3 threshold (n = 643) was generated to evaluate green vegetation impacts on f R estimation. For the two-band wavelength shift analyses applied to the NDVI < 0.3 dataset, a generalized normalized difference using 2226 nm and 2263 nm bands produced the top f R estimation performance (R 2 = 0.8222; RMSE = 0.1296). These findings were similar to the established two-band Shortwave Infrared Normalized Difference Residue Index (SINDRI) (R 2 = 0.8145; RMSE = 0.1324). Performance of the two-band generalized normalized difference and SINDRI decreased for the full-NDVI dataset (R 2 = 0.5865 and 0.4144, respectively). For the three-band wavelength shift analyses applied to the NDVI < 0.3 dataset, a generalized ratio-based index with a 2031–2085–2216 nm band combination, closely matching established Cellulose Absorption Index (CAI) bands, was top performing (R 2 = 0.8397; RMSE = 0.1231). Three-band indices with CAI-type wavelengths maintained top f R estimation performance for the full-NDVI dataset with a 2036–2111–2217 nm band combination (R 2 = 0.7581; RMSE = 0.1548). The 2036–2111–2217 nm band combination was also top performing in f R estimation (R 2 = 0.8690; RMSE = 0.0970) for an additional analysis assessing combined green vegetation cover and surface moisture effects. Our results indicate that a three-band configuration with band centers and wavelength tolerances of 2036 nm (±5 nm), 2097 nm (±14 nm), and 2214 (±11 nm) would optimize Landsat Next SWIR bands for f R estimation.

Landsat Next↗

Transfer function models for using empirical and physics-based simulation signal response data

In many situations, real or induced flaws such as tight cracks with known morphology cannot be manufactured in part geometry specimens or in real parts. Typically, surface fatigue cracks are manufactured in simple geometry specimens such as flat plates, dog-bone shaped flat or cylindrical specimens. If a nondestructive evaluation (NDE)technique is required to provide a reliably detectable flaw size, denoted asa90/95, for induced flaws in a part, then a direct method for qualifying the NDE procedure is to use appropriate induced flaw specimens and perform NDE procedure demonstration on the specimens. Probability of detection (POD)analysis of the empirical data may provide estimation of a90/95. This approach is described as direct POD demonstration testing, which may follow guidelines of MIL-HDBK-1823. This paper considers a case, where embedded tight cracklike induced flaws are to be detected reliably using a signal response based NDE procedure. Here, it is assumed that it is not practical to make surface or embedded induced flaw specimens in part geometry or configuration. Therefore, a direct POD demonstration testing cannot be undertaken. It is also assumed that simulation of signal response is possible for both surface and embedded induced flaws in part geometry specimens using a physics-based model. The proposed approach for NDE procedure qualification uses artificial flaws in simple geometry and part geometry specimens, and induced flaws in the same type of simple geometry specimens. Signal response data is taken on all sets of artificial and induced flaws in simple geometry and part geometry specimens. Moreover, simulated signal response data is generated for surface and embedded flaws. Thus, a case of five signal response versus flaw size datasets is considered. Three of the datasets are empirical and two datasets are physics model-based simulation datasets. A method of devising and using transfer function calculation dataset blocks to estimate the either the reliably detectable flaw size or the demonstration flaw size is provided.

Nondestructive evaluation↗

The NASA Open Science Data Repository: Biomedical Data, Analysis Tools, and Informatic Collaborations

Increased biomedical risks and challenges associated with deep space missions require knowledge discovery, health countermeasures, and biomedical support capabilities. Maximally open-access and reusable data is needed by developers, scientists, and engineers to develop these systems. The NASA Open Science Data Repository (OSDR) is a maximally open access and FAIR database (ie., findable, accessible, interoperable, and reusable), and meets various scientific, technical, and operational needs. It offers users and submitters the ability to upload, download, search, share, analyze, cite, and visualize data across ‘omics, physiological, phenotypic, payload, hardware, behavioral, bioimaging, video, and environmental monitoring telemetry datasets. OSDR is an expanded database, based upon the successes of NASA GeneLab. OSDR has >460 studies with datasets covering model organisms to non-NASA human astronauts. There are ~12 datasets from the Inspiration 4 (I4) mission, spanning metagenomics, comprehensive metabolic panels, clonal hematopoiesis, spatial transcriptomics, proteomics, and cytokine panels. In the interest of data privacy, two I4 datasets with raw files relating to the epitranscriptome, and a new request feature is live in OSDR (with a backend review process established) developed from industry norms. OSDR is collecting and curating biomedical human data from a new sub-orbital research flight and is open to more space life science/biomedical submissions from the international and commercial sectors. OSDR also recently began a collaboration with the European Space Agency (ESA) to collect and curate >200 terabytes of human and model organism data. The OSDR submission portal is designed to ingest and curate ~25 ‘omics and ~50 physiological-phenotypic-imaging assay data types. Tools available for OSDR users include: 1) an Environmental Data Application to compare radiation, CO2, relative humidity, temperature, and other telemetry across missions and subjects, 2) the RadLab database, a collaboration between NASA, ESA, the German and Italian Space Agencies, and the Bulgarian Academy of Sciences, and 3) a Multi-study visualization tool which enables users to look across and combine ‘omics datasets. There are ~600 volunteer OSDR Analysis Working Group (AWG) members providing feedback on scientific data/metadata standards and collaborating to mine-reuse OSDR in research. OSDR/GeneLab has enabled ~60 publications reusing data as of October 2023.

space biology↗

Global 3D Data Visualization and Analysis Platform With Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks [1]. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration [2]. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera [3], Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) [5] is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools [5, 7]. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [8]. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers [5,6]. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗

Global 3D Data Visualization and Analysis Platform with Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera, Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗

Synergistic Retrievals of Ice in High Clouds From Elastic Backscatter Lidar, Ku-band Radar and Submillimeter Wave Radiometer Observations

In this study, we investigate the synergy of elastic backscatter lidar, Ku-band radar, and sub-millimeter-wave radiometer measurements in the retrieval of ice from satellite observations. The synergy is analyzed through the generation of a large dataset of IceWater Content (IWC) profiles and simulated lidar, radar and radiometer observations. The characteristics of the instruments e.g. frequencies, sensitivities, etc. are set based on the expected characteristics of instruments of the Atmosphere Observing System (AOS) mission. A hold-out validation methodology is used to assess the accuracy of the IWC profiles retrieved from various combinations of observations from the three instruments. Specifically, the IWC and associated observations are randomly divided into two datasets, one for training and the other for evaluation. The training dataset is used to train the retrieval algorithm, while the evaluation dataset is used to assess the retrieval performance. The dataset of IWC profiles is derived from CloudSat reflectivity and CALIOP lidar observations. The retrieval of the ice water content IWC profiles from the computed observations is achieved in two steps. In the first step, a class, out of 18 potential classes characterized by different vertical distribution of IWC, is estimated from the observations. The 18 classes are predetermined based on the k-Means clustering algorithm. In the second step, the IWC profile is estimated using an Ensemble Kalman Smoother (EKS) algorithm that uses the estimated class as a priori information. The results of the study show that the synergy of lidar, radar, and radiometer observations is significant in the retrieval of the IWC profiles. Nevertheless, it should be mentioned that this synergy was found under idealized conditions, and additional work might be required to materialize it in practice. The inclusion of the lidar backscatter observations in the retrieval process has a larger impact on the retrieval performance than the inclusion of the radar observations. As ice clouds have a significant impact on atmospheric radiative processes, this work is relevant to ongoing efforts to reduce uncertainties in climate analyses and projections.

Mircea Grecu↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗

Analysis of hyper-spectral AVIRIS image data over a mixed-conifer forest in Maine

An introduction to some of the potential uses of hyperspectral data for ecosystem analysis is presented. The examples given are derived from a digital dataset acquired over a sub-boreal forest in central Maine in 1990 by the NASA-JPL Airborne Visible and Infrared Imaging Spectrometer (AVIRIS) instrument gathers data from 400 to 2500 nm in 224 channels at bandwidths of approximately 10 nm. As a preview to the uses of the hyperspectral data, several products from this dataset were extracted. They range from the traditional false color composite made from simulated Thematic Mapper bands and the well known normalized difference vegetation index to much more exotic products such as fractions of vegetation, soil and shade based on linear spectral mixing models and estimates of the leaf water content at the landscape level derived using spectrum-matching techniques. Our research and that of many others indicates that the hyperspectral datasets carry much important information which is only beginning to be understood. This analysis gives an initial indication of the utility of hyperspectral data. Much work still remains to be done in algorithm development and in understanding the physics behind the complex information signal carried in the hyperspectral datasets. This work must be carried out to provide the fullest science support for high spectral resolution data to be acquired by many of the instruments to be launched as part of the Earth Observing System program in the mid-1990's.

Lawrence, William T.↗

Analysis of the global ISCCP TOVS water vapor climatology

A climatological examination of the global water vapor field based on a multiyear period of successfull satellite-based observations is presented. Results from the multiyear global ISCCP TIROS Operational Vertical Sounder (TOVS) water vapor dataset as operationally produced by NESDIS and ISCCP are shown. The methods employed for the retrieval of precipitable water content (PWC) utilize infrared measurements collected by the TOVS instrument package flown aboard the NOAA series of operational polar-orbiting satellites. Strengths of this dataset include the nearly global daily coverage, availability for a multiyear period, operational internal quality checks, and its description of important features in the mean state of the atmosphere. Weaknesses of this PWC dataset include that the infrared sensors are unable to collect data in cloudy regions, the retrievals are strongly biased toward a land-based radiosonde first-guess dataset, and the description of high spatial and temporal variability is inadequate. Primary consequences of these factors are seen in the underestimation of ITCZ water vapor maxima, and underestimation of midlatitude water vapor mean and standard deviation values where transient atmospheric phenomena contribute significantly toward time means. A comparison of TOVS analyses to SSM/I data over ocean for the month of July 1988 shows fair agreement in the magnitude and distribution of the monthly mean values, but the TOVS fields exhibit much less temporal and spatial variability on a daily basis in comparison to the SSM/I analyses. The emphasis of this paper is on the presentation and documentation of an early satellite-based water vapor climatology, and description of factors that prevent a more accurate representation of the global water vapor field.

Wittmeyer, Ian L.↗

Preliminary Global Topographic Model of Mars Based on MOLA Altimetry, Earth-Based Radar, and Viking, Mariner and MGS Occultations

The recent altimetry data acquired by MOLA over the northern hemisphere of Mars have been combined with the Earth-based radar data obtained between 1971 and 1982, and occultation measurements of the Viking 1 and 2 Orbiters, Mariner 9, and MGS to derive a global model of the shape and topography of Mars. This preliminary model has a horizontal resolution of about 300 km. Vertical accuracy is on average a few hundred meters in the region of the data. Datasets: The altimetry and radar datasets were individually binned in 1.25 degree grids and merged with the occultation data. The Viking and Mariner occultation data in the northern hemisphere were excluded from the combined dataset where MOLA altimetry were available. The laser altimetry provided extensive and almost complete coverage of the northern hemisphere north of latitude 30 while the radar provided longitudinal coverage at several latitude bands between 23N and 23S. South of this region the only data were occultations. The majority of the occultations were obtained from Mariner 9, and the rest from Viking 1 & 2, and MGS. Earlier studies had shown that the Viking and Mariner occultations were on average only accurate to 500 meters. The recent MGS occultations are accurate to a few tens of meters. However, the highest southern latitude reached by the MGS occultations is only about 64S and data near the target region for the Mars 98 lander is limited to a few Viking and Mariner observations of relatively poor quality. In addition to the above datasets the locations of the Viking 1, Viking 2, and Pathfinder landers, obtained from the radio tracking of their signals, were included.

Smith, David E.↗