Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Mapping Snow Grain Size over Greenland from MODIS

This paper presents a new automatic algorithm to derive optical snow grain size (SGS) at 1 km resolution using Moderate Resolution Imaging Spectroradiometer (MODIS) measurements. Differently from previous approaches, snow grains are not assumed to be spherical but a fractal approach is used to account for their irregular shape. The retrieval is conceptually based on an analytical asymptotic radiative transfer model which predicts spectral bidirectional snow reflectance as a function of the grain size and ice absorption. The analytical form of solution leads to an explicit and fast retrieval algorithm. The time series analysis of derived SGS shows a good sensitivity to snow metamorphism, including melting and snow precipitation events. Preprocessing is performed by a Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, which includes gridding MODIS data to 1 km resolution, water vapor retrieval, cloud masking and an atmospheric correction. MAIAC cloud mask (CM) is a new algorithm based on a time series of gridded MODIS measurements and an image-based rather than pixel-based processing. Extensive processing of MODIS TERRA data over Greenland shows a robust performance of CM algorithm in discrimination of clouds over bright snow and ice. As part of the validation analysis, SGS derived from MODIS over selected sites in 2004 was compared to the microwave brightness temperature measurements of SSM\I radiometer, which is sensitive to the amount of liquid water in the snowpack. The comparison showed a good qualitative agreement, with both datasets detecting two main periods of snowmelt. Additionally, MODIS SGS was compared with predictions of the snow model CROCUS driven by measurements of the automatic whether stations of the Greenland Climate Network. We found that CROCUS grain size is on average a factor of two larger than MODIS-derived SGS. Overall, the agreement between CROCUS and MODIS results was satisfactory, in particular before and during the first melting period in mid-June. Following detailed time series analysis of SGS for four permanent sites, the paper presents SGS maps over the Greenland ice sheet for the March-September period of 2004.

Lyapustin, Alexei↗
NASA NTRSDate not supplied

GeoNEX-SUBSETS: Cutouts of geostationary satellite data over long-term monitoring sites

Satellite remote sensing data are important tool for extrapolating the knowledge obtained at the Fluxnet towers. We introduce our GEO-NEX geostationary satellite subset products, which make it easy to compare between ground observation and Geo-NEX products. The MODIS subset has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar orbiting satellites can observe target regions only once a day, while the Fluxnet eddy-covariance data are compiled as sub-hourly datasets. As a results, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. Here, the new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) has the high-frequent observation feature (10 minutes) in addition to similar spectral band and spatial resolution with MODIS. The high frequent observation allows us to compare the flux diurnal cycle with geostationary satellite sensor data. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which is the gridded Top-of-Atmosphere reflectance and brightness temperature data of geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices and climate data) will be also added upon their availability. We selected the ground observation sites from Fluxnet, Phenocam, and AERONET networks. The NEX subset data will be provided through NASA NEX data portal.

GeoNEX↗
NASA NTRS2023

Level-1 Calibration Assessment of Spire’s LEMUR-2 GNSS-R Ocean Normalized Bistatic Radar Cross Section Estimates

An assessment of the ocean surface Level-1 Normalized Bistatic Radar Cross Section products provided by the two batch 1 ‘LEMUR-2’ GNSS-R receivers of Spire, Inc. is reported. The analysis uses datasets extending from DOY 345, 2020 to DOY 329, 2021. Initial assessments indicate a highly consistent overall inter-channel response with mean NBRCS differences estimated to be at the 1.00% level over a 7-12 m/s ECMWF reference wind speed range. Efforts to validate the observation systems’ aggregate response relative to ≈3 million co-located CYGNSS measurements suggest a highly complementary behavior with an overall NBRCS correlation of 79.03% highlighting the potential utility of ‘LEMUR-2’ measurements for ocean surface wind sensing and related applications. Non-physical NBRCS dependencies on various Level-1 calibration variables, also observed with GNSS-R previous systems, are nonetheless noted and are explored in detail.

Mohammad M. Al-Khaldi↗
NASA NTRSDate not supplied

Distributed Spacecraft Autonomy - Development of Swarm Autonomy Capability and Scalability for Spacecraft

The Distributed Spacecraft Autonomy project is developing a suite of software tools that enable an operator to command and receive data from a swarm as a single entity, enable a swarm to autonomously coordinate its actions via distributed decision making and reactive closed-loop control, and model swarm behavior in the presence of anomalies or failures. Our use case is the mapping of the electron density of the ionosphere using radio tomography by coordinating the selection of appropriate GPS channels, and by recording Total Electron Count (TEC) measurements. DSA will be demonstrated onboard the NASA Ames Starling mission – a swarm of four small, LEO spacecraft, scheduled to launch in 2021. We will also perform a ground demonstration with simulated and hardware-in-the-loop elements, to validate the tools for controlling swarms of up to 100 assets. The capability to communicate autonomously between the swarm satellites is demonstrated via a sophisticated simulation architecture. Historical Plasmasphere TEC data obtained via dual-band Novatel GPS Receivers are utilized as a representative input dataset for the swarm. The representative TEC data and GPS satellite observability information is fed to the autonomous software package in place of a true real-time ground data collection process. The swarm satellites actively share status updates amongst one another and utilize multi-agent decision making to optimally identify regions of interest in the TEC distribution. The software, aware of the bandwidth limitations of the swarm satellites, prioritizes explorative measurements, which define the range of observability for the satellites, as well as exploitative measurements, which focus on maximizing the observance potential of regions with prolonged, elevated TEC density. The science of this study can ultimately be used to determine the dynamics and coupling of Earth’s magnetosphere, ionosphere, and atmosphere and their response to solar and terrestrial inputs. The findings can be applied to the imaging of critical, transient phenomena in the magnetosphere in later missions. Meanwhile, the swarm autonomy capabilities have far reaching potential in future satellite missions. As an experimental demonstration of the autonomous capabilities of the network, a message is first printed within a core Flight Executive (cFE) application. Two cFE applications that communicate with one another within the same core Flight System (cFS) are shown. Communication between mission applications on the internal cFE bus is extended to utilize Data Distribution Service (DDS) for vehicle-to-vehicle networking. The DDS middleware provides reliable delivery, routing, and topic subscription features over User Datagram Protocol (UDP). Leveraging Linux containerization, a networked set of satellite instances are generated by script to simulate swarm behavior. Swarm commanding and synchronization through the network is demonstrated under various topologies and data-loss conditions. Finally, autonomous swarm scalability from 2 satellites to 100 satellites is shown.

Distributed Autonomy↗
NASA NTRSDate not supplied

NASA GeneLab Multi-study Visualization Portal

NASA GeneLab has helped advance the field of Space Biology by providing a public repository where researchers can store, share, analyze and visualize the results of space flight related omics experiments. The GeneLab data visualization portal allows any user, regardless of bioinformatics knowledge or access to computational resources, to interact with the experimental data, draw their own conclusions, and gain insights about the effects of space on living systems. These tools help democratize scientific research and foster the NASA Open Science initiative. The new multi-study feature of the GeneLab visualization platform allows users to mine study metadata from RNA sequencing (RNA-seq) experiments to identify samples of interest by filtering datasets based on organism, tissue, assay technology type, and/or factor. Once samples are selected from multiple datasets, users can combine and normalize the sample data, then utilize the visualization displays, including Principal Component Analysis (PCA) plots, to assess sample distributions. Finally, users can perform differential gene expression analysis on the combined data and visualize the results through PCA plots, Volcano plots, Pair plots, Heatmap, Ideogram and Gene Set Enrichment Analysis. All user-generated results and visualizations will be available for download. Here, we present a biological study using samples from multiple GeneLab RNA-seq datasets and analyzed using the multi-study visualization platform to demonstrate inter- and intra-study variability, as well as commonly differentially expressed genes between spaceflight and ground control conditions across datasets. This new feature opens a wide range of possibilities and opportunities for further development including combining other assay technology types and integration with batch effect correction techniques and machine learning applications. Overall, this tool allows users to increase the statistical power of individual experiments, validate hypothesis, identify patterns, and opens the door to new and exciting research.

space biology↗
NASA NTRS2024

Measurements and Computational Analysis of the Turbulent Corner Flow on the NASA Juncture-Flow Model with a Symmetric Wing

The NASA Juncture Flow Experiment is designed to acquire high-quality flowfield data deep in the corner of a wing-fuselage junction for the purpose of computational fluid dynamics (CFD) validation and turbulence model improvement. This report presents and discusses the results of a recent experiment with the Juncture Flow Model in the NASA Langley 14- by 22-Foot Subsonic Tunnel. The main objective of the test was to expand the existing juncture-flow dataset with a symmetric wing case that displays fully attached, incipient separation, and separated flow in the corner of the wing-fuselage junction, depending on the model angle of incidence. Laser Doppler velocimetry (LDV) measurements were made at three model angles of incidence (0° : fully attached, 1° : incipient separation, and 5° : separated flow) and for each angle, mean-flow and Reynolds-stress data were obtained on the fuselage and at several locations along the corner of the wing-fuselage junction. Supporting measurements were made during the test campaign and include model and tunnel wall static pressures, tunnel wall boundary-layer profiles, oil-flow visualizations, and laser-based measurements of the as-built model geometry and model position in the test section. A companion set of Reynolds-averaged Navier-Stokes (RANS) CFD simulations were also performed and those results were used to support the discussion of the experimental test results.

Juncture Flow↗
NASA NTRS2015

Superboom Caustic Analysis and Measurement Program (SCAMP) Final Report

The objectives of the Superboom Caustic Analysis and Measurement (SCAMP) Program were to develop and validate, via flight-test measurements, analytical models for sonic boom signatures in and around focal zones as they are expected to occur during commercial aircraft transition from subsonic to supersonic flight, and to apply these models to focus boom prediction of low-boom aircraft designs. The SCAMP program has successfully investigated sonic boom focusing both analytically and experimentally, while gathering a comprehensive empirical flight test and acoustic dataset, and developing a suite of focused sonic boom prediction tools. An experimental flight and acoustic measurement test was designed during the initial year of the SCAMP program, with execution of the SCAMP flight test occurring in May 2011. The current SCAMP team, led by Wyle, includes partners from the Boeing Company, Pennsylvania State University, Gulfstream Aerospace, Eagle Aeronautics, and Central Washington University. Numerous collaborators have also participated by supporting the experiment with human and equipment resources at their own expense. The experiment involved precision flight of a McDonnell Douglas (now Boeing) F-18B executing different maneuvers that created focused sonic booms. The maneuvers were designed to center on the flight regime expected for commercial supersonic aircraft transonic transition, and also span a range of caustic curvatures in order to provide a variety of conditions for code validations. The SCAMP experiment was designed to capture concurrent F-18B on-board flight instrumentation data, high-fidelity ground-based and airborne acoustic data, and surface and upper air meteorological data. Close coordination with NASA Dryden resulted in the development of new experimental instrumentation and techniques to facilitate the SCAMP flight-test execution, including the development of an F-18B Mach rate cockpit display, TG-14 powered glider in-flight sonic boom measurement instrumentation and "Where's the Focus?" (WTF) software for near-real time way-point computation accounting for local atmospherics. In May 2011, 13 F-18B flights were conducted during 5 flying days over a 2 week period. A densely populated 10,000 ft-long ground acoustic array with 125-ft microphone spacing was designed to capture pre-, focus, and post-focus regions. The ground-based acoustic array was placed in a nominally east-west orientation in the remote Cuddeback lakebed region, north of Edwards AFB. This area was carefully selected to avoid placing focused booms on populated areas or solar power facilities. For the SCAMP measurement campaign, approvals were obtained to temporarily extend the Black Mountain supersonic corridor northward by three miles. The SCAMP flight tests successfully captured 70 boom events, with 61 focus passes, and 9 calibration passes. Seventeen of the focus passes and three of the calibration passes were laterally offset; with the others being centerline flights. Airborne incoming sonic boom wave measurements were measured by the TG-14 for 10 of the F-18B flight passes including one maximum focus signature, several N-u combinations, several overlapped N-u signatures, and several evanescent waves. During the 27-month program, the SCAMP team developed a suite of integrated computer codes with sonic boom focusing predictive capabilities: PCBoom, Lossy Nonlinear Tricomi Equation Method (LNTE) and the Nonlinear Progressive wave Equation (NPE) method. PCBoom propagates the rays through the atmosphere and, in addition to legacy focus signature prediction based on the Gill-Seebass method, provides input source characteristics and propagation parameters to LNTE and NPE. LNTE, a Tricomi solver that incorporates atmospheric losses, computes the focus signature at the focus, and computes the focus signature in the vicinity of the focal zone, including the evanescent and post-focus zones. LNTE signature auralization from low-boom vehicle designs has been demonstrated in the NASA Langley Interior Effects Room (IER). The NPE has also been validated for use in prediction of focused ground boom signatures in sonic boom focal zones. The NPE formulation has the capability to incorporate atmospheric turbulence in the predictions. This has been applied to sonic boom propagation in the past. Prediction of turbulence effects on focal zone signatures was not, however, explored during the SCAMP program.

Page, Juliet↗
NASA NTRSDate not supplied

Spaceborne Passive-Microwave and Visible/IR Observations of Severe Weather: Leveraging Multiple Perspectives for Detection, Validation, and Climatologies

Severe weather phenomena not only are responsible for damages to property, infrastructure, and agriculture, they are also difficult to measure in-situ and have been associated with large errors and uncertainties in precipitation estimation that pose challenges to establishing the current climatology of severe storms and their future trend in a changing Earth system. Severe convection exhibits distinct signatures in remote-sensing datasets, where it is manifested as textured or overshooting cloud tops in visible/IR imagery, or resulting a prominent brightness temperature depression in passive-microwave imagery. These distinct deep convective signatures in spaceborne datasets have been leveraged to analyze severe thunderstorms, create climatologies, improve prediction, and provide a method of detection around the globe where traditional ground-based data may be inconsistent or unavailable. Visible/IR and passive-microwave instruments are powerful tools for detecting severe thunderstorms, however, these datasets exhibit key limitations when examined individually: passive-microwave channels have large footprint and exhibit non-uniform beam filling. The visible/IR instruments have fine horizontal resolution but are limited by their insensitivity to processes occurring below cloud top. We investigate the nearly simultaneous and colocated MODIS (visible/IR) and AMSR-E (passive-microwave) onboard the Aqua satellite to leverage both datasets together and assess the extent to which these datasets can be combined to improve severe thunderstorm detection. We pair passive microwave, IR, and visible signatures of severe convection with ground-based weather radar, severe weather reports, and environmental parameters defined by the MERRA-2 reanalysis to characterize potentially severe convective storms observed by Aqua MODIS and AMSR-E. We will discuss how MODIS and AMSR-E signatures may be used together to diagnose storm properties and processes, and how the interrelationships between the signatures varies seasonally and geographically.

Sarah D. Bang↗
NASA NTRS2003

The Updated Umkehr Ozone Retrieval Algorithm and its Validation against Satellite Data

Improvements to the Umkehr ozone profile retrieval algorithm have been developed and are now being evaluated. The updated algorithm is able to simulate observations more accurately and provides data output that is easier to analyze. Among the new diagnostic capabilities that the updated algorithm provides is the averaging kernel (AK) method. The AK approach allows studying how the algorithm responds when a small perturbation is made in a particular layer of the atmosphere [Rodgers 1976, 1990]. We will use the AK method to define precisely what Umkehr should measure given a set of profiles measured by other platforms. This method allows us to compare trends and offsets in data more accurately than it has been done in the past. The updated Umkehr retrievals will be validated against SAGE II ozone profiles as well as SSBUV ozone profile data. We will discuss possible reasons for offset between data and differences in derived ozone profile trends. Considerable variability of the ozone profile within the 10-degree latitude envelope creates noise in the SAGE matching dataset and makes comparisons difficult. To eliminate this problem, the SAGE and Umkehr data had been previously de-seasonalized by subtracting the latitude/season dependent ozone climatology. However, the remaining noise in the ozone residuals was still considerably high for trend analysis and was attributed to longitude variability of SAGE sampling. The new ozone climatology (Labow, NASA) that has longitude dependent ozone variability will be used to minimize contribution of sampling noise in comparisons of satellite and ground station. The comparison of zenith-sky radiances (Umkehr N-value measurements) synthesized for a given set of SAGE profiles will be used to determine whether SAGE-derived N-values agree with the Umkehr-measured N-values. The instrumental effects will be discussed. Both the Umkehr data and SAGE II measurements will be analyzed for their information about ozone variability and loss and recovery rates at the mid- and upper (40 km) levels. The updated long-term Umkehr dataset can be used to provide high quality information for identifying signs of ozone recovery. The long Umkehr historical record can provide additional information for separating the dynamic and chemical mechanisms of depletion, and can help the community better understand climate change effects.

Petropavlovskikh, I.↗
NASA NTRSDate not supplied

Particle Interaction Physics Model Formulation for Plume-Surface Interaction Erosion and Cratering

The Predictive Simulation Capability development team of the STMD Game Changing Development sponsored PSI project is implementing computational simulation capability for the efficient and accurate prediction of Plume-Surface Interaction induced surface erosion and cratering in Martian and Lunar environments. The status of the Focus Area 3 of the PSI project in the generation and efficient application of accurate soil particle composition modeling in the Gas-Granular Flow Solver (GGFS) computational framework is presented. The process of constitutive closure model database generation using DEM particle interaction modeling for capturing the effects of irregular particle shape and poly-disperse mixture distribution effects is outlined. This capability has now been ported to NASA supercomputer assets and NASA engineers successfully demonstrated technology and skillset transfer in model generation for spherical and irregularly shaped, mono-disperse and bi-disperse mixture compositions. Assessment of the computational efficiency and practicality of the academic serially executed DEM tools on NASA supercomputers identified the need to migrate to a DEM framework capable of performing parallel simulations in a simultaneous process orchestrated in an automated setup, execution, database extraction, and dataset delivery ready for application simulations. The LIGGGHTS DEM toolset has been selected as the most suitable tool to migrate the DEM simulations. Once the soil model generation process is implemented, models capturing the shape and poly-dispersity effects will be generated to perform much refined validation simulations against the experiments performed under the PSI project. The application readiness of the soil models currently operational in GGFS was presented for the example of a full scale, 3-D simulation of the plume induced erosion and crater formation of the Apollo LM at an elevation of 5m above ground in a low pressure, near vacuum background.

Peter A Liever↗
NASA NTRSDate not supplied

Particle Interaction Physics Model Formulation for Plume-Surface Interaction Erosion and Cratering

The Predictive Simulation Capability development team of the STMD Game Changing Development sponsored PSI project is implementing computational simulation capability for the efficient and accurate prediction of Plume-Surface Interaction induced surface erosion and cratering in Martian and Lunar environments. The status of the Focus Area 3 of the PSI project in the generation and efficient application of accurate soil particle composition modeling in the Gas-Granular Flow Solver (GGFS) computational framework is presented. The process of constitutive closure model database generation using DEM particle interaction modeling for capturing the effects of irregular particle shape and poly-disperse mixture distribution effects is outlined. This capability has now been ported to NASA supercomputer assets and NASA engineers successfully demonstrated technology and skillset transfer in model generation for spherical and irregularly shaped, mono-disperse and bi-disperse mixture compositions. Assessment of the computational efficiency and practicality of the academic serially executed DEM tools on NASA supercomputers identified the need to migrate to a DEM framework capable of performing parallel simulations in a simultaneous process orchestrated in an automated setup, execution, database extraction, and dataset delivery ready for application simulations. The LIGGGHTS DEM toolset has been selected as the most suitable tool to migrate the DEM simulations. Once the soil model generation process is implemented, models capturing the shape and poly-dispersity effects will be generated to perform much refined validation simulations against the experiments performed under the PSI project. The application readiness of the soil models currently operational in GGFS was presented for the example of a full scale, 3-D simulation of the plume induced erosion and crater formation of the Apollo LM at an elevation of 5m above ground in a low pressure, near vacuum background.

Peter A Liever↗
NASA NTRSDate not supplied

An Overview of the CERES Radiation and Validation Experiment (CRAVE)

The Clouds and the Earth’s Radiant Energy System (CERES) experiment is one of the highest priority scientific satellite instruments developed for NASA’s Earth Observing System. The CERES Radiation and Validation Experiment (CRAVE) provides continuous world-class surface longwave and shortwave radiation measurements and validation of CERES and other satellite products. CRAVE consists of three sites (two active and one legacy). The legacy site was the CERES Ocean Validation Experiment, or COVE, located at Chesapeake Light Station (36.90 N, 75.71 W), 25 km off the coast of southeastern Virginia, USA. COVE was active from 2000-2016 but was deactivated due to structural concerns. The deactivation of COVE interrupted a rare long-term ocean/water scene dataset in the Baseline Surface Radiation Network (BSRN), the gold standard for surface radiation measurements. Shortly after the closure of COVE, Granite Island (46.72 N, 87.41 W), a new water site, was discovered and has been active since the summer of 2018. Granite Island is privately owned, located in Lake Superior, approximately 20 km north of Marquette, Michigan, USA, and 10 km to the nearest land point. The other CRAVE site is in Hampton, Virginia, USA, at Nasa Langley Research Center (37.10 N, 76.38 W), a land scene, and has been operating since December 2014. We will describe CRAVE and its importance, the uniqueness of each site and site logistics, participating networks and measurements made for radiometric, aerosol, meteorological and water skin temperature analysis. CRAVE measurements detecting smoke originating from Canadian wildfires with aerosol optical depths well over 2 and first results from a shortwave calibration round robin experiment will also be presented.

Bryan Fabbri↗
NASA NTRSDate not supplied

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗
NASA NTRS2023

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗
NASA NTRS2011

Sensitivity of C-Band Polarimetric Radar-Based Drop Size Distribution Measurements to Maximum Diameter Assumptions

The estimation of rain drop size distribution (DSD) parameters from polarimetric radar observations is accomplished by first establishing a relationship between differential reflectivity (Z(sub dr)) and the central tendency of the rain DSD such as the median volume diameter (D0). Since Z(sub dr) does not provide a direct measurement of DSD central tendency, the relationship is typically derived empirically from rain drop and radar scattering models (e.g., D0 = F[Z (sub dr)] ). Past studies have explored the general sensitivity of these models to temperature, radar wavelength, the drop shape vs. size relation, and DSD variability. Much progress has been made in recent years in measuring the drop shape and DSD variability using surface-based disdrometers, such as the 2D Video disdrometer (2DVD), and documenting their impact on polarimetric radar techniques. In addition to measuring drop shape, another advantage of the 2DVD over earlier impact type disdrometers is its ability to resolve drop diameters in excess of 5 mm. Despite this improvement, the sampling limitations of a disdrometer, including the 2DVD, make it very difficult to adequately measure the maximum drop diameter (D(sub max)) present in a typical radar resolution volume. As a result, D(sub max) must still be assumed in the drop and radar models from which D0 = F[Z(sub dr)] is derived. Since scattering resonance at C-band wavelengths begins to occur in drop diameters larger than about 5 mm, modeled C-band radar parameters, particularly Z(sub dr), can be sensitive to D(sub max) assumptions. In past C-band radar studies, a variety of D(sub max) assumptions have been made, including the actual disdrometer estimate of D(sub max) during a typical sampling period (e.g., 1-3 minutes), D(sub max) = C (where C is constant at values from 5 to 8 mm), and D(sub max) = M*D0 (where the constant multiple, M, is fixed at values ranging from 2.5 to 3.5). The overall objective of this NASA Global Precipitation Measurement Mission (GPM/PMM Science Team)-funded study is to document the sensitivity of DSD measurements, including estimates of D0, from C-band Z(sub dr) and reflectivity to this range of D(sub max) assumptions. For this study, GPM Ground Validation 2DVD's were operated under the scanning domain of the UAHuntsville ARMOR C-band dual-polarimetric radar. Approximately 7500 minutes of DSD data were collected and processed to create gamma size distribution parameters using a truncated method of moments approach. After creating the gamma parameter datasets the DSD's were then used as input to a T-matrix model for computation of polarimetric radar moments at C-band. All necessary model parameterizations, such as temperature, drop shape, and drop fall mode, were fixed at typically accepted values while the D(sub max) assumption was allowed to vary in sensitivity tests. By hypothesizing a DSD model with D(sub max) (fit) from which the empirical fit to D0 = F[Z(sub dr)] was derived via non-linear least squares regression and a separate reference DSD model with D(sub max) (truth), bias and standard error in D0 retrievals were estimated in the presence of Z(sub dr) measurement error and hypothesized mismatch in D(sub max) assumptions. Although the normalized standard error for D0 = F[Z(sub dr)r] can increase slightly (as much as from 11% to 16% for all 7500 DSDs) when the D(sub max) (fit) does not match D(sub max) (truth), the primary impact of uncertainty in D(sub max) is a potential increase in normalized bias error in D0 (from 0% to as much as 10% over all 7500 DSDs, depending on the extent of the mismatch between D(sub max) (fit) and D(sub max) (truth)). For DSDs characterized by large Z(sub dr) (Z(sub dr) > 1.5 to 2.0 dB), the normalized bias error for D0 estimation at C-band is sometimes unacceptably large (> 10%), again depending on the extent of the hypothesized D(sub max) mismatch. Modeled errors in D0 retrievals from Z(sub dr) at C-band are demonstrated in detail and comparedo similar modeled retrieval errors at S-band and X-band where the sensitivity to D(sub max) is expected to be less. The impact of D(sub max) assumptions to the retrieval of other DSD parameters such as Nw, the liquid water content normalized intercept parameter, are also explored. Likely implications for DSD retrievals using C-band polarimetric radar for GPM are assessed by considering current community knowledge regarding D(sub max) and quantifying the statistical distribution of Z(sub dr) from ARMOR over a large variety of meteorological conditions. Based on these results and the prevalence of C-band polarimetric radars worldwide, a call for more emphasis on constraining our observational estimate of D(sub max) within a typical radar resolution volume is made

Carey, Lawrence D.↗
NASA NTRS2023

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗
NASA NTRS2003

Mathematical Inversion of Lightning Data: Techniques and Applications

A survey of some interesting mathematical inversion studies dealing with radio, optical, and electrostatic measurements of lightning are presented. A discussion of why NASA is interested in lightning, what specific physical properties of lightning are retrieved, and what mathematical techniques are used to perform the retrievals are discussed. In particular, a relatively new multi-station VHF time-of-arrival (TOA) antenna network is now on-line in Northern Alabama and will be discussed. The network, called the Lightning Mapping Array (LMA), employs GPS timing and detects VHF radiation from discrete segments (effectively point emitters) that comprise the channel of lightning strokes within cloud and ground flashes. The LMA supports on-going ground-validation activities of the low Earth orbiting Lightning Imaging Sensor (LIS) satellite developed at NASA Marshall Space Flight Center (MSFC) in Huntsville, Alabama. The LMA also provides detailed studies of the distribution and evolution of thunderstorms and lightning in the Tennessee Valley, and offers interesting comparisons with other meteorological/geophysical datasets. In order to take full advantage of these benefits, it is essential that the LMA channel mapping accuracy (in both space and time) be fully characterized and optimized. A new channel mapping retrieval algorithm is introduced for this purpose. To characterize the spatial distribution of retrieval errors, the algorithm has been applied to analyze literally tens of millions of computer-simulated lightning VHF point sources that have been placed at various ranges, azimuths, and altitudes relative to the LMA network. Statistical results are conveniently summarized in high-resolution, color-coded, error maps.

Koshak, William↗