SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This paper serves as a brief overview of the AVIRIS instrument (Airborne Visible/Infrared Imaging Spectrometer) and its role in the field of imaging spectrometry. Mission planning and flight operations are discussed, and recommendations are given regarding the deployment of ground truth experiments.
This summary describes the 9 March 1994 TIMS airborne calibration experiment conducted at Castaic Lake, California. TIMS was flown on the NASA/ARC C-130 with the new retractable air fence installed in the TIMS instrument bay. The purpose of this experiment was to determine is the fence would reduce the air turbulence in the TIMS instrument bay, thereby reducing the errors in calibration caused by wind-blast cooling of the blackbody reference sources internal to TIMS. Previous experiments have indicated that the wind blast effect could cause TIMS to over-estimate surface temperatures by more than 10°C. A suite of twelve flight was designed to subject the TIMS/air fence system to different wind conditions and air temperatures. The TIMS flights were supported by a ground-truth team, who measured lake surface temperatures from a boat, and a atmosphere characterization team, who launched an airsonde and measured solar irradiance with a Reagan Sun Photometer.
Mars Pathfinder, one of the Discovery class missions (quick. low-cost projects with focused science objectives), will land a single spacecraft with a microrover and several instruments on the surface of Mars in 1997. Pathfinder will be the first mission to use a rover, carrying a chemical analysis instrument, to characterize the rocks and soils in a landing area over hundreds of square meters on Mars, which will provide a calibration point or ground truth for orbital remote sensing observations.
Image segmentation is one of the fundamental steps in computer vision. Separating targets from background clutter with high precision is a challenging operation for both humans and computers. Currently, segmenting objects from IR images is done by tedious manual work. The implementation of a Deep Neural Network (DNN) to perform precision segmentation of multi-band IR video images is presented. A customized pix2pix DNN with multiple layers of generative encoder/decoder and discriminator architecture is used in the IR image segmentation process. Real and synthetic images and ground truths are employed to train the DNN. Iterative training is performed to achieve optimum accuracy of segmentation using a minimal number of training data. Special training images are created to enhance the missing features and to increase the segmentation accuracy of the objects. Retraining strategies are developed to minimize the DNN training time. Single pixel accuracy has been achieved in IR target boundary segmentation using DNNs. The segmentation accuracy between the customized pix2pix DNN and simple thresholding, GraphCut, simple neural network and ResNet models are compared.
Laboratory study of hypervelocity spacecraft fragmentation has traditionally involved the collection and analysis of fragments that were caught in deceleration material surrounding the impact. This process has typically involved the disintegration of the catchment material either through chemical dissolution, or through physical excavation to recover the fragments. Due to the scale of the three impact tests—the Satellite Orbital Debris Characterization Impact Test (SOCIT), the DebriSat satellite impact test, and the DebrisLV launch vehicle impact test—the latter two using more than 12 cubic meters of polyurethane foam to capture the fragments, hese projects have used x-ray imagery to precisely locate and thus, to more efficiently extract fragments in the soft-catch material. Three years into the DebriSat fragment extraction process, a side study was initiated to explore what additional information could be discerned from the x-rays, with significant results. This study was instrumental to a rapid replacement and retooling as the project was forced to replace the x-ray system around which the extraction process had been based. The revised process continues to map the debris for extraction. The project has, in parallel, systematically addressed the limits/tolerances of what x-rays can reveal about size, shape, density, mass, velocity, energy, and deformation/damage of the fragment during the deceleration in the catchment material while replicating the original extraction mapping function. All of these features have been optimized or have sufficient understanding to characterize the basic factors that will define a complete data set extracted solely from x-ray imagery. It is an ideal time to develop such a process, with extracted fragments providing “ground truth” against image-only data, and abundant available imagery of the same fragments under both the prior and replacement x-ray technologies, which have several fundamentally different characteristics. This paper addresses the types and quality of hypervelocity fragmentation data that can be and has been extracted from x-rays. It further addresses the question of whether and under what circumstances future hypervelocity experiments can use x-ray methods to largely—or to completely—avoid the extraction process in recording all appropriate results. Lastly, this paper addresses lessons learned and how future efforts can be further optimized.
Origins: Return and analyze a sample of pristine carbonaceous asteroid regolith Spectral Interpretation: Provide ground truth for telescopic data of the entire asteroid population Resource Identification: Map the chemistry and mineralogy of a primitive carbonaceous asteroid Security: Measure the Yarkovsky effect on a potentially hazardous asteroid Regolith Explorer: Document the regolith at the sampling site at cm scale
The Aerosol Robotic Network (AERONET) has provided highly accurate, ground-truth measurements of the aerosol optical depth (AOD) using Cimel Electronique Sun–sky radiometers for more than 25 years. In Version 2 (V2) of the AERONET database, the near-real-time AOD was semiautomatically quality controlled utilizing mainly cloud-screening methodology, while additional AOD data contaminated by clouds or affected by instrument anomalies were removed manually before attaining quality-assured status (Level 2.0). The large growth in the number of AERONET sites over the past 25 years resulted in significant burden to the manual quality control of millions of measurements in a consistent manner. The AERONET Version 3 (V3) algorithm provides fully automatic cloud screening and instrument anomaly quality controls. All of these new algorithm updates apply to near-real-time data as well as post-field-deployment processed data, and AERONET reprocessed the database in 2018. A full algorithm redevelopment provided the opportunity to improve data inputs and corrections such as unique filter-specific temperature characterizations for all visible and near-infrared wavelengths, updated gaseous and water vapor absorption coefficients, and ancillary data sets. The Level 2.0 AOD quality-assured data set is now available within a month after post-field calibration, reducing the lag time from up to several months. Near-real-time estimated uncertainty is determined using data qualified as V3 Level 2.0 AOD and considering the difference between the AOD computed with the pre-field calibration and AOD computed with pre-field and post-field calibration. This assessment provides a near-real-time uncertainty estimate for which average differences of AOD suggest a +0.02 bias and one sigma uncertainty of 0.02, spectrally, but the bias and uncertainty can be significantly larger for specific instrument deployments. Long-term monthly averages analyzed for the entire V3 and V2 databases produced average differences (V3–V2) of +0.002 with a ±0.02 SD (standard deviation), yet monthly averages calculated using time-matched observations in both databases were analyzed to compute an average difference of −0.002 with a ±0.004 SD. The high statistical agreement in multiyear monthly averaged AOD validates the advanced automatic data quality control algorithms and suggests that migrating research to the V3 database will corroborate most V2 research conclusions and likely lead to more accurate results in some cases.
We present QuantifyML, which applies model counting to assess the learn ability, safety, and robustness of machine learning models. Typically, the efficacy of machine learning models is determined by computing their accuracy statistically on test datasets. However, this may be misleading, if the test data is not representative of the problem that is being studied. With QuantifyML we aim to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into aC program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise countsw.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, ex-pressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the safety and robustness of trained models.
The objective of the Scientific Physical and Operational Characterization (SPOC) project is to build an evidence-based description of terrestrial field science to inform the operational, physical, and tool requirements for planetary exploration extravehicular activities (xEVAs). EVAs of the future, including Artemis 2024 and beyond, intend to promote scientific productivity (e.g., LEAG science goals)[1]; however, no clear, objective pathway currently exists to enable this goal, particularly with respect to the desired increase in autonomy imparted to future astronauts. The SPOC project applies expertise in the fields of cognitive systems engineering [2-5], biomechanics, wearable sensors [6-8] and hardware/software to more targetly address these issues. In doing so, a terrestrial fieldwork ground-truth can be established that will benefit human and robotic exploration of other planetary surfaces.
In-situ atmospheric exploration of giant planets is a top priority of the planetary science community and NASA. The Galileo Probe a Jupiter made the first and only in-situ composition measurements of the atmosphere. Most importantly, the noble gas and isotopic ratio can be made only through in-situ measurements, and the Galileo Probe measurements must be followed up by similar measurements at Saturn, Uranus, and Neptune. In addition, abundances of condensable cloud-forming species are also needed to measure the vertical distribution of those molecules to provide ground-truths measurements for remote-sensing measurements. My talk will focus on the Small Next-generation Atmospheric Probe (SNAP) design developed in partnership by Hampton University and NASA Langley Research Center to enable delivery of multiple probes. Using SNAP as a reference design, I will also discuss key instrument trades and the state of the art in the atmospheric composition instruments.
The exploration of the lunar south polar region and the ground truthing of polar volatiles is one of the top priorities for several space agencies and private partners. Here we use Moon Mineralogy Mapper surficial water ice detections to investigate the location of water ice-bearing permanently shaded regions near the south pole. We extract a variety of parameters such as their temperature regime, slope, hydrogen content, number of ice detections, depth stability for water ice and dry ice, and mobility aspects. We identify 169 water ice-bearing PSRs and use their characteristics to identify sites that allow to access the highest abundances of volatiles, sites that can be visited to characterize the lateral or vertical distribution of volatiles (water ice and dry ice), and sites that allow for the fastest recovery of a scientifically interesting sample. Collectively, 37 PSRs are identified as sites of interest, including 11 that would address more than one mission objective and may be, for that reason, higher priority targets of exploration. These PSRs are found in Shoemaker, Faustini, Cabeus, Malapert, Nobile, Sverdrup, Wiechert J and Haworth craters, as well as 3 unnamed craters (PSRs 57, 120, 89). These sites are all located within 6 degrees of the south pole. We present case studies for a relatively short traverse mission (20 to 50 km) to PSR 89, a medium length traverse (~100 km) to Sverdrup 1, and a longer traverse (~300 km) to Cabeus that can serve as a guide in planning upcoming exploration missions.
In this study, we compare eight recently developed snow depth products over Arctic sea ice, which use satellite observations, modeling, or a combination of satellite and modeling approaches. These products are further compared against various ground-truth observations, including those from ice mass balance observations and airborne measurements. Large mean snow depth discrepancies are observed over the Atlantic and Canadian Arctic sectors. The differences between climatology and the snow products early in winter could be in part a result of the delaying in Arctic ice formation that reduces early snow accumulation, leading to shallower snowpacks at the start of the freeze-up season. These differences persist through spring despite overall more winter snow accumulation in the reanalysis-based products than in the climatologies. Among the products evaluated, the University of Washington (UW) snow depth product produces the deepest spring (March–April) snowpacks, while the snow product from the Danish Meteorological Institute (DMI) provides the shallowest spring snow depths. Most snow products show significant correlation with snow depths retrieved from Operational IceBridge (OIB) while correlations are quite low against buoy measurements, with no correlation and very low variability from University of Bremen and DMI products. Inconsistencies in reconstructed snow depth among the products, as well as differences between these products and in situ and airborne observations, can be partially attributed to differences in effective footprint and spatial–temporal coverage, as well as insufficient observations for validation/bias adjustments. Our results highlight the need for more targeted Arctic surveys over different spatial and temporal scales to allow for a more systematic comparison and fusion of airborne, in situ and remote sensing observations.
In engineering and aerospace applications, it is vital to operational success to have insight into the expected performance and health of physical systems. The field of prognostics and health management provides quantitative methods for monitoring, predicting, and managing system health. Prognostics algorithms can be employed to assess the current state of a system, propagate the system throughout time, and predict potential anomalies or failures that may occur. While they can provide accurate prediction results, effective prognostics algorithms can be challenging to use in resource-constrained settings due to computational limitations and high computational latency, leading to obsolete predictions. Thus, computationally efficient and accurate algorithms are necessary for future remaining useful life predictions. In this work, we implement new algorithmic approaches for prediction, quantitatively compare them via a battery degradation use-case, and provide recommendations of potential improvements to a prognostics framework. One approach to prediction is through sampling, whereby the current state of a physical system is sampled many times and each sample is propagated forward until failure is reached, resulting in a distribution of failure values. To improve the efficiency of this process, we implemented five new algorithmic approaches to prediction, including three distinct sampling methods (standard Monte Carlo, Quasi-Monte Carlo, and Latin Hypercube Sampling), a variable time step algorithm, and a variable sample size algorithm. To compare the algorithms, we employ a variety of metrics designed specifically to analyze both computational efficiency and model accuracy. Our metrics include accuracy to compare the average predicted value to ground truth, mean absolute deviation to illustrate dispersion, specific percentile error to describe accuracy within a user-defined risk tolerance, and code run-time. To quantitatively analyze our results, we employ a use-case of degradation of a Lithium-ion battery. We use an electrochemistry-based model to describe the current health state of the battery, and implement our prediction algorithms to propagate forward in time until end-of-discharge (EOD) is reached. Notably, through this work it was found that none of our sampling approaches had a significant impact on computational efficiency or model accuracy in predicting EOD of the battery. We find that while the sampling methods are unique, the distributions they generate are similar, ultimately producing final predictions that are nearly identical. In exploring the effect of the time step within the prediction algorithm, we found that prediction accuracy was highly dependent on the time step used, and that implementing a variable time step within a particular prediction may provide an increase in computational efficiency while also maintaining prediction accuracy. Finally, implementing a variable sample size also affected prediction, and our results show that tuning both the magnitude and timing of the sample size adjustment can result in improved computation speed and maintained prediction accuracy. Taken together, our findings highlight the challenge of performing prognostics in resource-constrained settings, and illustrate the potential of developing new prediction algorithms to improve computational efficiency.
One of the observational parameters of interest in ground-based optical measurements is ascertaining material properties using broadband filter photometry and spectroscopy for orbiting targets. Broadband photometry can provide reflectance measurements that can aid in color-color indices and assess if objects can be classified into families or taxonomies. However, these reflectance properties can vary due to aspect angle, phase angle, and general degradation of the target’s exterior material. Spectral characterization can aid in material characterization utilizing known absorption bands and spectra signatures, but these signatures are affected by the same conditions described for remote observations. When utilizing ground-based measurements, it is well understood that material characterization is subject to variability due to space weathering and/or other external events (i.e., collision or explosion). The focus of this study is on space weathering effects on spacecraft materials in low Earth orbit. To better assess how materials are affected by the harsh space environment, specifically modern materials, a collection of materials was analyzed in both its pristine condition and after electron bombardment. This sample collection is part of an upcoming mission with the Materials International Space Station Experiment Flight Facility (MISSE-FF) that will be launched in 2022. These laboratory analyses on the samples will provide a ground truth to compare with the in-situ collected data. The data will also be stored in the NASA Johnson Space Center’s Spacecraft Materials Spectral Database that is available to U. S. citizens and maintained by the Orbital Debris Program Office. The following paper provides an overview of the materials investigated, laboratory and database overview, and spectral results for both pristine and post-electron exposed conditions. The spectral signature data highlights which materials are stable, or remain relatively unchanged, and which materials vary significantly due to exposure and material configuration (variations due to rotation of the sample on a flat surface). Initial results on changes in spectral directional reflectance of the materials as a function of incident illumination direction are also presented. This data also will benefit the space situational awareness community with spectral characterization of novel materials that can support their respective optical measurements focused on material identification.
Abstract—The autonomous approach of a spacecraft to an asteroid or comet (a small body) relies heavily on visual feature tracking to aid in estimating relative trajectories and the properties of the small body. Feature tracking for small bodies brings several challenges, including changing lighting, poor visual texture, and a concentration of features in a small part of an image. Six existing, open-source algorithms for feature tracking were tested on a simulated dataset and compared to the ground truth in the path of features. The main finding is that none of the algorithms provide all of the desired characteristics of long feature tracks with low errors and few outliers. Instead, there is a trade-off between long feature tracks and low error. The feature-matching algorithms SIFT, and BRISK provide good error characteristics, but short feature tracks, whereas the optical flow algorithm KLT provides long feature tracks, but with many features of large error. Given the challenges in feature tracking, it is recommended to focus development on each component of a feature tracking system: detection, description, and outlier rejection.
Future lander missions will travel to ambitious, scientifically interesting locations near rough and dangerous terrain. They will need to operate with limited prior information about the terrain, and under varying lighting conditions. Landing safely and precisely in the face of these challenges is difficult for existing vision-based landing systems, which require detailed orbital reconnaissance, a priori hazard maps, and impose time-of-day restrictions on landing to ensure similar lighting conditions in orbital and descent imagery. Advanced 3D imaging LiDAR systems currently under development, and originally intended for single-scan hazard detection, have the potential to be operated continuously from altitudes of up to 5 km. Used together with existing inertial measurement units (IMUs), these sensors open a path-to-flight for a full navigation and mapping system, which could replace or augment a traditional landing sensor suite. A landing system based around these sensors can perform accurate altimetry, map-relative localization (MRL), LiDAR-inertial odometry, and map refinement in an illumination-insensitive manner, over unknown or partially known terrain. This paper outlines preliminary work on a LiDAR-inertial landing system that: estimates the spacecraft trajectory during entry, descent, and landing (EDL); and maps the topography of the terrain below, for future use in hazard detection and avoidance. An incremental, factor graph based, smoothing approach is used to solve for the maximum a posteriori trajectory of spacecraft states. Integrated IMU measurements and features tracked in adjacent range and intensity images are used to estimate motion (LiDAR-inertial odometry). LiDAR scans are binned into motion-corrected digital elevation models (DEMs), which are matched to an existing orbital topographic map to provide absolute position information (MRL). The estimated trajectory is then used to project the LiDAR scans into the map frame, creating a variable-resolution quadtree topographic map suitable for hazard detection and avoidance. Existing topographic maps from throughout the solar system (i.e., Earth, the Moon, Mars, Ceres, Vesta, Europa, Enceladus, and Eros) are upsampled for use in EDL simulations. The Mars 2020 Lander Vision System Simulator (LVSS) is extended to simulate LiDAR-inertial data for realistic EDL trajectories. Results of the algorithm operating on the simulated data are presented. Estimated spacecraft trajectory and refined map are compared to ground truth to assess estimation accuracy.
A potential Mars Sample Return (MSR) architecture is being jointly studied by NASA and ESA. As currently envisioned, the MSR campaign consists of a series of 3 missions: sample cache, fetch and return to Earth. In this paper, we focus on the fetch part of the MSR, and more specifically the problem of autonomously detecting and localizing sample tubes deposited on the Martian surface. Towards this end, we study two machine-vision based approaches: First, a geometrydriven approach based on template matching that uses hardcoded filters and a 3D shape model of the tube; and second, a data-driven approach based on convolutional neural networks (CNNs) and learned features. Furthermore, we present a large benchmark dataset of sample-tube images, collected in representative outdoor environments and annotated with ground truth segmentation masks and locations. The dataset was acquired systematically across different terrain, illumination conditions and dust-coverage; and benchmarking was performed to study the feasibility of each approach, their relative strengths and weaknesses, and robustness in the presence of adverse environmental conditions.
This paper presents preliminary simulations andanalyses done to assess the feasibility of performing Map RelativeLocalization (MRL) with the Europa Lander LiDAR beingdeveloped for the Europa Lander Pre-Phase A concept. MapRelative Localization is the process of determining the horizontalposition of a lander with respect to an onboard, a-priori map,by comparing the map to sensor observations of the terrain duringdeorbit, descent, and landing (DDL). Although kilometerscaleposition knowledge is commonly available during DDL,landing in hazard-rich environments requires position errors of100 m or less. Prior knowledge in the case of Europa Landerwill be visual and topographic maps collected by the upcomingEuropa Clipper mission. The Mars 2020 Lander Vision System(LVS) uses images from a camera to localize with respect tovisual maps. This technology, as well as a 3D imaging LiDAR indevelopment for hazard detection, is currently baselined for theEuropa Lander Pre-Phase A concept. This paper investigatesthe potential use of the hazard detection LiDAR to performMRL with respect to a 3D digital elevation model (DEM)provided by the Europa Clipper mission, as an alternative orbackup solution to passive optical MRL. Compared to passiveoptical MRL, one advantage of LiDAR-based localization isthat it is insensitive to lighting conditions, potentially relaxingrequirements on synchronizing map acquisition and landingtime of day. To analyze LiDAR based MRL performance,six representative terrains are synthetically up-sampled fromGalileo-derived maps of Europa to a resolution of 0.5 m/pxand covering an area of 4 km by 4 km. These maps are usedas ground-truth to generate simulated noisy a-priori onboardtopographic maps expected from Europa Clipper as well assimulated LiDAR DEMs generated at an altitude of 5 km duringEuropa Lander DDL. The simulated LiDAR DEM is matchedagainst the simulated map via 2D normalized cross-correlation,exploiting the accurately known spacecraft attitude to avoidthe need for more computationally intensive algorithms such asIterative Closest Point (ICP). Two sources of measurement errorare identified for analysis: 1) additive Gaussian noise in therange measurements from the Europa Lander LiDAR and theEuropa Clipper derived maps and 2) errors in the LiDAR DEMinduced by errors in the Europa Lander state estimate which isused to de-warp the LiDAR scan data into a DEM format. Weassess the effect of each of these types of errors independently onmatching performance as well as the overall performance whenall types of error are introduced. Additionally, we present theresult of a sensitivity study to terrain frequency content.