Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Extension and Statistical Analysis of the GACP Aerosol Optical Thickness Record.

The primary product of the Global Aerosol Climatology Project (GACP) is a continuous record of the aerosol optical thickness (AOT) over the oceans. It is based on channel-1 and -2 radiance data from the Advanced Very High Resolution Radiometer (AVHRR) instruments flown on successive National Oceanic and Atmospheric Administration (NOAA) platforms. We extend the previous GACP dataset by four years through the end of 2009 using NOAA-17 and -18 AVHRR radiances recalibrated against MODerate resolution Imaging Spectroradiometer (MODIS) radiance data, thereby making the GACP record almost three decades long. The temporal overlap of over three years of the new NOAA-17 and the previous NOAA-16 record reveals an excellent agreement of the corresponding global monthly mean AOT values, thereby confirming the robustness of the vicarious radiance calibration used in the original GACP product. The temporal overlap of the NOAA-17 and -18 instruments is used to introduce a small additive adjustment to the channel-2 calibration of the latter resulting in a consistent record with increased data density. The Principal Component Analysis (PCA) of the newly extended GACP record shows that most of the volcanic AOT variability can be isolated into one mode responsible for ~12% of the total variance. This conclusion is confirmed by a combined PCA analysis of the GACP, MODIS, andMulti-angle Imaging SpectroRadiometer (MISR) AOTs during the volcano-free period fromFebruary 2000 to December 2009.We show that the modes responsible for the tropospheric AOT variability in the three datasets agree well in terms of correlation and spatial patterns. A previously identified negative AOT trend which started in the late 1980s and continued into the early 2000s is confirmed. Its magnitude and duration indicate that it was caused by changes in tropospheric aerosols. The latest multi-satellite segment of the GACP record shows that this trend tapered off, with no noticeable AOT change after 2002. This result is consistent with the MODIS andMISR AOT records as well as with the recent gradual reversal frombrightening to dimming revealed by surface flux measurements in many aerosol producing regions. Thus the robustness of the GACP record is confirmed, increasing our confidence in the validity of the negative trend. Although the nominal negative GACP AOT trend could partially be an artifact of increasing aerosol absorption, we argue that the time dependence of the GACP record, including the latest flat period, is more consistent with the actual decrease in the tropospheric AOT.

aerosols↗

Technology for large digital mosaics of Landsat data

Procedures and software for the digital mosaicking of Landsat data are discussed. It is noted that image processing in support of JPL's planetary program has furnished the software and procedures necessary to achieve digital image mosaicking of vidicon imagery using rigid projective geometry. The incorporation of ground-control points, by either manual or automatic ground-control point file identification, has yielded rms positional accuracies exceeding the National Map Accuracy Standards. Rotation to north vertical is effected at low computational cost. It is possible to cut input data frames in any arbitrary shape to remove cloud cover and accommodate terrain offset effects. In similar fashion, the final digital mosaic can be segmented arbitrarily to conform to user requirements. Information is presented on applications in Pennsylvania and Bolivia.

Zobrist, A. L.↗

DeepSAT: A Deep Learning Approach to Tree-Cover Delineation in 1-m NAIP Imagery for the Continental United States

High resolution tree cover classification maps are needed to increase the accuracy of current land ecosystem and climate model outputs. Limited studies are in place that demonstrates the state-of-the-art in deriving very high resolution (VHR) tree cover products. In addition, most methods heavily rely on commercial softwares that are difficult to scale given the region of study (e.g. continents to globe). Complexities in present approaches relate to (a) scalability of the algorithm, (b) large image data processing (compute and memory intensive), (c) computational cost, (d) massively parallel architecture, and (e) machine learning automation. In addition, VHR satellite datasets are of the order of terabytes and features extracted from these datasets are of the order of petabytes. In our present study, we have acquired the National Agriculture Imagery Program (NAIP) dataset for the Continental United States at a spatial resolution of 1-m. This data comes as image tiles (a total of quarter million image scenes with ~60 million pixels) and has a total size of ~65 terabytes for a single acquisition. Features extracted from the entire dataset would amount to ~8-10 petabytes. In our proposed approach, we have implemented a novel semi-automated machine learning algorithm rooted on the principles of "deep learning" to delineate the percentage of tree cover. Using the NASA Earth Exchange (NEX) initiative, we have developed an end-to-end architecture by integrating a segmentation module based on Statistical Region Merging, a classification algorithm using Deep Belief Network and a structured prediction algorithm using Conditional Random Fields to integrate the results from the segmentation and classification modules to create per-pixel class labels. The training process is scaled up using the power of GPUs and the prediction is scaled to quarter million NAIP tiles spanning the whole of Continental United States using the NEX HPC supercomputing cluster. An initial pilot over the state of California spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles has produced true positive rates of around 88 percent for fragmented forests and 74 percent for urban tree cover areas, with false positive rates lower than 2 percent for both landscapes.

Imagery↗

Focused Assessment with Sonography for Trauma in weightlessness: a feasibility study

BACKGROUND: The Focused Assessment with Sonography for Trauma (FAST) examines for fluid in gravitationally dependent regions. There is no prior experience with this technique in weightlessness, such as on the International Space Station, where sonography is currently the only diagnostic imaging tool. STUDY DESIGN: A ground-based (1 g) porcine model for sonography was developed. We examined both the feasibility and the comparative performance of the FAST examination in parabolic flight. Sonographic detection and fluid behavior were evaluated in four animals during alternating weightlessness (0 g) and hypergravity (1.8 g) periods. During flight, boluses of fluid were incrementally introduced into the peritoneal cavity. Standardized sonographic windows were recorded. Postflight, the video recordings were divided into 169 20-second segments for subsequent interpretation by 12 blinded ultrasonography experts. Reviewers first decided whether a video segment was of sufficient diagnostic quality to analyze (determinate). Determinate segments were then analyzed as containing or not containing fluid. A probit regression model compared the probability of a positive fluid diagnosis to actual fluid levels (0 to 500 mL) under both 0-g and 1.8-g conditions. RESULTS: The in-flight sonographers found real-time scanning and interpretation technically similar to that of terrestrial conditions, as long as restraint was maintained. On blinded review, 80% of the recorded ultrasound segments were considered determinate. The best sensitivity for diagnosis in 0 g was found to be from the subhepatic space, with probability of a positive fluid diagnosis ranging from 9% (no fluid) to 51% (500 mL fluid). CONCLUSIONS: The FAST examination is technically feasible in weightlessness, and merits operational consideration for clinical contingencies in space.

NASA Discipline Life Sciences Technologies↗

NASA Tech Briefs, April 2006

The topics covered include: 1) Replaceable Sensor System for Bioreactor Monitoring; 2) Unitary Shaft-Angle and Shaft-Speed Sensor Assemblies; 3) Arrays of Nano Tunnel Junctions as Infrared Image Sensors; 4) Catalytic-Metal/PdO(sub x)/SiC Schottky-Diode Gas Sensors; 5) Compact, Precise Inertial Rotation Sensors for Spacecraft; 6) Universal Controller for Spacecraft Mechanisms; 7) The Flostation - an Immersive Cyberspace System; 8) Algorithm for Aligning an Array of Receiving Radio Antennas; 9) Single-Chip T/R Module for 1.2 GHz; 10) Quantum Entanglement Molecular Absorption Spectrum Simulator; 11) FuzzObserver; 12) Internet Distribution of Spacecraft Telemetry Data; 13) Semi-Automated Identification of Rocks in Images; 14) Pattern-Recognition Algorithm for Locking Laser Frequency; 15) Designing Cure Cycles for Matrix/Fiber Composite Parts; 16) Controlling Herds of Cooperative Robots; 17) Modification of a Limbed Robot to Favor Climbing; 18) Vacuum-Assisted, Constant-Force Exercise Device; 19) Production of Tuber-Inducing Factor; 20) Quantum-Dot Laser for Wavelengths of 1.8 to 2.3 micron; 21) Tunable Filter Made From Three Coupled WGM Resonators; and 22) Dynamic Pupil Masking for Phasing Telescope Mirror Segments.

Source record↗

Low-dose high-resolution $\mathrm{TOF}$-$\mathrm{PET}$ using ionization-activated multi-state low-$\mathrm{Z}$ detector media

We propose PET scanners using low atomic number media that undergo a persistent local change of state along the paths of the Compton recoil electrons. Measurement of the individual scattering locations and angles, deposited energies, and recoil electron directions allows using the kinematical constraints of the 2-body Compton scattering process to perform a statistical time-ordering of the scatterings, with a high probability of precisely identifying where the gamma first interacted in the detector. In these cases the Line-of-Response is measured with high resolution, determined by the underlying physics processes and not the detector segmentation. There are multiple such media that act through different mechanisms. As an example in which the change of state is quantum-mechanical through a change in molecular configuration, rather than thermodynamic, as in a bubble chamber, we present simulations of a two-state photoswitchable organic dye, a ‘Switchillator’, that is activated to a fluorescent-capable state by the ionization of the recoil electrons. The activated state is persistent, and can be optically excited multiple times to image individual activated molecules. Energy resolution is provided by counting the activated molecules. Location along the LOR is implemented by large-area time-of-flight MCP-PMT photodetectors with single photon time resolution in the tens of ps and sub-mm spatial resolution. Simulations indicate a large reduction of dose.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Fracture Description of the HFTS-2 Slant Core, Delaware Basin, West Texas

Previous work in the Midland Basin Hydraulic Fracture Test Site project (HFTS1) has shown the value of core recovered from a stimulated volume in providing information on the geometry and extent of hydraulic fractures. This project (HFTS2) is in the Wolfcamp Formation of the Delaware Basin. A slant core through the stimulated volume was acquired above and below a stimulated well and the results of the fracture description are presented here. Here, nine, 3-inch-diameter whole cores from the slant well were examined for fractures prior to slabbing, together with a CT scan of the core. We used criteria developed during the HFTS1 project to identify hydraulic, natural, drilling-induced and core-handling fractures. Material collected from a few fracture faces was cleaned, sieved, and examined under a microscope to look for proppant. A total of 1261 fractures, including 500 hydraulic fractures, were described in 948 feet of core. Hydraulic fractures are not evenly distributed through the cores; they tend to occur in clusters. Many are remarkably planar, smooth, and featureless, while others have twist hackles, steps, plumose, and kinks. Natural, subvertical fractures, mostly less than 1 mm in width, sealed with blocky calcite, are oriented NE-SW (Set 1) and WNW-ESE (Set 2). Two Set 1 fractures have drusy cement on parted faces and were possibly open prior to drilling. A few subvertical sealed fractures with different orientations are also present. Bed-parallel natural fractures, most having fibrous cement (beef), and some showing top-to-north bed-parallel shear are present. Faults with normal/oblique movement were found in one part of the core. Drilling induced and core-handling breaks were identified in all cores, and were also noted to have reactivated some natural fractures. The results from this work will allow hydraulic fracture distribution relative to the stimulated well to be assessed. The number of fractures is generally greater than the number of perforations, but these can be compared for different stages and perforation clusters. Surface features provide information about the direction of hydraulic fracture propagation and about segmentation and bifurcation that might increase the number of fracture strands. Reactivation of natural fractures, including bedding-parallel fractures, occurs although the mechanism of parting is mostly unknown. The wider HFTS2 project will make use of this fracture description to improve hydraulic fracture modeling (geomechanics and engineering), to help explain pressure depletion and fiber optics observations (reservoir depletion and frac geometry), to help verify indirect fracture diagnostic techniques such as microseismic monitoring (geophysics), and to help calibrate horizontal well image logs.

58 GEOSCIENCES↗

Onboard Processor for Compressing HSI Data

With EO-1 Hyperion and MightySat in orbit NASA and the DoD are showing their continued commitment to hyperspectral imaging (HSI). As HSI sensor technology continues to mature, the ever-increasing amounts of sensor data generated will result in a need for more cost effective communication and data handling systems. Lockheed Martin, with considerable experience in spacecraft design and developing special purpose onboard processors, has teamed with Applied Signal & Image Technology (ASIT), who has an extensive heritage in HSI, to develop a real-time and intelligent onboard processing (OBP) system to reduce HSI sensor downlink requirements. Our goal is to reduce the downlink requirement by a factor greater than 100, while retaining the necessary spectral fidelity of the sensor data needed to satisfy the many science, military, and intelligence goals of these systems. Our initial spectral compression experiments leverage commercial-off-the-shelf (COTS) spectral exploitation algorithms for segmentation, material identification and spectral compression that ASIT has developed. ASIT will also support the modification and integration of this COTS software into the OBP. Other commercially available COTS software for spatial compression will also be employed as part of the overall compression processing sequence. Over the next year elements of a high-performance reconfigurable OBP will be developed to implement proven preprocessing steps that distill the HSI data stream in both spectral and spatial dimensions. The system will intelligently reduce the volume of data that must be stored, transmitted to the ground, and processed while minimizing the loss of information.

Cook, Sid↗

GPM Microwave Imager Engineering Model Results

The Global Precipitation Measurement (GPM) Microwave Imager (GMI) Instrument is being developed by Ball Aerospace and Technology Corporation (BATC) for the GPM program at NASA Goddard. The Global Precipitation Measurement (GPM) mission is an international effort managed by the National Aeronautics and Space Administration (NASA) to improve climate, weather, and hydro-meteorological predictions through more accurate and more frequent precipitation measurements. The GPM Microwave Imager (GMI) will be used to make calibrated, radiometric measurements from space at multiple microwave frequencies and polarizations. GMI will be placed on the GPM Core Spacecraft together with the Dualfrequency Precipitation Radar (DPR). The DPR is two-frequency precipitation measurement radar, which will operate in the Ku-band and Ka-band of the microwave spectrum. The Core Spacecraft will make radiometric and radar measurements of clouds and precipitation and will be the central element ofGPM's space segment. The data products from GPM will provide information concerning global precipitation on a frequent, near-global basis to meteorologists and scientists making weather forecasts and performing research on the global energy and water cycle, precipitation, hydrology, and related disciplines. In addition, radiometric measurements from GMI and radar measurements from the DPR will be used together to develop a retrieval transfer standard for the purpose of calibrating precipitation retrieval algorithms. This calibration standard will establish a reference against which other retrieval algorithms using only microwave radiometers (and without the benefit of the DPR) on other satellites in the GPM constellation will be compared.

Newell, David↗

Experimental Observations of Damage States in Unnotched and Notched 3D Orthogonal Woven Coupons Loaded in Tension

This paper describes a series of unnotched and notched tensile tests on two 3D orthogonal woven architectures loaded in the warp direction. Dogbone specimens were used for the unnotched tests, and open-hole specimens were used for the notched tests. For each architecture and test type, two specimens were loaded under monotonic displacement control to failure, and two specimens were incrementally loaded to failure in five steps. X-ray computed tomography (CT) was used to characterize the woven architecture and defects on each specimen prior to testing. Digital image correlation (DIC) images were obtained from both sides of the specimen throughout the loading and unloading. For the incremental tests, X-ray CT was used to document the damage progression after each load increment. The results for both architectures and test specimens followed a similar pattern where matrix cracks formed perpendicular to the load direction and were primarily located between the stacks of warp tows. Two-piece failure path always occurred perpendicular to the loading direction, along the through-thickness segments of the Z-tows. The combination of stress concentrations due to the specimen geometry, weave geometry, and cut tows created stress concentrations that appear to initiate failure.

Woven materials↗

Insights Into Thermal Runaway Mechanisms: Fast Tomography Analysis of Metal Agglomerates in Lithium-Ion Batteries

Thermal Runaway (TR) in lithium-ion batteries (LIB) is a critical technological and social concern. Whilst such events are rare, TR is characterized by uncontrollable heating leading to catastrophic failures. To deepen the understanding of the failure process and subsequently develop more accurate TR prediction models and as a result safer battery systems, we present in this work high-speed X-ray tomography for in-depth investigations of the copper current collector melting and agglomeration during TR. The melting process presents valuable real-time internal information about heat evolution during TR, previously challenging to access but crucially important for validating TR models. In this work, controlled failure studies combined with high-speed X-ray tomography were performed on two different commercial LIB models, subjecting them to both external heating and nail penetration to induce TR. Through real-time observation via high-speed tomography, followed by segmentation, rendering, and analysis, the formation of copper agglomerates was qualitatively and quantitatively characterized and visualized for the first time. Agglomerates tended to form either from the battery's outermost layers or centrally, depending on the method of TR initiation, and gives an indirect insight into the internal temperature evolution and distribution. Moreover, an initial comparative analysis between the battery models also revealed differences in agglomerate size, which has been linked to the thicker copper current collectors of one of the cell models. We further discuss the impact of larger copper agglomerates on heat distribution and safety. This study not only sheds light on the intricate dynamics of TR in LIBs but also underscores the pivotal role of 'gold-standard' imaging techniques in advancing battery safety, crucial for the robust modeling of TR and the future design of electric vehicle safety systems.

25 ENERGY STORAGE↗

Field size, length, and width distributions based on LACIE ground truth data

The development of agricultural remote sensing systems requires knowledge of agricultural field size distributions so that the sensors, sampling frames, image interpretation schemes, registration systems, and classification systems can be properly designed. Malila et al. (1976) studied the field size distribution for wheat and all other crops in two Kansas LACIE (Large Area Crop Inventory Experiment) intensive test sites using ground observations of the crops and measurements of their field areas based on current year rectified aerial photomaps. The field area and size distributions reported in the present investigation are derived from a representative subset of a stratified random sample of LACIE sample segments. In contrast to previous work, the obtained results indicate that most field-size distributions are not log-normally distributed. The most common field size observed in this study was 10 acres for most crops studied.

Pitts, D. E.↗

Comparative Study of 3-Dimensional Woven Joint Architectures for Composite Spacecraft Structures

The National Aeronautics and Space Administration (NASA) Exploration Systems Mission Directorate initiated an Advanced Composite Technology (ACT) Project through the Exploration Technology Development Program in order to support the polymer composite needs for future heavy lift launch architectures. As an example, the large composite structural applications on Ares V inspired the evaluation of advanced joining technologies, specifically 3D woven composite joints, which could be applied to traditionally manufactured barrel segments. Implementation of these 3D woven joint technologies may offer enhancements in damage tolerance without sacrificing weight. However, baseline mechanical performance data is needed to properly analyze the joint stresses and subsequently design/down-select a preform architecture. Six different configurations were designed and prepared for this study; each consisting of a different combination of warp/fill fiber volume ratio and preform interlocking method (z-fiber, fully interlocked, or hybrid). Tensile testing was performed for this study with the enhancement of a dual camera Digital Image Correlation (DIC) system which provides the capability to measure full-field strains and three dimensional displacements of objects under load. As expected, the ratio of warp/fill fiber has a direct influence on strength and modulus, with higher values measured in the direction of higher fiber volume bias. When comparing the z-fiber weave to a fully interlocked weave with comparable fiber bias, the z-fiber weave demonstrated the best performance in two different comparisons. We report the measured tensile strengths and moduli for test coupons from the 6 different weave configurations under study.

Jones, Justin S.↗

GPM Microwave Imager Design, Predicted Performance and Status

The Global Precipitation Measurement (GPM) Microwave Imager (GMI) Instrument is being developed by Ball Aerospace and Technology Corporation (BATC) for the GPM program at NASA Goddard. The Global Precipitation Measurement (GPM) mission is an international effort managed by the National Aeronautics and Space Administration (t.JASA) to improve climate, weather, and hydro-meteorological predictions through more accurate and more frequent precipitation measurements. The GPM Microwave Imager (GMI) will be used to make calibrated, radiometric measurements from space at multiple microwave frequencies and polarizations. GMI will be placed on the GPM Core Spacecraft together with the Dual-frequency Precipitation Radar (DPR). The DPR is two-frequency precipitation measurement radar, which will operate in the Ku-band and Ka-band of the microwave spectrum. The Core Spacecraft will make radiometric and radar measurements of clouds and precipitation and will be the central element of GPM's space segment. The data products from GPM will provide information concerning global precipitation on a frequent, near-global basis to meteorologists and scientists making weather forecasts and performing research on the global energy and water cycle, precipitation, hydrology, and related disciplines. In addition, radiometric measurements from GMI and radar measurements from the DPR will be used together to develop a retrieval transfer standard for the purpose of calibrating precipitation retrieval algorithms. This calibration standard will establish a reference against which other retrieval algorithms using only microwave radiometers (and without the benefit of the DPR) on other satellites in the GPM constellation will be compared.

Krimchansky, Sergey↗

LIPA: Lunar Ice Perception Algorithm

Introduction: The highest concentration of Lu-nar water-ice stores exists within the Permanently Shadowed Regions (PSRs) of the Lunar South Pole [1-3]. As such, the ability to locate in situ water-ice stores in an accurate, systematic, and safe manner will prove vital for future Lunar activities which rely on hydrogen-based resources. Here we show how the strong absorptive properties of ice can be exploited so that surface ice located in PSRs can be easily differentiated from the surrounding frozen regolith. Testbeds which simulate an icy lunar landscape were created and then systematically imaged using a mid-wave infrared (MWIR) camera system. Testbeds were imaged under two filter modes (1) high-absorption (high-abs) mode: whereby imagery captured were confined to a single central wave-length (CWL) of 3.15 ± 0.03 μm and (2) low-absorption (low-abs) mode: whereby imagery cap-tured were confined to a single CWL of 3.80 ± 0.04 μm (Figure 1). High- and low-absorption modes are related to the absorptive properties of ice at each selected wavelength, respectively. Corresponding images from each filter mode were differenced (i.e., pixels were subtracted) to enhance contrast between ice-bearing and non-ice-bearing pixels, and then fed into a semantic segmen-tation model. The model was trained to detect and differentiate between water, ice, shadows, and lunar regolith. Results: Modeling results accurately discrimi-nated ice from other materials (such as frozen lunar regolith) and were used to visually resolve the spa-tial extent of surface ice. Further, outputs produced through semantic segmentation were used to estimate water-ice contents in collected imagery [(Pixels with Class = “Water Ice”)/(Sum of Pixels)*100]. Summary: These works prove promising for future in situ resource utilization (ISRU) missions which employ robotics in combination with infrared camera systems to advance science objectives (e.g., locate water-ice in frozen regolith) on the lunar sur-face. References: [1] Cannon K. M., Deutsch A. N., Head J. W., and Britt D. T. (2020) Geophysical Re-search Letters, 46, e2020GL088920. [2] Honniball C. I. et al. (2021) Nature Astronomy 5, no. 2, 121-127. [3] Li S. et al. (2018) Proceedings of the National Academy of Sciences, 115(36), 8907-8912.

A. Slabic↗

Extensions of algebraic image operators: An approach to model-based vision

Researchers extend their previous research on a highly structured and compact algebraic representation of grey-level images which can be viewed as fuzzy sets. Addition and multiplication are defined for the set of all grey-level images, which can then be described as polynomials of two variables. Utilizing this new algebraic structure, researchers devised an innovative, efficient edge detection scheme. An accurate method for deriving gradient component information from this edge detector is presented. Based upon this new edge detection system researchers developed a robust method for linear feature extraction by combining the techniques of a Hough transform and a line follower. The major advantage of this feature extractor is its general, object-independent nature. Target attributes, such as line segment lengths, intersections, angles of intersection, and endpoints are derived by the feature extraction algorithm and employed during model matching. The algebraic operators are global operations which are easily reconfigured to operate on any size or shape region. This provides a natural platform from which to pursue dynamic scene analysis. A method for optimizing the linear feature extractor which capitalizes on the spatially reconfiguration nature of the edge detector/gradient component operator is discussed.

Lerner, Bao-Ting↗

Nonstandard representations of aspheric surfaces in a telescope design

Space-based telescopes for sub-mm astronomy may require large, segmented primary mirrors. While spherical segments are the easiest to manufacture and test, a fast sphere produces large aberrations which must be corrected by one or more aspheric surfaces. Attention is presently given to an f/10 system with an f/0.7 spherical primary mirror and a field of view of + or - 1.5 min of arc. The third and fourth mirrors are conics, and the secondary is a 24th-degree power series on a base sphere. For sub-mm astronomy, a reasonable target for this design is a diffraction-limited image at 30 microns. In an effort to improve performance, the Wassermann-Wolf (1949) approach to aspheric design was applied.

Rodgers, J. M.↗

Learning instrument invariant characteristics for generating high-resolution global coral reef maps

Coral reefs are one of the most biologically complex and diverse ecosystems within the shallow marine environment. Unfortunately, these underwater ecosystems are threatened by a number of anthropogenic challenges, including ocean acidification and warming, overfishing, and the continued increase of marine debris in oceans. This requires a comprehensive assessment of the world's coastal environments, including a quantitative analysis on the health and extent of coral reefs and other associated marine species, as a vital Earth Science measurement. However, limitations in observational and technological capabilities inhibit global sustained imaging of the marine environment. Harmonizing multimodal data sets acquired using different remote sensing instruments presents additional challenges, thereby limiting the availability of good quality labeled data for analysis. In this work, we develop a deep learning model for extracting domain invariant features from multimodal remote sensing imagery and creating high-resolution global maps of coral reefs by combining various sources of imagery and limited hand-labeled data available for certain regions. This framework allows us to generate, for the first time, coral reef segmentation maps at 2-meter resolution, which is a significant improvement over the kilometer-scale state-of-the-art maps. Additionally, this framework doubles accuracy and IoU metrics over baselines that do not account for domain invariance.

Domain Adaptation↗