Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sensor selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Integrated System for Methane Emissions Monitoring, Mapping, and Quantification

This report presents the work completed under the DOE iM4 project for the development of a methane emission monitoring system for detection, location, and quantification of methane in oil and gas industries. The task was divided into four main areas including: 1) Sensors and Input, 2) Centralized Cloud Information Center, 3) Algorithms, and 4) Testing and Validation. Task 1 focused on researching and developing an understanding of the current, or soon to be, available methane sensing technologies. Task 2 consisted of developing the architecture, selecting hardware, software and elements for the methane monitoring system. Task 3 focused on the algorithms used for the complex inverse model of going from measured methane signatures to the detection, localization, and quantification of sources that are desired. Finally, Task 4 focused on the methods of testing and validating the operation of the system. Attention was also given to the development method and cost breakdown of the system.

03 NATURAL GAS↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, AD model validation through real-world sensor data is important for applications in nuclear facilities. In this paper, we propose an Autoencoder (AE)—a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD)—as another AD scheme for identifying irregularities withinthe same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Background-Aware 3-D Point Cloud Segmentation With Dynamic Point Feature Aggregation

With the proliferation of LiDAR sensors and 3-D vision cameras, 3-D point cloud analysis has attracted significant attention in recent years. In this article, we propose a novel 3-D point cloud learning network, referred to as dynamic point feature aggregation network (DPFA-Net), by selectively performing the neighborhood feature aggregation (FA) with dynamic pooling and an attention mechanism. DPFA-Net has two variants for semantic segmentation and classification of 3-D point clouds. As the core module of the DPFA-Net, we propose an FA layer, in which features of the dynamic neighborhood of each point are aggregated via a self-attention mechanism. In contrast to other segmentation models, which aggregate features from fixed neighborhoods, our approach can aggregate features from different neighbors in different layers providing a more selective and broader view to the query points and focusing more on the relevant features in a local neighborhood. In addition, to further improve the performance of semantic segmentation, we exploit the background–foreground (BF) information and present two novel approaches, namely, two-stage BF-Net and BF regularization. Experimental results show that the proposed DPFA-Net achieves the state-of-the-art overall accuracy score of 89.22% for semantic segmentation on the Stanford large-scale 3-D Indoor Spaces (S3DIS) dataset and provides consistently satisfactory performance across different tasks of semantic segmentation, part segmentation, and 3-D object classification. Furthermore, our model achieves 93.1% accuracy on the ModelNet40 dataset and provides a mean shape intersection-over-union (IoU) value of 85.5% for part segmentation on the ShapeNet-Part dataset. It is a also computationally more efficient compared to other methods.

3-D↗
DOE OSTI2023

A Threshold Helium Leakage Detection Switch with Ultra Low Power Operation

Detecting helium leakage is important in many applications, such as in dry cask nuclear waste storage systems. This work develops a helium detection system based on the relative permittivity (dielectric constant) difference between air and helium. This difference changes the status of an electrostatic microelectromechanical system (MEMS) switch. The switch is a capacitive-based device and requires a very negligible amount of power. Exciting the switch’s electrical resonance enhances the MEMS switch sensitivity to detect low helium concentration. This work simulates two different MEMS switch configurations: a cantilever-based MEMS modeled as a single-degree-freedom model and a clamped-clamped beam MEMS molded using the COMSOL Multiphysics finite-element software. While both configurations demonstrate the switch’s simple operation concept, the clamped-clamped beam was selected for detailed parametric characterization due to its comprehensive modeling approach. The beam detects at least 5% helium concentration levels when excited at 3.8 MHz, near electrical resonance. The switch performance decreases at lower excitation frequencies or increases the circuit resistance. The MEMS sensor detection level was relatively immune to beam thickness and parasitic capacitance changes. However, higher parasitic capacitance increases the switch’s susceptibility to errors, fluctuations, and uncertainties.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, validation of AD models through real-world sensor data is important for their application in nuclear facilities. In this paper, we propose an Autoencoder (AE)— a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD) — as another AD scheme for identifying irregularities within the same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We also validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

A SiPM-based optical readout system for the EIC dual-radiator RICH

Silicon photomultipliers (SiPM) are candidates selected as the potential photodetector technology for the dual-radiator Ring-Imaging Cherenkov (dRICH) detector at the future Electron-Ion Collider (EIC). SiPM are cheap devices, highly efficient and insensitive to the high magnetic field at the expected location of the sensors in the experiment. Here, on the other hand, SiPM are not radiation tolerant. Despite the integrated radiation level is expected to be moderate it should be tested whether single photon-counting capabilities and the increase in dark count rate can be kept under control to maintain the optimal dRICH detector performance across the years. The current status of the research for the EIC dRICH application and the first results on studies performed on a sample of commercial and prototype SiPM sensors are presented.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Molecular qubits based on photogenerated spin-correlated radical pairs for quantum sensing

Photogenerated spin-correlated radical pairs (SCRPs) in electron donor–bridge–acceptor (D–B–A) molecules can act as molecular qubits and inherently spin qubit pairs. SCRPs can take singlet and triplet spin states, comprising the quantum superposition state. Their synthetic accessibility and well-defined structures, together with their ability to be prepared in an initially pure, entangled spin state and optical addressability, make them one of the promising avenues for advancing quantum information science. Coherence between two spin states and spin selective electron transfer reactions form the foundation of using SCRPs as qubits for sensing. We can exploit the unique sensitivity of the spin dynamics of SCRPs to external magnetic fields for sensing applications including resolution-enhanced imaging, magnetometers, and magnetic switch. Molecular quantum sensors, if realized, can provide new technological developments beyond what is possible with classical counterparts. While the community of spin chemistry has actively investigated magnetic field effects on chemical reactions via SCRPs for several decades, we have not yet fully exploited the synthetic tunability of molecular systems to our advantage. This review offers an introduction to the photogenerated SCRPs-based molecular qubits for quantum sensing, aiming to lay the foundation for researchers new to the field and provide a basic reference for researchers active in the field. We focus on the basic principles necessary to construct molecular qubits based on SCRPs and the examples in quantum sensing explored to date from the perspective of the experimentalist.

Mani, Tomoyasu (ORCID:0000000241255195)↗
DOE OSTI2020

Selection of Components for the Remote, Canister-Monitoring System

This report documents the selection of components as part of the efforts initiated to develop a remote, canister-monitoring system (RCMS) for determining and monitoring environmental conditions within dry fuel storage canisters containing aluminum clad spent nuclear fuel (ASNF) at the Idaho National Laboratory (INL). These efforts are in support of Department of Energy Office of Environmental Management (DOE-EM) investigations into technical issues associated with extended dry storage (50+ years) of ASNF. The capability to establish and monitor the performance of ASNF in situ provides the opportunity to (1) evaluate the appropriate technologies for monitoring, (2) collect canister environment conditions as soon as possible, (3) verify and validate current laboratory-based study results and analytic modeling approaches, and (4) potentially identify additional dry storage options for ASNF at the INL site. The improved understanding of ASNF behavior gained by performing this work would also contribute to the safety basis for extended dry storage in current and future configurations as well as to provide information for future transportation, conditioning, and disposal of ASNF. The parameters to be monitored by the RCMS include temperature, relative humidity, hydrogen gas concentration and radiation environment (dose). Components are selected based on the expected environmental conditions within the canister and fuel storage area, and the desired performance of the RCMS. Several of these components have been purchased and received. Future activities include component testing and calibration, software development for operation of the integrated sensor module and fabrication of a representative test volume. The results of these tests and changes to desired performance characteristics will inform subsequent activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

OSCA1 is an osmotic specific sensor: a method to distinguish Ca 2+ -mediated osmotic and ionic perception

Genetic mutants defective in stimulus-induced Ca 2+ increases have been gradually isolated, allowing the identification of cell-surface sensors/receptors, such as the osmosensor OSCA1. However, determining the Ca 2+ -signaling specificity to various stimuli in these mutants remains a challenge. For instance, less is known about the exact selectivity between osmotic and ionic stresses in the osca1 mutant. Here, we have developed a method to distinguish the osmotic and ionic effects by analyzing Ca 2+ increases, and demonstrated that osca1 is impaired primarily in Ca 2+ increases induced by the osmotic but not ionic stress. We recorded Ca 2+ increases induced by sorbitol (osmotic effect, OE) and NaCl/CaCl 2 (OE + ionic effect, IE) in Arabidopsis wild-type and osca1 seedlings. Here we assumed the NaCl/CaCl 2 total effect (TE) = OE + IE, then developed procedures for Ca 2+ imaging, image analysis and mathematic fitting/modeling, and found osca1 defects mainly in OE. The osmotic specificity of osca1 suggests that osmotic and ionic perceptions are independent. The precise estimation of these two stress effects is applicable not only to new Ca 2+ -signaling mutants with distinct stimulus specificity but also the complex Ca 2+ signaling crosstalk among multiple concurrent stresses that occur naturally, and will enable us to specifically fine tune multiple signal pathways to improve crop yields.

Arabidopsis↗
DOE OSTI2020

The LSST DESC data challenge 1: generation and analysis of synthetic images for next-generation surveys

Data Challenge 1 (DC1) is the first synthetic data set produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST data set. DC1 is comprised of r -band observations of 40 deg 2 to 10 yr LSST depth. In this paper, we present each stage of the simulation and analysis process: (a) generation, by synthesizing sources from cosmological N -body simulations in individual sensor-visit images with different observing conditions; (b) reduction using a development version of the LSST Science Pipelines; and (c) matching to the input cosmological catalogue for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star–galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: (i) survey properties have an impact of 50 per cent of the statistical uncertainty for the scales and models used in DC1; (ii) a selection to eliminate artefacts in the catalogues is necessary to avoid biases in the measured clustering; and (iii) the presence of bright objects has a significant impact (2σ–6σ) in the estimated power spectra at small scales (ℓ > 1200), highlighting the impact of blending in studies at small angular scales in LSST.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

An overview of data tools for representing and managing building information and performance data

Building information modeling (BIM) has been widely adopted for representing and exchanging building data across disciplines during building design and construction. However, BIM's use in the building operation phase is limited. With the increasing deployment of low-cost sensors and meters, as well as affordable digital storage and computing technologies, growing volumes of data have been collected from buildings, their energy services systems, and occupants. Such data are crucial to help decision makers understand what, how, and when energy is consumed in buildings—a critical step to improving building performance for energy efficiency, demand flexibility, and resilience. However, practical analyses and use of the collected data are very limited due to various reasons, including poor data quality, ad-hoc representation of data, and lack of data science skills. To unlock value from building data, there is a strong need for a toolchain to curate and represent building information and performance data in common standardized terminologies and schemas, to enable interoperability between tools and applications. This study selected and reviewed 24 data tools based on common use cases of data across the building life cycle, from design to construction, commissioning, operation, and retrofits. The selected data tools are grouped into three categories: (1) data dictionary or terminology, (2) data ontology and schemas, and (3) data platforms. The data are grouped into ten typologies covering most types of data collected in buildings. This study resulted in five main findings: (1) most data representation tools can represent their intended data typologies well, such as Green Button for smart meter data and Brick schema for metadata of sensors in buildings and HVAC systems, but none of the tools cover all ten types of data; (2) there is a need for data schemas to represent the basis of design data and metadata of occupant data; (3) standard terminologies such as those defined in BEDES are only adopted in a few data tools; (4) integrating data across various stages in the building life cycle remains a challenge; and (5) most data tools were developed and maintained by different parties for different purposes, their flexibility and interoperability can be improved to support broader use cases. Finally, recommendations for future research on building data tools are provided for the data and buildings community based on the FAIR principles to make data Findable, Accessible, Interoperable, and Reusable.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Large Area Transfer of Bismuth‐Based Layered Oxide Thin Films Using a Flexible Polymer Transfer Method

Magnetic and ferroelectric oxide thin films have long been studied for their applications in electronics, optics, and sensors. The properties of these oxide thin films are highly dependent on the film growth quality and conditions. To maximize the film quality, epitaxial oxide thin films are frequently grown on single-crystal oxide substrates such as strontium titanate (SrTiO 3 ) and lanthanum aluminate (LaAlO 3 ) to satisfy lattice matching and minimize defect formation. However, these single-crystal oxide substrates cannot readily be used in practical applications due to their high cost, limited availability, and small wafer sizes. One leading solution to this challenge is film transfer. In this demonstration, a material from a new class of multiferroic oxides is selected, namely bismuth-based layered oxides, for the transfer. A water-soluble sacrificial layer of Sr 3 Al 2 O 6 is inserted between the oxide substrate and the film, enabling the release of the film from the original substrate onto a polymer support layer. The films are transferred onto new substrates of silicon and lithium niobate (LiNbO 3 ) and the polymer layer is removed. These substrates allow for the future design of electronic and optical devices as well as sensors using this new group of multiferroic layered oxide films.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Overview of Quantum Sensing Materials and Techniques for Energy Sector Applications

The energy sector has become increasingly dependent upon highly sensitive sensing devices for a wide range of applications. Variables such as temperature, pH, electromagnetic fields, ions, and pressure must be measured with high precision, often in harsh conditions (e.g. highly corrosive environments due to high temperature, pressure and humidity). These sensors are deployed in infrastructure such as transformers, pipelines, mines, nuclear power plants, and other areas to ensure safe operating conditions and uninterrupted, optimized service. Moreover, new opportunities for sensors have emerged due to the expansion of smart grids/meters, driverless vehicles, and the discovery of new oil, gas, and critical mineral deposits. The continued maturation of quantum sensing technologies offers exciting opportunities for quantum-enhanced measurements within the energy sector that may provide significant improvements in sensitivity beyond the classical limit. Here, an overview of established and emerging quantum materials for sensing applications will be provided, from trapped ions to color centers in diamond and silicon carbide. Associated quantum sensing methods for these materials will be discussed, with an emphasis on platforms that are nearing commercial viability. Specific application opportunities within the energy sector for quantum sensors will then be analyzed, including oil/gas discovery, greenhouse gas emission monitoring, pH and ion sensing, current measurement in electric vehicle batteries, and quantum-enhanced spectroscopy. Remaining barriers, such as quantum sensor platform miniaturization and ruggedization, will also be analyzed. A specific project at the National Energy Technology Laboratory involving the functionalization of qubits using metal-organic frameworks for enhanced quantum sensing will also be highlighted. Here, nitrogen vacancy centers (NV) in nanodiamonds, a commercially available qubit with long coherence times and utilizable quantum properties at room temperature, are encapsulated in a controlled way using the metal-organic framework ZIF-8. The ZIF-8 provides a well-defined, porous scaffold that can be controlled to promote the selective uptake of specific target analytes, such as gas molecules or ions. The quantum sensing performance of this composite material is either preserved or enhanced following ZIF-8 encapsulation; the optically detected magnetic resonance response of the NV nanodiamonds with and without the ZIF-8 coating are identical, while the ZIF-8 coating increases the longitudinal spin relaxation lifetime (T1) of the NV centers, an important parameter for spin relaxometry-based quantum sensing experiments. Taken together, these results demonstrate the importance of qubit functionalization as a crucial step for rationally designing high performance quantum sensors.

Crawford, Scott↗
DOE OSTI2022

Detection of Cyber Attacks in Grid-tied PV Systems Using Dynamic Watermarking

This paper presents of an active detection scheme for detecting cyber attacks on sensors controlling a grid-tied PV systems. Several cyber vulnerabilities in Grid tied PV Systems are discussed. The defense mechanism introduces a private (secret) watermarking signal into the control inputs of the grid-tied inverter system. This will enable the detection of any malicious manipulation of sensor measurements. Based on the measured data, two statistical tests are conducted to identify anomalies in the system using the presence of the watermarking signal. It shown that when a sensor data is compromised and/or replaced by a pre-recorded healthy signal, both test 1 and 2 exhibit high values indicating a possible malicious activity. The robustness of the proposed algorithm is tested and validated with several attack scenarios on a grid tied PV system. Select results from an experimental setup are discussed.

Ibrahim, Hasan↗
DOE OSTI2022

A Review: PFAS Adsorption, Sensing, and Remediation with Engineered Nanoporous Materials

Per- and polyfluoroalkyl substances (PFAS) are among the most abundant environmental contaminant species. They are widespread due to uncontrolled industrial and commercial use and have been linked to health risks such as cancer. With rising global concerns about the public health effects of PFAS, there is an incentive to develop strategies for reliable monitoring and effective PFAS removal, particularly in drinking water. Traditional PFAS sensing techniques are inefficient due to long measurement times, high labor input, high costs, and limitations to ex situ analysis. Current commercially available sorbents for PFAS removal generally lack the ability to capture PFAS components rapidly and quantitatively. Furthermore, existing sorbents are notably inefficient in removing the more toxic, smaller PFAS chemical chains. Large-scale applications of these methods tend to be costly and resource-intensive. Pacific Northwest National Laboratory has developed unique strategies for PFAS sensing and removal with capture probe technology that has an affinity for fluorocarbons, including PFAS. For both sensing and removal, the customizable capture probes can target specific PFAS compounds since they used a metal-organic framework (MOF)-based technology that can be fine-tuned and molecularly tailored. This tailoring of the materials enables high PFAS sensitivity, selectivity, and faster uptake. PNNL’s capture probe materials have been developed into a sensing technique based on the interactions of the capture probes with PFAS at the molecular level and further transduced that to a quantifiable electrochemical response. The materials have been integrated into a sensor platform developed by New Jersey Institute of Technology (NJIT). Tunable capture probes with a range of detection sensitivities allow for faster and more sensitive PFAS detection limits as low as what appears to be 0.5 ng/L (compared to the U.S. Environmental Protection Agency health advisory level of 70 ng/L). Customization of the capture probe results in improved sorption capacities (fast kinetics and high capacities) compared to commercial granular activated carbons. This research applied various experimental and modeling tools to improve understanding the molecular level interactions between the sorbents towards PFAS adsorption properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Continuous Emulation and Multiscale Visualization of Traffic Flow Using Stationary Roadside Sensor Data

With the advent of the next-generation traffic monitoring systems, there has been a significant increase in the spatial-temporal resolution of vehicle mobility data in many cities. Effective analysis and visualization of such data can provide transportation planners with data-driven insights, which can facilitate the understanding of multiscale traffic dynamics. In this paper, we present a web-based traffic emulator for emulating and visualizing near-real-time and historical traffic flows on highways using data from road-side sensors. To construct a continuous traffic flow, the emulator adopts an analytical pipeline that can (a) integrate traffic data collected from discrete road-side radar detection sensors, (b) interpolate traffic conditions (vehicle speed and volume) on unmeasured road segments based on traffic flow theory, and (c) generate lane-specific vehicle trajectories and movements using a mathematically optimized representation of the road network. Our app also provides an integrated visual workflow that allows users to explore the interconnected traffic dynamics using an appropriate traffic flow visualization selected based on the level of detail. We devise two innovative geo-visualization techniques that utilize an animated strips-network representation and a lane usage matrix to visualize lane performances. To ensure a smooth emulation of large-scale traffic flow in an easy-to-access web environment, we implement the emulator using client-side GPU-accelerated techniques. Lastly, we close with a case study that visualizes traffic dynamics of two scenarios - an afternoon peak hour and a traffic accident - in Chattanooga, Tennessee. Our app visualizes the responses of traffic dynamics during different traffic conditions, and to the presence of the traffic accident at different spatial scales.

42 ENGINEERING↗
DOE OSTI2021

cGAS-like receptors sense RNA and control 3'2'-cGAMP signalling in Drosophila

Cyclic GMP–AMP synthase (cGAS) is a cytosolic DNA sensor that produces the second messenger cG[2'–5']pA[3'–5']p (2'3'-cGAMP) and controls activation of innate immunity in mammalian cells. Animal genomes typically encode multiple proteins with predicted homology to cGAS, but the function of these uncharacterized enzymes is unknown. Here we show that cGAS-like receptors (cGLRs) are innate immune sensors that are capable of recognizing divergent molecular patterns and catalysing synthesis of distinct nucleotide second messenger signals. Crystal structures of human and insect cGLRs reveal a nucleotidyltransferase signalling core shared with cGAS and a diversified primary ligand-binding surface modified with notable insertions and deletions. We demonstrate that surface remodelling of cGLRs enables altered ligand specificity and used a forward biochemical screen to identify cGLR1 as a double-stranded RNA sensor in the model organism Drosophila melanogaster. We show that RNA recognition activates Drosophila cGLR1 to synthesize the novel product cG[3'–5']pA[2'–5']p (3'2'-cGAMP). A crystal structure of Drosophila stimulator of interferon genes (dSTING) in complex with 3'2'-cGAMP explains selective isomer recognition, and 3'2'-cGAMP induces an enhanced antiviral state in vivo that protects from viral infection. Similar to radiation of Toll-like receptors in pathogen immunity, our results establish cGLRs as a diverse family of metazoan pattern recognition receptors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗