Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Chlorophyll- a dynamics in the lower Amazon River: insights from in situ and hyperspectral remote sensing using OCI-PACE

Chlorophyll-a concentration (Chla) is a key indicator of phytoplankton biomass and aquatic trophic status. However, satellite-derived Chla in sediment-rich waters, such as those found in the Lower Amazon River, remains challenging. The present study characterizes in situ Chla levels and their relationships with geographic, physical, and biogeochemical parameters in the Lower Amazon. Data collected between 2014 and 2017 across four hydrological seasons included measurements of Chla, remote sensing reflectance, and water quality parameters such as total suspended sediment, conductivity, water surface temperature, dissolved oxygen, pH, dissolved organic carbon and coloured dissolved organic matter. An empirical model was developed to estimate Chla using simulated hyperspectral bands from NASA’s PACE mission, achieving high performance (R 2 = 0.76; RMSE = 0.11 μg·L −1 ). Red bands proved particularly effective for Chla retrieval, while the addition of ultraviolet bands further enhanced model accuracy. The application of the developed model to satellite imagery yielded results consistent with in situ observations for the same hydrologic season. Seasonal variation and geographic location were major factors influencing Chla dynamics. This study provides a novel contribution to Chla estimation in optically complex, highly turbid waters and highlights the potential of the PACE mission to enhance global aquatic ecosystem monitoring. In conclusion, by offering freely available hyperspectral data with high radiometric resolution, PACE represents a significant advancement in the realm of remote sensing of aquatic environments.

Amazon River↗

The Strategic Implications of the Evolving US-China Nuclear Balance

China is significantly expanding the size and sophistication of its nuclear forces. Over the summer of 2021, researchers using satellite imagery discovered three separate fields of intercontinental ballistic missile (ICBM) silos under construction in the deserts of north-central China. If each silo is eventually equipped with a missile, the Chinese nuclear arsenal capable of striking the continental US could triple in size. Furthermore, the US government estimates that China’s nuclear arsenal could number 1000 warheads by 2030, with at least 200 deployed on long-range platforms.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Iterative self-organizing SCEne-LEvel sampling (ISOSCELES) for large-scale building extraction

Convolutional neural networks (CNN) provide state-of-the-art performance in many computer vision tasks, including those related to remote-sensing image analysis. Successfully training a CNN to generalize well to unseen data, however, requires training on samples that represent the full distribution of variation of both the target classes and their surrounding contexts. With remote sensing data, acquiring a sufficiently representative training set is a challenge due to both the inherent multi-modal variability of satellite or aerial imagery and the general high cost of labeling data. To address this challenge, we have developed ISOSCELES, an Iterative Self-Organizing SCEne LEvel Sampling method for hierarchical sampling of large image sets. Using affinity propagation, ISOSCELES automates the selection of highly representative training images. Compared to random sampling or using available reference data, the distribution of the training is principally data driven, reducing the chance of oversampling uninformative areas or undersampling informative ones. In comparison to manual sample selection by an analyst, ISOSCELES exploits descriptive features, spectral and/or textural, and eliminates human bias in sample selection. Using a hierarchical sampling approach, ISOSCELES can obtain a training set that reflects both between-scene variability, such as in viewing angle and time of day, and within-scene variability at the level of individual training samples. We verify the method by demonstrating its superiority to stratified random sampling in the challenging task of adapting a pre-trained model to a new image and spatial domain for country-scale building extraction. Using a pair of hand-labeled training sets comprising 1,987 sample image chips, a total of 496,000,000 individually labeled pixels, we show, across three distinct model architectures, an increase in accuracy, as measured by F1-score, of 2.2–4.2%.

42 ENGINEERING↗

Cropland abandonment between 1986 and 2018 across the United States: spatiotemporal patterns and current land uses

Knowing where and when croplands have been abandoned or otherwise removed from cultivation is fundamental to evaluating future uses of these areas, e.g. as sites for ecological restoration, recultivation, bioenergy production, or other uses. However, large uncertainties remain about the location and time of cropland abandonment and how this process and the availability of associated lands vary spatially and temporally across the United States. Here, we present a nationwide, 30 m resolution map of croplands abandoned throughout the period of 1986–2018 for the conterminous United States (CONUS). We mapped the location and time of abandonment from annual cropland layers we created in Google Earth Engine from 30 m resolution Landsat imagery using an automated classification method and training data from the U.S. Department of Agriculture Cropland Data Layer. Our abandonment map has overall accuracies of 0.91 and 0.65 for the location and time of abandonment, respectively. From 1986 to 2018, 12.3 (±2.87) million hectares (Mha) of croplands were abandoned across CONUS, with areas of greatest change over the Ogallala Aquifer, the southern Mississippi Alluvial Plain, the Atlantic Coast, North Dakota, northern Montana, and eastern Washington state. The average annual nationwide abandoned area across our study period was 0.51 Mha per year. Annual abandonment peaked between 1997 and 1999 at a rate of 0.63 Mha year –1 , followed by a continuous decrease to 0.41 Mha year –1 in 2009–2011. Among the abandoned croplands, 53% (6.5 Mha) changed to grassland and pasture, 18.6% (2.28 Mha) to shrubland and forest, 8.4% (1.03 Mha) to wetlands, and 4.6% (0.56 Mha) to non-vegetated lands. Of the areas that we mapped as abandoned, 19.6% (2.41 Mha) were enrolled in the Conservation Reserve Program as of 2020. Our new map highlights the long-term dynamic nature of agricultural land use and its relation to various competitive pressures and land use policies in the United States.

54 ENVIRONMENTAL SCIENCES↗

Further adoption of conservation tillage can increase maize yields in the western US Corn Belt

Conservation tillage can reduce soil erosion, increase soil health, and decrease labor and fuel input costs. Despite these benefits, potential yield impacts remain an important concern for farmers considering adoption. Previous research suggests that conservation tillage is likely to have the largest yield benefits in more arid conditions, but a lack of field-level analyses across climatic, management and soil conditions limits confidence in such predictions. Satellite imagery provides the opportunity to monitor agricultural lands at sub-field resolution across large spatial scales and wide environmental gradients. Here we investigate the maize yield impacts of conservation tillage in the semi-arid western US Corn Belt, using sub-field resolution datasets on tillage practices and crop yields derived from satellite data spanning four states (Nebraska, Kansas, South Dakota, and North Dakota) between 2008 and 2020. On these datasets, we estimate heterogenous yield outcomes for several thousand maize fields across gradients in climate, soil quality and irrigation status by using a causal forests analysis, an adaptation of the random forests machine-learning algorithm for causal inference on observational data. We find that long-term adoption of conservation tillage increased rainfed maize yields by an average of 9.9% in the region. Impacts on irrigated yields were small and not statistically significant. These results, along with an analysis of variables related to greater than average yield benefits, indicate that improved water infiltration and retention are the primary reasons for conservation tillage benefits. Despite yield benefits, many fields estimated to see increased yields under long term low till have not adopted the practice. Therefore, we identify specific counties likely to benefit most from increased levels of adoption. Our results strengthen the understanding of the impacts of conservation agriculture on crop yields and help define environments and counties most likely to benefit from conservation tillage.

54 ENVIRONMENTAL SCIENCES↗

Widespread windthrow in Southeast Asian tropical forests verified by satellite observations

Windthrow, defined as abrupt tree mortality caused by intense winds, is well documented in the Neotropics but remains largely unverified in Asian tropical forests. Using Landsat 8 imagery for the period 2020-2022 and established spectral (shortwave-infrared, near-infrared, and red band composites) and morphological criteria (fan-shaped geometry and sharp boundaries), this study verified the presence of windthrow across Sumatra, Borneo, and New Guinea and produced the first georeferenced inventory of 60 events in the region. Event sizes were right-skewed, with many small gaps and few large (>200 ha) disturbances. Orientations were anisotropic, with concentrations of windthrow events pointing west to northwest-to-north and eastward, both aligning with known pathways of organized convection in the Maritime Continent of Southeast Asia. Detection was conservatively biased low by cloud cover, long revisit intervals, and the exclusion of land-use areas. This study provides a verified baseline that enables reproducible mapping with higher resolution sensors and field observations to quantify windthrow frequency, severity, and ecological significance.

Asia’s tropical forests↗

Vegetation heterogeneity reflects soil thermal state and surface soil displacement in a thawing permafrost landscape

Thawing permafrost has the potential to dramatically alter the physical and ecological structure of northern landscapes. Warming of the Arctic and subsequent degradation of permafrost have created a need to assess the stability and movement of soils on hillslopes and the potential impacts on ecosystem structure. In this work, we explore the relationships among vegetation heterogeneity, soil temperature, and soil surface displacements observed from 2019 to 2022 in a watershed in the discontinuous permafrost region on the Seward Peninsula of Alaska. Vegetation heterogeneity was measured as the standard deviation (SD) of the normalized difference vegetation index (NDVI) from 3 m PlanetScope satellite imagery around each soil temperature and active layer thickness observation. Locations of observations were clustered into three soil thermal groups, warm, intermediate, and cold, based on soil temperature and active layer thickness. Average annual horizontal surface displacements were significantly lower for soils within the warm thermal group (median = 0.033 m yr −1 ) compared to soils within the cold thermal group (median = 0.090 m yr −1 ; p < 0.001). Conversely, vegetation heterogeneity was significantly higher in the warm (median = 0.014 SD NDVI; p = 0.002) and intermediate (median = 0.015 SD NDVI; p = 0.002) groups compared with the cold thermal group (median = 0.012 SD NDVI), suggesting a warming-induced shift in vegetation community complexity. Because of the observed associations of ground surface displacement rates and vegetation heterogeneity with soil thermal state, we hypothesize that warming soil conditions induce changes in the rates and patterns of hillslope erosion due to an increase in surface movement as near-surface permafrost thaws, followed by a decrease as the permafrost table deepens and excess ice content diminishes. The transition to warm soils promotes surface ecosystem transformation, shifting the dominant vegetation at the site, given the warming climatic conditions of the region. We integrated our observations of soil temperature, vegetation heterogeneity, and soil surface displacements into a conceptual model that describes the co-evolution of hillslopes and vegetation in warming permafrost environments, which is currently unrepresented in earth system models.

54 ENVIRONMENTAL SCIENCES↗

Quantifying the Variability of “Fixed-Width” Buffers on Harvested Lands in Western Oregon and Washington

In contemporary forest management, buffers of unharvested trees are left along streams to protect riparian and aquatic ecosystems. Buffer regulations often focus on specific minimum width requirements, which aid in straightforward regulation and application, but minimum widths also suggest buffered edges are uniform and contain little variability. Conceptual papers suggest that alternative buffer configurations may offer greater flexibility in landscape-level protection, increase forest complexity, and enhance aquatic and riparian biodiversity. However, before considering alternatives to fixed-width buffers, it is necessary to quantify the inherent variability in current buffer practices present on the landscape. In this study, we used aerial imagery to quantify variability of buffer widths in two hundred randomly selected recently harvested units on managed land in Oregon and Washington with both fish-bearing and non-fish-bearing sections of stream. Wider buffers on larger streams had a greater magnitude of variability, but when normalized by stream size, variation was greater in smaller streams, and overall, variation ranged from 25% to 50% of the mean width. Despite local variability, buffer widths rarely fell below 9.14 m (30 ft). The variation quantified here provides an initial measure of variability to inform future management, given emerging interest in variable retention buffers.

58 GEOSCIENCES↗

Discovery of TOI-1260d and the characterization of the multiplanet system

ABSTRACT We report the discovery of a third planet transiting the star TOI-1260, previously known to host two transiting sub-Neptune planets with orbital periods of 3.127 and 7.493 d, respectively. The nature of the third transiting planet with a 16.6-d orbit is supported by ground-based follow-up observations, including time-series photometry, high-angular resolution images, spectroscopy, and archival imagery. Precise photometric monitoring with CHEOPS allows to improve the constraints on the parameters of the system, improving our knowledge on their composition. The improved radii of TOI-1260b and TOI-1260c are $2.36 \pm 0.06 \rm R_{\oplus }$, $2.82 \pm 0.08 \rm R_{\oplus }$, respectively while the newly discovered third planet has a radius of $3.09 \pm 0.09 \rm R_{\oplus }$. The radius uncertainties are in the range of 3 per cent, allowing a precise interpretation of the interior structure of the three planets. Our planet interior composition model suggests that all three planets in the TOI-1260 system contains some fraction of gas. The innermost planet TOI-1260b has most likely lost all of its primordial hydrogen-dominated envelope. Planets c and d were also likely to have experienced significant loss of atmospheric through escape, but to a lesser extent compared to planet b.

Lam, K. W. F. (ORCID:0000000299106088)↗

The most luminous, merger-free AGNs show only marginal correlation with bar presence

The role of large-scale bars in the fuelling of active galactic nuclei (AGNs) is still debated, even as evidence mounts that black hole growth in the absence of galaxy mergers cumulatively dominates and may substantially influence disc (i.e. merger-free) galaxy evolution. We investigate whether large-scale galactic bars are a good candidate for merger-free AGN fuelling. Specifically, we combine slit spectroscopy and Hubble Space Telescope imagery to characterize star formation rates (SFRs) and stellar masses of the unambiguously disc-dominated host galaxies of a sample of luminous, Type-1 AGN with 0.02 < z < 0.24. After carefully correcting for AGN signal, we find no clear difference in SFRs between AGN hosts and a stellar mass-matched sample of galaxies lacking an AGN (0.013 < z < 0.19), although this could be due to small sample size (nAGN = 34). We correct for SFR and stellar mass to minimize selection biases, and compare the bar fraction in the two samples. We find that AGNs are marginally (~1.7σ) more likely to host a bar than inactive galaxies, with AGN hosts having a bar fraction, $f_{\mathrm{bar}}=0.59^{+0.08}_{-0.09}$ and inactive galaxies having a bar fraction, $f_{\mathrm{bar}}=0.44^{+0.08}_{-0.09}$. However, we find no further differences between SFR- and mass-matched AGNs and inactive samples. While bars could potentially trigger AGN activity, they appear to have no further, unique effect on a galaxy’s stellar mass or SFR.

79 ASTRONOMY AND ASTROPHYSICS↗

Entropy and Boundary Based Adversarial Learning for Large Scale Unsupervised Domain Adaptation

Supervised semantic segmentation methods provide state-of-the-art performance, but their performance is limited by the amount of quality labeled data they need for training. Scarcity of labeled data and non-transferablity of models, due to cross-domain discrepancy makes it a bigger challenge for remote sensing imagery analysis. In this work, we approach this problem through adversarial learning, driven by entropy and boundary of region-of-interest for unsupervised domain adaptation. This concept helps with better boundary prediction and encourages target domain entropy maps (probability/uncertainty maps) to be similar to source domains. In particular, we showed that deriving informative entropy through the adversarial learning is essential to enable the adaptation. We used a large scale cross country building extraction dataset to validate the framework. The experimental results show the usefulness of considering boundary and entropy driven adversarial learning for adaptation.

Makkar, Nikhil↗

Towards Geospatial Knowledge Graph Infused Neuro-Symbolic AI for Remote Sensing Scene Understanding

Deep learning has proven its effectiveness in numerous tasks for remote sensing scene understanding. However there is an increasing interest to explore fusion of domain-specific background information to the deep neural network to further improve its performance. Remote sensing researchers are also working towards developing models that generalize and adapt to multiple applications. Generalization challenges coupled with the scarcity of large corpora of high-quality noise-free labelled data, have together fueled an interest for leveraging background information. Knowledge graphs serve as excellent choice to represent domain-specific information in a structured, standardized and extensible manner. Integrating symbolic knowledge representations in the form of Knowledge Graph Embedding (KGE) to perform neuro-symbolic reasoning is an emerging research direction promising significant impacts. This vision paper seeks to position ideas and provoke early thoughts toward advancing neuro-symbolic artificial intelligence in the context of geospatial challenges. Specifically, it conceptualizes and elaborates on an architecture for infusing geospatial knowledge from knowledge graph in a deep neural network pipeline. As guiding case studies - land-use land-cover classification, object detection and instance segmentation can benefit from infusing spatio-contextual information with remote sensing imagery. The discussion further reflects on and articulates the challenges and explainable AI opportunities anticipated when scaling and maintaining large-scale geospatial knowledge graphs.

Potnis, Abhishek↗

TOWARDS RAPID RESPONSE UPDATES OF POPULATIONS AT RISK

Understanding population at risks has been a focus of the LandScan program through its development of population estimates. With advancements in computer vision, deep learning technologies and access to High Performance Computing (HPC) and high resolution imagery, population estimates are now modeled at the building level. However, when those patterns are disrupted, rapid updates to population distribution estimates are needed to support humanitarian aid and response. Oak Ridge National Laboratory (ORNL) recently adapted an existing deep learning building footprint extraction model in development of a scalable approach to Building Damage Assessments (BDA). This new opportunity opens the possibility of automating BDA to support rapid population distribution estimate updates for geographic areas involved in geopolitical conflicts or natural events for humanitarian aid and response or where to focus recovery efforts. In addition, incorporate social surveys to further model human behavior under conflict or other scenarios that disrupt normal patterns of life.

Urban, Marie↗

Efficient Extraction Of Building Elevation Attributes For Flood Risk Management Using Airborne LiDAR Data

In this paper, we address the need for extracting two key building elevation attributes—Lowest Adjacent Grade (LAG) and Highest Adjacent Grade (HAG)—which are crucial for effective flood risk management. Conventional methods, involving onsite surveying or the use of optical imagery-derived building footprints combined with Digital Elevation Models (DEMs), often face misalignment and time discrepancy issues due to varied remote sensing sources. We introduce a new, scalable method that exclusively relies on airborne LiDAR data to overcome these challenges. Our approach employs an object-based ground filtering technique, and the results were evaluated using two different DEMs and building footprint sets. The findings demonstrate that our single-source method, utilizing only airborne LiDAR data, significantly improves the accuracy of LAG and HAG calculations compared to traditional methods that use hand-digitized building footprints. The proposed approach offers a solution for comprehensive flood risk management endeavors.

Song, Hunsoo↗

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

cloud properties↗

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗