Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and sensing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Generative Patch Priors for Practical Compressive Image Recovery

In this work, we propose the generative patch prior (GPP) that defines a generative prior for compressive image recovery, based on patch-manifold models. Unlike learned, image-level priors that are restricted to the range space of a pre-trained generator, GPP can recover a wide variety of natural images using a pre-trained patch generator. Additionally, GPP retains the benefits of generative priors like high reconstruction quality at extremely low sensing rates, while also being much more generally applicable. We show that GPP outperforms several unsupervised and supervised techniques on three different sensing models – linear compressive sensing with known, and unknown calibration settings, and the non-linear phase retrieval problem. Finally, we propose an alternating optimization strategy using GPP for joint calibration-and-reconstruction which performs favorably against several baselines on a real world, uncalibrated compressive sensing dataset. The code and models for GPP are available on github.

compressed sensing↗
DOE OSTI2025

Reference Shapefiles and Pre-trained Random Forest Classification Models for Detecting Aufeis on the North Slope of Alaska in Landsat Imagery

This dataset provides shapefiles and trained machine learning models used for aufeis detection at four sites on the North Slope of Alaska. It includes reference data for evaluating Landsat-based detection methods, supporting research on remote sensing approaches for identifying aufeis. The ReferenceData folder contains ArcGIS shapefiles of semi-automated land cover classifications for 217 Landsat Collection 2 images, categorizing pixels into six classes: aufeis, snow, ground, none, water, and cloud. The SiteBuffers.zip file includes 10-kilometer buffer shapefiles defining regions of interest around four aufeis fields (Canning21, FH1, Firth, and Kuparuk), used to test three detection techniques. Additionally, the TrainedRFModels folder contains six pre-trained Scikit-Learn Random Forest classifiers (100 trees, max depth = 30) designed to predict aufeis presence in Landsat Collection 2 Surface Reflectance images using Red, Blue, SWIR2, NDVI, and NDWI bands. This dataset supports the development and validation of remote sensing methods for mapping aufeis in Arctic environments.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Comprehensive Northern Hemisphere Particle Microphysics Data Set From the Precipitation Imaging Package

Microphysical observations of precipitating particles are critical data sources for numerical weather prediction models and remote sensing retrieval algorithms. However, obtaining coherent data sets of particle microphysics is challenging as they are often unindexed, distributed across disparate institutions, and have not undergone a uniform quality control process. This work introduces a unified, comprehensive Northern Hemisphere particle microphysical data set from the National Aeronautics and Space Administration precipitation imaging package (PIP), accessible in a standardized data format and stored in a centralized, public repository. Data is collected from 10 measurement sites spanning 34° latitude (37°N–71°N) over 10 years (2014–2023), which comprise a set of 1,070,000 precipitating minutes. The provided data set includes measurements of a suite of microphysical attributes for both rain and snow, including distributions of particle size, vertical velocity, and effective density, along with higher-order products including an approximation of volume-weighted equivalent particle densities, liquid equivalent snowfall, and rainfall rate estimates. The data underwent a rigorous standardization and quality assurance process to filter out erroneous observations to produce a self-describing, scalable, and achievable data set. Case study analyses demonstrate the capabilities of the data set in identifying physical processes like precipitation phase-changes at high temporal resolution. Bulk precipitation characteristics from a multi-site intercomparison also highlight distinct microphysical properties unique to each location. This curated PIP data set is a robust database of high-quality particle microphysical observations for constraining future precipitation retrieval algorithms, and offers new insights toward better understanding regional and seasonal differences in bulk precipitation characteristics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Coarse-to-fine Task-driven Inpainting for Geoscience Images

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. As far as we know, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images, and they never consider the following geoscience task when developing inpainting methods. Here, this paper aims to repair the occluded regions for a better geoscience task performance and advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with the help of designed coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we propose a MaskMix based data augmentation method, which augments inpainting masks instead of augmenting original images, to exploit the limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method. The code is available at: https://github.com/HMS97/Task-driven-Inpainting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Towards Diverse and Representative Global Pretraining Datasets for Remote Sensing Foundation Models

The design of a pretraining dataset is emerging as a critical component for the generality of foundation models. In the remote sensing realm, large volumes of imagery and benchmark datasets exist that can be leveraged to pretrain foundation models, however using this imagery in absence of a well-crafted sampling strategy is inefficient and has the potential to create biased and less generalizable models. Here, we provide a discussion and vision for the curation and assessment of pretraining datasets for remote sensing geospatial foundation models. We highlight the importance of geographic, temporal, and image acquisition diversity and review possible strategies to enable such diversity at global scale. In addition to these characteristics, support for various spatial-temporal pretext tasks within the dataset is also critical. Ultimately, our primary objective is to place emphasis on and draw attention to the data curation stage of the foundation model development pipeline. By doing so, we think it is possible to reduce biases of geospatial foundation models, as well as enable broader generalization to downstream remote sensing tasks and applications.

Arndt, Jacob↗
DOE OSTI2026

Estimating Fine-Resolution Shortwave Broadband Albedo of Croplands from Harmonized Landsat and Sentinel-2 Data

Altered surface albedo due to land-cover conversions and management is a significant driver of global climate change. Albedo can be directly measured at ground stations, and remote sensing data can be used to scale-up albedo values to regional and global levels. Some previous studies have retrieved fine-resolution (10–30 m) instantaneous albedo and coarse-resolution (500–1000 m) daily mean albedo from remote sensing data, but they all required the input of Moderate Resolution Imaging Spectroradiometer (MODIS) albedo information at 500-m resolution, and none have assembled both instantaneous and daily albedo based exclusively on fine-resolution satellite data. Here, to address this issue, we compiled 387 instantaneous and 346 daily albedo records using field net radiometer measurements from the bioenergy croplands at the W. K. Kellogg Biological Station in southwest Michigan. We then connected these albedo records with a suite of variables derived from harmonized Landsat and Sentinel-2 data through two machine learning algorithms (random forest regression and extreme gradient boosting) to retrieve clear-sky instantaneous and daily shortwave broadband albedo. The performance statistics indicate reasonable accuracy of model results [root-mean-square error (RMSE)] around or below 0.03 except for snow-covered surfaces), suggesting that the retrieval of both instantaneous and daily albedo based exclusively on fine-resolution satellite data is promising. To facilitate the use of fine-resolution albedo products at the global level, future efforts need to include more albedo records of diverse surface cover types, as well as to accurately model daily albedo for cloudy days to address the “clear-sky bias.”

Harmonized Landsat and Sentinel-2↗
DOE OSTI2021

An integrated Imaging and Modeling Toolbox for Accelerated Development of Root-focused Crops at Field Scales

This project, led by Yuxin Wu at the LBNL, was proposed to develop an integrated imaging-modeling toolbox allowing for accelerated development of root-focused crops at field scales. Our approach is based on a novel root phenotyping method we termed Tomographic Electrical Rhizosphere Imaging (TERI), which provides advanced phenotyping of key root traits by sensing the electrical impedance response of roots and soil to external electrical excitations, and mapping these responses to root and soil properties. The role of Noble Research Institute in this project is to assist TERI model establishment and validation by collecting various above- and below-ground traits data from container- and field-grown plants (mainly wheat). Over the last three years, Noble Research Institute has conducted 3 phases of experiments as proposed including: (Phase 1) greenhouse and hoop-house experiments in wheat and pecan plants grown under controlled container-grown conditions; (Phase 2) space-planted individual plant field experiment using different wheat varieties; and (Phase 3) small-plot planted field experiment using different wheat varieties, as well as using different small grains species including wheat, rye, triticale, oat and barley for increasing plant variation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Object Detection and Recognition with PointPillars in LiDAR Point Clouds – Comparisions

In the field of autonomous systems, neural networks have been leveraged for object detection and recognition in 2-dimensional images captured by cameras. Other types of sensors are available for sensing surroundings, including LiDAR sensors, and corresponding networks have been developed to perform detection and recognition in the point clouds generated by these sensors. The approaches are similar, both perform convolutions, but have distinct characteristics and challenges. In designing and configuring autonomous systems, a variety of LiDAR sensors are available, along with configurable deep neural networks to leverage their data. This work presents a review of the PointPillars network, an evolution of the seminal PointNet, comparing accuracy and training time relative to different LiDAR sensors, network and training parameters, CPU and GPU hardware, and the criticality of the use of reflective intensity as a feature. The value of using reflectivity as a predictive feature is explored and quantified to determine if it makes a significant difference in accuracy of the PointPillars network. Two separate LiDAR sensors are utilized, a 16-plane and a 32-plane, and corresponding accuracies and training times with the PointPillars network are evaluated.

LiDAR, machine learning, neural network, object re↗
DOE OSTI2026

APPL Hyperspectral_Imaging_Dataset_for_Heritability_Analysis_in_Populus_trichocarpa

This dataset contains hyperspectral imaging data collected at the Advanced Plant Phenotyping Laboratory (APPL) at Oak Ridge National Laboratory. Natural variants of Populus trichocarpa were imaged using a high-throughput hyperspectral phenotyping pipeline to quantify spectral reflectance traits for downstream quantitative genetics analyses. The dataset includes hyperspectral image files and derived reflectance data products suitable for extracting spectral features across the measured wavelength range (e.g., VNIR and/or SWIR, depending on instrument configuration), along with associated sample metadata (e.g., genotype identifiers, experimental design factors, and imaging run identifiers). These data were generated to support analyses of broad-sense heritability of hyperspectral traits and their relationships with biochemical phenotypes (including lignin traits from Py-MBMS).

APPL↗
DOE OSTI2026

Imaging of a van der Waals spin-orbit torque system using spin ensembles in hBN

Recently, optically active spin defects embedded in two-dimensional (2D) van der Waals (vdW) crystals have emerged as a transformative quantum sensing platform to explore cutting-edge materials science. Taking advantage of excellent solid-state integrability, this new class of spin defects can be readily arranged in nanoscale proximity to target materials, showing great promise for realizing in-situ quantum sensing of microscopic spin and charge behaviors in vdW heterostructures. Here we report hexagonal boron nitride-based quantum imaging of field-free deterministic magnetic switching and electric current distributions in an all-vdW spin-orbit torque (SOT) system. By visualizing variations of nanoscale magnetic stray field profile of room-temperature 2D magnet Fe 3 GaTe 2 under different SOT conditions, we show how the magnetic switching evolves from deterministic to stochastic behavior due to the interplay between spin orientations, anisotropy and Joule heating. Micromagnetic simulations rationalize our results well, revealing the role of field-like SOT in inhibiting thermal fluctuation driven stochastic switching and chaotic multi-domain competition. This understanding, which is otherwise difficult to access by conventional transport measurements, offers valuable insights into material design, testing, and performance evaluation of next-generation vdW spintronic devices.

Imaging techniques↗
DOE OSTI2022

Inferring plant–plant interactions using remote sensing

Rapid technological advancements and increasing data availability have improved the capacity to monitor and evaluate Earth's ecology via remote sensing. However, remote sensing is notoriously ‘blind’ to fine-scale ecological processes such as interactions among plants, which encompass a central topic in ecology. Here, we discuss how remote sensing technologies can help infer plant–plant interactions and their roles in shaping plant-based systems at individual, community and landscape levels. At each of these levels, we outline the key attributes of ecosystems that emerge as a product of plant–plant interactions and could possibly be detected by remote sensing data. We review the theoretical bases, approaches and prospects of how inference of plant–plant interactions can be assessed remotely. At the individual level, we illustrate how close-range remote sensing tools can help to infer plant–plant interactions, especially in experimental settings. At the community level, we use forests to illustrate how remotely sensed community structure can be used to infer dominant interactions as a fundamental force in shaping plant communities. At the landscape level, we highlight how remotely sensed attributes of vegetation states and spatial vegetation patterns can be used to assess the role of local plant–plant interactions in shaping landscape ecological systems. Synthesis . Remote sensing extends the domain of plant ecology to broader and finer spatial scales, assisting to scale ecological patterns and search for generic rules. Robust remote sensing approaches are likely to extend our understanding of how plant–plant interactions shape ecological processes across scales—from individuals to landscapes. Combining these approaches with theories, models, experiments, data-driven approaches and data analysis algorithms will firmly embed remote sensing techniques into ecological context and open new pathways to better understand biotic interactions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

LiDAR-Aided Interior Orientation Parameters Refinement Strategy for Consumer-Grade Cameras Onboard UAV Remote Sensing Systems

Unmanned aerial vehicles (UAVs) are quickly emerging as a popular platform for 3D reconstruction/modeling in various applications such as precision agriculture, coastal monitoring, and emergency management. For such applications, LiDAR and frame cameras are the two most commonly used sensors for 3D mapping of the object space. For example, point clouds for the area of interest can be directly derived from LiDAR sensors onboard UAVs equipped with integrated global navigation satellite systems and inertial navigation systems (GNSS/INS). Imagery-based mapping, on the other hand, is considered to be a cost-effective and practical option and is often conducted by generating point clouds and orthophotos using structure from motion (SfM) techniques. Mapping with photogrammetric approaches requires accurate camera interior orientation parameters (IOPs), especially when direct georeferencing is utilized. Most state-of-the-art approaches for determining/refining camera IOPs depend on ground control points (GCPs). However, establishing GCPs is expensive and labor-intensive, and more importantly, the distribution and number of GCPs are usually less than optimal to provide adequate control for determining and/or refining camera IOPs. Moreover, consumer-grade cameras with unstable IOPs have been widely used for mapping applications. Therefore, in such scenarios, where frequent camera calibration or IOP refinement is required, GCP-based approaches are impractical. To eliminate the need for GCPs, this study uses LiDAR data as a reference surface to perform in situ refinement of camera IOPs. The proposed refinement strategy is conducted in three main steps. An image-based sparse point cloud is first generated via a GNSS/INS-assisted SfM strategy. Then, LiDAR points corresponding to the resultant image-based sparse point cloud are identified through an iterative plane fitting approach and are referred to as LiDAR control points (LCPs). Finally, IOPs of the utilized camera are refined through a GNSS/INS-assisted bundle adjustment procedure using LCPs. Seven datasets over two study sites with a variety of geomorphic features are used to evaluate the performance of the developed strategy. The results illustrate the ability of the proposed approach to achieve an object space absolute accuracy of 3–5 cm (i.e., 5–10 times the ground sampling distance) at a 41 m flying height.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Predicting Nugget Size of Resistance Spot Welds Using Infrared Thermal Videos With Image Segmentation and Convolutional Neural Network

Resistance spot welding (RSW) is a widely adopted joining technique in automotive industry. Recent advancement in sensing technology makes it possible to collect thermal videos of the weld nugget during RSW using an infrared (IR) camera. The effective and timely analysis of such thermal videos has the potential of enabling in situ nondestructive evaluation (NDE) of the weld nugget by predicting nugget thickness and diameter. Deep learning (DL) has demonstrated to be effective in analyzing imaging data in many applications. However, the thermal videos in RSW present unique data-level challenges that compromise the effectiveness of most pre-trained DL models. We propose a novel image segmentation method for handling the RSW thermal videos to improve the prediction performance of DL models in RSW. The proposed method transforms raw thermal videos into spatial-temporal instances in four steps: video-wise normalization, removal of uninformative images, watershed segmentation, and spatial-temporal instance construction. The extracted spatial-temporal instances serve as the input data for training a DL-based NDE model. The proposed method is able to extract high-quality data with spatial-temporal correlations in the thermal videos, while being robust to the impact of unknown surface emissivity. Overall, our case studies demonstrate that the proposed method achieves better prediction of nugget thickness and diameter than predicting without the transformation.

42 ENGINEERING↗
DOE OSTI2020

2020 Transportation Research Board Workshop: Infrastructure Spatial Sensing at Intersections: The Potential to Enhance Safety and Enable Automation

The sensing technology that is enabling vehicle automation also can revolutionize traffic intersection safety, control, and efficiency. Infrastructure spatial sensing technology refers to the deployment of sensors that can detect and track all objects in the field of view - for example, mounting lidar sensors, radar, and video imaging at an intersection and fusing the data to produce a three-dimensional dynamic operational awareness. Combining such sensing capability with fail-safe vehicle communications can facilitate applications such as eco-approach and departure, optimizing efficient vehicle-signal coordination, and reducing traffic accidents through increasing safety. Furthermore, evidence is mounting suggesting that infrastructure-based sensing is needed in order to safely deploy automated public mobility alongside the normal vehicle and pedestrian traffic in our cities. Six speakers were invited to present their work from various aspects (safety, efficiency, and automation) addressing infrastructure-based sensing at the workshop on Infrastructure Spatial Sensing hosted in Washington DC as part of the Transportation Research Board Annual Meeting in January 12, 2019. A summary of the presentation are included herein.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

AC Magnetometry Using Nano-ferrofluid Cladded Multimode Interferometric Fiber Optic Sensors for Power Grid Monitoring Applications

The AC magnetic field response of the superparamagnetic nano-ferrofluid is an interplay between the Neel and Brownian relaxation processes and is generally quantified via the susceptibility measurements at high frequencies. The high frequency limit is dictated by these relaxation times which need to be shorter than the time scale of the time varying magnetic field for the nano-ferrofluid to be considered in an equilibrium state at each time instant. Even though the high frequency response of ferrofluid has been extensively investigated for frequencies up to GHz range by non-optical methods, harnessing dynamic response by optical means for AC magnetic field sensing in fiber-optic-based sensors-field remains unexplored. Instead, the incorporation of nano-ferrofluid as sensing materials has been only limited to DC magnetic field sensing, often citing their long response time as a limiting factor to AC field sensing. This work reports the finding of high frequency (up to 15 kHz) AC magnetic field sensing capability of nanomagnetic fluid as the cladding material of a fiber-optic multimode interferometry (MMI) structure optimized for the fourth self-imaging spectral response. The key parameter enabling high frequency response is the short response time (<1 ms) achieved by optimizing both the sensing structure and nano-ferrofluid solution. Focus has been imparted on 60 Hz line-frequency profiles of various current/magnetic fields to test the efficacy of these sensors in metering and monitoring current and current-induced magnetic fields in the electrical power grid systems. The magnetic field sensitivity of 240 mV/Gauss per dBm of transmitted power was achieved for 60 Hz field applied via Helmholtz coil, whereas the 60 Hz AC current sensitivity of 2.83 mV/A was measured due to magnetic field induced by current in a straight conducting wire.

42 ENGINEERING↗
DOE OSTI2024

Demonstration of Non-linear Optical Spectroscopy Enhancement utilizing Entangled Photons

Laser-based nonlinear optical spectroscopy approaches have enabled the direct sensing of important chemistry in nearly every fundamental or applied field of science. Yet in many applications, increased detectivity is needed to unravel fundamental mechanisms. One possibility is the use of quantum entanglement to increase detection cross-sections, but it is unproven that enhancement from quantum light extends to practical intensities for chemical sensing. In this report, we investigated the creation and use of entangled photons in nonlinear optical mixing for second harmonic generation and infrared imaging. We observe that the linear scaling of nonlinear mixing from entangled photon sources extends to the mW laser power regime, and enhances direct infrared imaging on Si-based charge coupled device cameras. These results motivate future experimentation on practical uses of entangled photons for nonlinear optical sensing applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Increased range and contrast in fog with circularly polarized imaging

Fogs, low lying clouds, and other highly scattering environments pose a challenge for many commercial and national security sensing systems. Current autonomous systems rely on optical sensors for navigation whose performance is degraded by highly scattering environments. In our previous simulation work, we have shown that polarized light can penetrate through a scattering environment such as fog. We have demonstrated that circularly polarized light maintains its initial polarization state better than linearly polarized light, even through large numbers of scattering events and thus ranges. This has recently been experimentally verified by other researchers. In this work, we present the design, construction, and testing of active polarization imagers at short-wave infrared and visible wavelengths. We explore multiple polarimetric configurations for the imagers, focusing on linear and circular polarization states. The polarized imagers were tested at the Sandia National Laboratories Fog Chamber under realistic fog conditions. Here, we show that active circular polarization imagers can increase range and contrast in fog better than linear polarization imagers. We show that when imaging typical road sign and safety retro-reflective films, circularly polarized imaging has enhanced contrast throughout most fog densities/ranges compared to linearly polarized imaging and can penetrate over 15 to 25 m into the fog beyond the range limit of linearly polarized imaging, with a strong dependence on the interaction of the polarization state with the target materials.

47 OTHER INSTRUMENTATION↗