Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Estimating Fine-Resolution Shortwave Broadband Albedo of Croplands from Harmonized Landsat and Sentinel-2 Data

Altered surface albedo due to land-cover conversions and management is a significant driver of global climate change. Albedo can be directly measured at ground stations, and remote sensing data can be used to scale-up albedo values to regional and global levels. Some previous studies have retrieved fine-resolution (10–30 m) instantaneous albedo and coarse-resolution (500–1000 m) daily mean albedo from remote sensing data, but they all required the input of Moderate Resolution Imaging Spectroradiometer (MODIS) albedo information at 500-m resolution, and none have assembled both instantaneous and daily albedo based exclusively on fine-resolution satellite data. Here, to address this issue, we compiled 387 instantaneous and 346 daily albedo records using field net radiometer measurements from the bioenergy croplands at the W. K. Kellogg Biological Station in southwest Michigan. We then connected these albedo records with a suite of variables derived from harmonized Landsat and Sentinel-2 data through two machine learning algorithms (random forest regression and extreme gradient boosting) to retrieve clear-sky instantaneous and daily shortwave broadband albedo. The performance statistics indicate reasonable accuracy of model results [root-mean-square error (RMSE)] around or below 0.03 except for snow-covered surfaces), suggesting that the retrieval of both instantaneous and daily albedo based exclusively on fine-resolution satellite data is promising. To facilitate the use of fine-resolution albedo products at the global level, future efforts need to include more albedo records of diverse surface cover types, as well as to accurately model daily albedo for cloudy days to address the “clear-sky bias.”

Harmonized Landsat and Sentinel-2↗
DOE OSTI2024

Corrosion Analysis of 121103072 (SAVY-4000)

A surveillance feedlist for fiscal year (FY) 2022 was developed with the intent to target containers with contents known to generate corrosive gasses. One SAVY-4000 (hereafter “SAVY”) container with a serial number 121103072 was selected due to the reasonable wattage and known molten salt extraction (MSE) material corrosive behavior. The material was measured at 3.08 W with approximately 200 g of material placed inside of the SAVY for 6.07 years. The inner packaging configuration included a ¼ Qt stainless steel slip top inner container and a sPVC bag-out bag enclosing the inner container. Visual observations of the container during retrieval revealed several concerning features on the exterior of the container, notably on the lid. Fig. 1 shows the container lid along with an inset image further magnifying the features of interest. The corroded tamper indicating device (TID) wire and the corroded radioactive material tag wire indicated that corrosive gas species for steel were produced during storage. Although the TID wire and rad tag wire are not the same composition as the SAVY body and lid, these are often used as an indicator of potential corrosion inside of the SAVY container. The oxide residing inside of the filter holes and significant buildup around one hole provided further evidence supporting the presence of corrosive species inside of the container.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Dose-efficient automatic differentiation for ptychographic reconstruction

Ptychography, as a powerful lensless imaging method, has become a popular member of the coherent diffractive imaging family over decades of development. The ability to utilize low-dose X-rays and/or fast scans offers a big advantage in a ptychographic measurement (for example, when measuring radiation-sensitive samples), but results in low-photon statistics, making the subsequent phase retrieval challenging. Here, we demonstrate a dose-efficient automatic differentiation framework for ptychographic reconstruction (DAP) at low-photon statistics and low overlap ratio. As no reciprocal space constraint is required in this DAP framework, the framework, based on various forward models, shows superior performance under these conditions. It effectively suppresses potential artifacts in the reconstructed images, especially for the inherent periodic artifact in a raster scan. We validate the effectiveness and robustness of this method using both simulated and measured datasets.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗
DOE OSTI2022

A Scalable Pipeline for Gigapixel Whole Slide Imaging Analysis on Leadership Class HPC Systems

Whole Slide Imaging (WSI) captures microscopic details of a patient's histopathological features at multiple res-olutions organized across different levels. Images produced by WSI are gigapixel-sized, and saving a single image in memory requires a few gigabytes which is scarce since a complicated model occupies tens of gigabytes. Performing a simple met-ric operation on these large images is also expensive. High-performance computing (HPC) can help us quickly analyze such large images using distributed training of complex deep learning models. One popular approach in analyzing these images is to divide a WSI image into smaller tiles (patches) and then train a simpler model with these reduced-sized but large numbers of patches. However, we need to solve three pre-processing challenges efficiently for pursuing this patch-based approach. 1) Creating small patches from a high-resolution image can result in a high number (hundreds of thousands per image) of patches. Storing and processing these images can be challenging due to a large number of I/O and arithmetic operations. To reduce I/Oand memory accesses, an optimal balance between the size and number of patches must exist to reduce I/O and memory accesses. 2) WSI images may have tiny annotated regions for cancer tissue and a significant portion with normal and fatty tissues; correct patch sampling should avoid dataset imbalance. 3) storing and retrieving many patches to and from disk storage might incur I/O latency while training a deep learning model. An efficient distributed data loader should reduce I/O latency during the training and inference steps. This paper explores these three challenges and provides empirical and algorithmic solutions deployed on the Summit supercomputer hosted at the Oak Ridge Leadership Computing Facility.

Dash, Sajal↗
DOE OSTI2020

Proof-of-concept Talbot–Lau x-ray interferometry with a high-intensity, high-repetition-rate, laser-driven K-alpha source

Talbot–Lau x-ray interferometry is a grating-based phase-contrast technique, which enables measurement of refractive index changes in matter with micrometric spatial resolution. The technique has been established using a variety of hard x-ray sources, including synchrotron, free-electron lasers, and x-ray tubes, and could be used in the optical range for low-density plasmas. The tremendous development of table-top high-power lasers makes the use of high-intensity, laser-driven K-alpha sources appealing for Talbot–Lau interferometer applications in both high-energy-density plasma experiments and biological imaging. To this end, we present the first, to the best of our knowledge, feasibility study of Talbot–Lau phase-contrast imaging using a high-repetition-rate laser of moderate energy (100 mJ at a repetition rate of 10 Hz) to irradiate a copper backlighter foil. The results from up to 900 laser pulses were integrated to form interferometric images. A constant fringe contrast of 20% is demonstrated over 100 accumulations, while the signal-to-noise ratio continued to increase with the number of shots. Phase retrieval is demonstrated without prior ex-situ phase stepping. Instead, correlation matrices are used to compensate for the displacement between reference acquisition and the probing of a PMMA target rod. The steps for improved measurements with more energetic laser systems are discussed. The final results are in good agreement with the theoretically predicted outcomes, demonstrating the applicability of this diagnostic to a range of laser facilities for use across several disciplines.

Bouffetier, V. (ORCID:0000000160791260)↗
DOE OSTI2022

The Illumination of Thunderclouds by Lightning: 3. Retrieving Optical Source Altitude

Abstract Optical space‐based lightning sensors such as the Geostationary Lightning Mapper (GLM) detect and geolocate lightning by recording rapid changes in cloud top illumination. While lightning locations can be determined to within a pixel on the GLM imaging array, these instruments are not individually able to natively report lightning altitude. It has previously been shown that thunderclouds are illuminated differently based on the altitude of the optical source. In this study, we examine how altitude information can be extracted from the spatial distributions of GLM energy recorded from each optical pulse. We match GLM “groups” with Lightning Mapping Array (LMA) source data that accurately report the 3‐D positions of coincident Radio‐Frequency (RF) emitters. We then use machine learning methods to predict the mean LMA source altitudes matched to GLM groups using metrics from the optical data that describe the amplitude, breadth, and texture of the group spatial energy distribution. The resulting model can predict the LMA mean source altitude from GLM group data with a median absolute error of <1.5 km, which is sufficient to determine the location of the charge layer where the optical energy originated. This model is able to capture changes to the source altitude distribution in response to convective processes in the thunderstorm, and the GLM predictions can reveal the vertical structure of individual flashes ‐ enabling 3‐D flash geolocation with GLM for the first time. Future work will account for differences in thunderstorm charge/precipitation structures and viewing angle across the GLM Field of View.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Studying drought-induced forest mortality using high spatiotemporal resolution evapotranspiration data from thermal satellite imaging

Drought can have pervasive and wide-spread impacts to forest health, as evidenced in several severe events occurring over the recent decades. Extensive forest die-off due to drought can impair the ecological functioning of forests, impacting habitat, water yield and quality from forested lands, and altering forest fire dynamics and intensity. Satellite remote sensing provides an effective means for detecting and monitoring spatial patterns of forest mortality over large areas, exploiting free and open long-term image archives available at a range in spatial and temporal resolutions. While remotely sensed surface reflectances and vegetation indices have been widely used to study optical response of forest canopies to drought events, retrievals of evapotranspiration (ET) derived from thermal satellite imagery – particularly at resolutions approaching crown scale - can provide insights into cumulative tree stresses that can incite disease and trigger mortality. In this study, we applied a multi-sensor satellite data fusion approach to estimate daily 30-m resolution ET and an associated Evaporative Stress Index (ESI) to study drought-induced mortality in a temperate forest at the Missouri Ozark AmeriFlux (MOFLUX) site, located in the central United States. The study covered the period from 2010 to 2014, including an exceptional drought year of 2012. Modeled ET agreed well with eddy flux measurements from the MOFLUX tower, with average monthly relative errors of 15%. Plot-scale ESI, describing temporal anomalies in the ratio of actual-to-reference ET, was used as an index of relative forest health to investigate relationships between forest mortality and drought severity. ESI showed good agreement with observed predawn leaf water potential, especially during the drought year. Furthermore, plot-scale ESI was also correlated with the subsequent year's tree mortality, suggesting the importance of considering the forest health condition prior to drought when studying drought-induced forest impacts. This study demonstrates the utility of multi-year ET remote sensing data at the stand or plot scale as an indicator of forest health and as a predictor of future mortality due to drought.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

X-ray scattering based scanning tomography for imaging and structural characterization of cellulose in plants

X-ray and neutron scattering have long been used for structural characterization of cellulose in plants. Due to averaging over the illuminated sample volume, these measurements traditionally overlooked the compositional and morphological heterogeneity within the sample. Here, a scanning tomographic imaging method is described, using contrast derived from the X-ray scattering intensity, for virtually sectioning the sample to reveal its internal structure at a resolution of a few micrometres. This method provides a means for retrieving the local scattering signal that corresponds to any voxel within the virtual section, enabling characterization of the local structure using traditional data-analysis methods. This is accomplished through tomographic reconstruction of the spatial distribution of a handful of mathematical components identified by non-negative matrix factorization from the large dataset of X-ray scattering intensity. Joint analysis of multiple datasets, to find similarity between voxels by clustering of the decomposed data, could help elucidate systematic differences between samples, such as those expected from genetic modifications, chemical treatments or fungal decay. The spatial distribution of the microfibril angle can also be analyzed, based on the tomographically reconstructed scattering intensity as a function of the azimuthal angle.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Using Dark Fiber and Distributed Acoustic Sensing to Characterize a Geothermal System in the Imperial Valley, Southern California

The Imperial Valley, CA, is a tectonically active transtensional basin located south of the Salton Sea; the area hosts numerous geothermal fields, including significant hidden hydrothermal resources without surface manifestations. Development of inexpensive, rugged, and highly sensitive exploration techniques for undiscovered geothermal systems is critical for accelerating geothermal power deployment as well as unlocking a low-carbon energy future. We present a case study utilizing distributed acoustic sensing (DAS) and ambient noise interferometry for geothermal reservoir imaging, utilizing unlit fiber-optic telecommunication infrastructure (dark fiber). The study exploits two days of passive DAS data acquired in early November 2020 over a ~28-km section of fiber from Calipatria, CA to Imperial, CA. We apply ambient noise interferometry to retrieve coherent signals from DAS records and develop a bin stacking technique to attenuate the effects from persistent localized noise sources and to enhance retrieval of coherent surface waves. As a result, we are able to obtain high-resolution two-dimensional (2D) S wave velocity ($V_s$) structure to 3 km depth, based on joint inversion of both the fundamental and higher overtones. We observe a previously unmapped high $V_s$ and low $V_p$/$V_s$ ratio feature beneath the Brawley geothermal system, which we interpret to be a zone of hydrothermal mineralization and lower porosity. This interpretation is consistent with a host of other measurements including surface heat flow, gravity anomalies, and available borehole wireline data. These results demonstrate the potential utility of DAS deployed on dark fiber for geothermal system exploration and characterization in the appropriate geological settings.

Vp/Vs imaging↗
DOE OSTI2021

Generative Patch Priors for Practical Compressive Image Recovery

In this work, we propose the generative patch prior (GPP) that defines a generative prior for compressive image recovery, based on patch-manifold models. Unlike learned, image-level priors that are restricted to the range space of a pre-trained generator, GPP can recover a wide variety of natural images using a pre-trained patch generator. Additionally, GPP retains the benefits of generative priors like high reconstruction quality at extremely low sensing rates, while also being much more generally applicable. We show that GPP outperforms several unsupervised and supervised techniques on three different sensing models – linear compressive sensing with known, and unknown calibration settings, and the non-linear phase retrieval problem. Finally, we propose an alternating optimization strategy using GPP for joint calibration-and-reconstruction which performs favorably against several baselines on a real world, uncalibrated compressive sensing dataset. The code and models for GPP are available on github.

compressed sensing↗
DOE OSTI2024

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗
DOE OSTI2025

High-fidelity holographic beam shaping with optimal transport and phase diversity

A phase-only spatial light modulator (SLM) provides a powerful way to shape laser beams into arbitrary intensity patterns but at the cost of a hard computational problem of determining an appropriate SLM phase. Here, we show that optimal transport methods can generate approximate solutions to this problem that serve as excellent initializations for iterative phase retrieval algorithms, yielding vortex-free solutions with superior accuracy and efficiency. Additionally, we show that analogous algorithms can be used to measure the intensity and phase of the input beam incident upon the SLM via phase diversity imaging. These techniques furnish flexible and convenient solutions to the computational challenges of beam shaping with an SLM.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

A three-dimensional reconstruction algorithm for scanning transmission electron microscopy data from thick samples

Increasing interest in three-dimensional nanostructures adds impetus to electron microscopy techniques capable of imaging at or below the nanoscale in three dimensions. We present a reconstruction algorithm that takes as input a focal series of four-dimensional scanning transmission electron microscopy (4D-STEM) data and transcends the prevalent structure retrieval algorithm assumption of a very thin specimen homogenous along the optic axis. We demonstrate this approach by reconstructing the different layers of a lead iridate (Pb$_2$Ir$_2$O$_7$) and yttrium-stabilized zirconia (Y$_{0.095}$Zr$_{0.905}$O$_2$) heterostructure from data acquired with the specimen in a single plan-view orientation, with the epitaxial layers stacked along the beam direction.

Brown, Hamish G↗
DOE OSTI2024

Survey of gravitationally lensed objects in HSC imaging (SuGOHI) – X. Strong lens finding in the HSC-SSP using convolutional neural networks

ABSTRACT We apply a novel model based on convolutional neural networks (CNN) to identify gravitationally lensed galaxies in multiband imaging of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) Survey. The trained model is applied to a parent sample of 2350 061 galaxies selected from the $\sim$ 800 deg$^2$ Wide area of the HSC-SSP Public Data Release 2. The galaxies in HSC Wide are selected based on stringent pre-selection criteria, such as multiband magnitudes, stellar mass, star formation rate, extendedness limit, photometric redshift range, etc. The trained CNN assigns a score from 0 to 1, with 1 representing lenses and 0 representing non-lenses. Initially, the CNN selects a total of 20 241 cutouts with a score greater than 0.9, but this number is subsequently reduced to 1522 cutouts after removing definite non-lenses for further visual inspection. We discover 43 grade A (definite) and 269 grade B (probable) strong lens candidates, of which 97 are completely new. In addition, we also discover 880 grade C (possible) lens candidates, 289 of which are known systems in the literature. We identify 143 candidates from the known systems of grade C that had higher confidence in previous searches. Our model can also recover 285 candidate galaxy-scale lenses from the Survey of Gravitationally lensed Objects in HSC Imaging (SuGOHI), where a single foreground galaxy acts as the deflector. Even though group-scale and cluster-scale lens systems are not included in the training, a sample of 32 SuGOHI-c (i.e. group/cluster-scale systems) lens candidates is retrieved. Our discoveries will be useful for ongoing and planned spectroscopic surveys, such as the Subaru Prime Focus Spectrograph project, to measure lens and source redshifts in order to enable detailed lens modelling.

Jaelani, Anton T. (ORCID:0000000162825778)↗
DOE OSTI2021

Effect of sample anisotropy on scanning near-field optical microscope images

Scattering-type scanning near-field optical microscopy (s-SNOM) has been widely used to characterize strongly correlated electronic, two dimensional, and plasmonic materials, and it has enormous potential for biological applications. Many of these materials exhibit anisotropic responses that complicate the extraction of dielectric constants from s-SNOM measurements. Here, we generalize our recently developed approach for retrieving the near-field scattering signal from isotropic systems and apply it to anisotropic dielectrics. Specifically, we compare our theoretical results with experimental measurements on modestly anisotropic sapphire that exhibit strong resonances at the infrared frequency range. Good agreement with the experimental result is found. Finally, our result is important for understanding the near-field response of low damping, anisotropic polaritonic states in dielectric media.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Wildfire Smoke Particle Properties and Evolution, from Space-Based Multi-Angle Imaging

Emitted smoke composition is determined by properties of the biomass burning source and ambient ecosystem. However, conditions that mediate the partitioning of black carbon (BC) and brown carbon (BrC) formation, as well as the spatial and temporal factors that drive particle evolution, are not understood adequately for many climate and air-quality related modeling applications. In situ observations provide considerable detail about aerosol microphysical and chemical properties, although sampling is extremely limited. Satellites offer the frequent global coverage that would allow for statistical characterization of emitted and evolved smoke, but generally lack microphysical detail. However, once properly validated, data from the National Aeronautics and Space Administration (NASA) Earth Observing System’s Multi-Angle Imaging Spectroradiometer (MISR) instrument can create at least a partial picture of smoke particle properties and plume evolution. We use in situ data from the Department of Energy’s Biomass Burning Observation Project (BBOP) field campaign to assess the strengths and limitations of smoke particle retrieval results from the MISR Research Aerosol (RA) retrieval algorithm. We then use MISR to characterize wildfire smoke particle properties and to identify the relevant aging factors in several cases, to the extent possible. The RA successfully maps qualitative changes in effective particle size, light absorption, and its spectral dependence, when compared to in situ observations. By observing the entire plume uniformly, the satellite data can be interpreted in terms of smoke plume evolution, including size-selective deposition, new-particle formation, and locations within the plume where BC or BrC dominates.

54 ENVIRONMENTAL SCIENCES↗