Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Sampling Subjective Polygons for Patch-Based Deep Learning Land-Use Classification in Satellite Images

Model generalization remains a key challenge in the analysis of large amounts of heterogeneous satellite image data. One major limiting factor in developing generalizable models, in the context of supervised learning, is the lack of high quality training datasets. A model's capacity to perform well on new data is often inhibited by imbalance and bias in the data that was used for training. This is especially a problem when using convolutional neural networks to classify urban land-use in satellite images. Notable dataset imbalance issues in this application include land-use type imbalance and image scene imbalance. To begin understanding these dataset imbalance problems in more detail, we develop and test a number of sampling methods for generating training image datasets from subjective training polygons for urban land-use classification. We investigate sampling at different point densities as a means to reduce content repetition and therefore content imbalance and bias in the training image dataset.

Arndt, Jacob↗

GPU-based Image Compression for Efficient Compositing in Distributed Rendering Applications

Visualizations of large-scale data sets are often created on graphics clusters that distribute the rendering task amongst many processes. When using real-time GPU-based graphics algorithms, the most time-consuming aspect of distributed rendering is typically the com-positing phase - combining all partial images from each rendering process into the final visualization. Compo siting requires image data to be copied off the GPU and sent over a network to other processes. While compression has been utilized in existing distributed rendering compositors to reduce the data being sent over the network, this compression tends to occur after the raw images are transferred from the GPU to main memory. In this paper, we present work that leverages OpenGL / CUDA interoperability to compress raw images on the GPU prior to transferring the data to main memory. This approach can significantly reduce the device-to-host data transfer time, thus enabling more efficient compositing of images generated by distributed rendering applications.

Lipinksi, Riley↗

Enhancing Electron Microscopy Image Classification Using Data Augmentation

Manual labeling for machine learning tasks such as image classification is tedious and labor-intensive; as a result, scientific datasets suitable for deep learning applications are scarce and limited. While data augmentation techniques have shown promise for extending image datasets, very little work has been done to understand the impact of combining multiple augmentation methods sequentially or the limits of their effectiveness when combined. Our work addresses this gap by examining how standard and combinatorial data augmentation affects the performance of machine learning models when trained on small datasets for label classification tasks. For our analysis, we generate single, double and quadruple-augmented datasets for a microscopy image classification task using six standard augmentation methods, and compare the resultant improvements observed in binary classification accuracy with three standard image classification models (DenseNet169, MobileNetV2, ResNet101V2). Our experiments show a non-monotonic relationship between the number of simultaneous augmentation methods and classification accuracy, indicating that there is a trade-off between the degree of augmentation and the model performance. These findings suggest that the optimal number of augmentation methods will vary by domain and use case. We also find that the order in which augmentation methods are applied to a limited dataset matters when combining augmentation schemes, with our use case showing performance differences up to 2.6% when the augmentation order is reversed for double-augmented datasets. Our work offers insights to the limits of data augmentation when working on image classification tasks with limited datasets.

Welsman, Jordan A↗

3D Deep Learning Joint Inversion of Active Seismic Full Waveform and Passive Seismic Traveltime Data for Reservoir Imaging and Uncertainty Quantification

Here, we present deep learning (DL) networks for three-dimensional (3D) joint inversion of active seismic full waveform and passive seismic traveltime data to image reservoirs and their properties and quantify imaging uncertainties. Active seismic full-waveform data can provide high-resolution monitoring images but are collected only intermittently because of their high acquisition cost. In contrast, passive seismic data can be gathered at relatively low cost between regular active surveys, although their imaging quality can be compromised by factors such as low signal-to-noise ratios and limited ray coverage of the target. Although these datasets are routinely acquired together at CO 2 storage sites, their combined inversion within a 3D DL framework has not been previously demonstrated. To our knowledge, this is the first study to address this gap, combining the strength of both data types. For efficient data storage and DL training with large 3D seismic datasets, we use a 3D data matrix in which a random number of passive seismic traveltime data are stored as parabolic envelopes using one-hot encoding and a 3D full-waveform data matrix in which multiple shot gathers are summed. Two network architectures are evaluated: a single-encoder U-Net for single-data type inversion and a dual-encoder U-Net for joint inversion of active and passive seismic data. We also evaluate the single-encoder U-Net for joint inversion by concatenating full-waveform data and traveltime data. We propose a systematic approach for selecting an optimal dropout rate that balances regularization during training and Monte Carlo dropout-based uncertainty quantification during prediction by examining the correlation coefficient between standard deviation and prediction error, along with the training misfit, across a range of dropout rates. 3D DL inversion experiments include five different network configurations, with evaluations under ideal, noisy and dropout-enabled conditions. Both model and data uncertainties are assessed, as well as their combined effects. Across all conditions, the networks consistently predict accurate CO 2 saturation models with low prediction errors, such as a structural similarity index of 0.993 and CO 2 difference of 1.1%. Uncertainty estimates show strong spatial correlation with prediction errors, confirming the effectiveness of the proposed dropout selection approach. The results demonstrate that our DL approach, utilizing compact data representations and appropriate uncertainty quantification, yields accurate subsurface images under various inversion conditions and provides valuable insights into the reliability of predictions.

Um, Evan Schankee [Lawrence Berkeley National Labo↗

Influence of Data Acquisition Algorithms on X-ray Phase Contrast Imaging Computed Tomography

X-ray phase contrast imaging (XPCI) is a non-destructive evaluation technique that enables high-contrast detection of low-attenuation materials that are largely transparent in traditional radiography. Extending a grating based Talbot-Lau XPCI system to three- dimensional imaging with computed tomography (CT) imposes two motion requirements: the analyzer grating must translate transverse to the optical axis to capture image sets for XPCI reconstruction, and the sample must rotate to capture angular data for CT reconstruction. The acquisition algorithm choice determines the order of movement and positioning of the two stages. The choice of image acquisition algorithm for XPCI CT is instrumental to collecting high fidelity data for reconstruction. We investigate how data acquisition influences XPCI CT by comparing two simple data acquisition algorithms and determine that capturing a full phase-stepping image set for a CT projection before rotating the sample results in higher quality data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Unsupervised Image-Based Classification of Corrosion Severity in Automobile Engine Connecting Rods

Corrosion in engine connecting rods is a critical issue in the automotive industry, potentially leading to catastrophic engine failure, monetary losses, and safety hazards. The labor shortage in the industry further emphasizes the need for fast, accurate, and automated corrosion detection methods to ensure appropriate surface treatments can be applied to restore component integrity. We present an unsupervised image-based framework for classifying corrosion severity in automobile engine connecting rods using short-wave infrared (SWIR) and telecentric grayscale imaging. We employ the structural similarity index measure (SSIM) as a dissimilarity metric and the k-medians clustering algorithm for classification. Our algorithm achieves an overall accuracy of 80.64% for SWIR images, with 100% accuracy in classifying highly corroded samples. For grayscale images, the method attains an overall accuracy of 77.42%, with 90.91% accuracy for highly corroded samples. The method’s ability to work with different imaging modalities and its high accuracy in identifying severe corrosion cases make it a promising tool for automated corrosion assessment in the automotive industry, potentially improving efficiency and safety in engine component maintenance.

42 ENGINEERING↗

Development of polarization-sensitive optical coherence tomography imaging platform and metrics to quantify electrostimulation-induced peripheral nerve injury in vivo in a small animal model

Neuromodulation devices are rapidly evolving for the treatment of neurological diseases and conditions. Injury from implantation or long-term use without obvious functional losses is often only detectable through terminal histology. New technologies are needed that assess the peripheral nervous system (PNS) under normal and diseased or injured conditions. We aim to demonstrate an imaging and stimulation platform that can elucidate the biological mechanisms and impacts of neurostimulation in the PNS and apply it to the sciatic nerve to extract imaging metrics indicating electrical overstimulation. A sciatic nerve injury model in a 15-rat cohort was observed using a newly developed imaging and stimulation platform that can detect electrical overstimulation effects with polarization-sensitive optical coherence tomography. The sciatic nerve was electrically stimulated using a custom-developed nerve holder with embedded electrodes for 1 h, followed by a 1-h recovery period, delivered at above-threshold Shannon model k-values in experimental groups: sham control (SC, n = 5, 0.0 mA / 0 Hz), stimulation level 1 (SL1, n = 5, 3.4 mA / 50 Hz, and k = 2.57), and stimulation level 2 (SL2, n = 5, 6.8 mA / 100 Hz, and k = 3.17). The stimulation and imaging system successfully captured study data across the cohort. When compared to a SC after a 1-week recovery, the fascicle closest to the stimulation lead showed an average change of +4 % / – 309 % (SL1/SL2) in phase retardation and –79 % / – 148 % in optical attenuation relative to SC. Analysis of immunohistochemistry (IHC) shows a +1 % / – 36 % difference in myelin pixel counts and –13 % / + 29 % difference in axon pixel counts, and an overall increase in cell nuclei pixel count of +20 % / + 35 % . These metrics were consistent with IHC and hematoxylin/eosin tissue section analysis. The poststimulation changes observed in our study are manifestations of nerve injury and repair, specifically degeneration and angiogenesis. Optical imaging metrics quantify these processes and may help evaluate the safety and efficacy of neuromodulation devices.

60 APPLIED LIFE SCIENCES↗

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗

Coherent diffraction imaging in the undergraduate laboratory

We present an undergraduate optics instructional laboratory designed to teach skills relevant to a broad range of modern scientific and technical careers. In this laboratory project, students image a custom aperture using coherent diffraction imaging, while learning principles and skills related to digital image processing and computational imaging, including multidimensional Fourier analysis, iterative phase retrieval, noise reduction, finite dynamic range, and sampling considerations. After briefly reviewing these imaging principles, we describe the required experimental materials and setup for this project. Our experimental apparatus is both inexpensive and portable, and a software application we developed for interactive data analysis is freely available.

Porter, J. Nicholas↗

Iterative multi-task learning and inference from seismic images

Seismic interpretation aims to extract quantitative and interpretable attributes from a seismic image produced using some migration method to inform characteristics of a subsurface reservoir or target of interest. Current paradigms for computing seismic attributes mostly rely on single-task algorithms. We develop an iterative, multi-task machine learning method to learn and infer multiple attributes from a seismic image. This method is composed of two stages: a multi-task inference stage and a multi-modal, multi-task refinement stage. The basic mechanism of this method is that we train a multi-task inference neural network (NN) to estimate a set of attributes, including a relative geological time (RGT), a denoised higher-resolution (DHR) seismic image, and multiple fault attributes (including probability, dip, and strike), from a low-resolution, noisy seismic image; then we input the inferred attributes to a multi-task refinement NN to enhance the raw inference results iteratively. The two multi-task NNs are trained separately based on synthetic seismic images and associated attributes generated by a geological modeling algorithm. The software we intend to release is a PyTorch implementation of this multi-task learning method for both 2D and 3D cases along with scripts to run the training/validation. The algorithm and software can be a useful tool for automatic seismic interpretation.

Gao, Kai↗

Sandia Image Labeling Tool (SILT)

SAND2025-01840O Sandia Image Labeling Tool (SILT) is a Python tool that labels images for machine learning and other applications. SILT uploads JSON files to create a template for labeling an image. SILT can then upload images, including images that are tens of GB large and dynamically loads them in a manner that a user, with a very modest spec laptop, can handle. It then saves the label as a JSON using the template. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Pitts, Todd↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

Deep-ultraviolet ptychographic pocket-scope (DART): mesoscale lensless molecular imaging with label-free spectroscopic contrast

The mesoscale characterization of biological specimens has traditionally required compromises between resolution, field-of-view, depth-of-field, and molecular specificity, with most approaches relying on external labels. Here we present the Deep-ultrAviolet ptychogRaphic pockeT-scope (DART), a handheld platform that transforms label-free molecular imaging through intrinsic deep-ultraviolet spectroscopic contrast. By leveraging biomolecules’ natural absorption fingerprints and combining them with lensless ptychographic microscopy, DART resolves down to 308-nm linewidths across centimeter-scale areas while maintaining millimeter-scale depth-of-field. The system’s virtual error-bin methodology effectively eliminates artifacts from limited temporal coherence and other optical imperfections, enabling high-fidelity molecular imaging without lenses. Through differential spectroscopic imaging at deep-ultraviolet wavelengths, DART quantitatively maps nucleic acid and protein distributions with femtogram sensitivity, providing an intrinsic basis for explainable virtual staining. We demonstrate DART’s capabilities through imaging of tissue sections, cytopathology specimens, blood cells, and neural populations, revealing detailed molecular contrast without external labels. The combination of high-resolution molecular mapping and broad mesoscale imaging in a portable platform opens new possibilities from rapid clinical diagnostics, tissue analysis, to biological characterization in space exploration.

60 APPLIED LIFE SCIENCES↗

Advancing subsurface analysis: Integrating computer vision and deep learning for the near real-time interpretation of borehole image logs in the Illinois Basin-Decatur Project

The accurate quantification and mapping of subsurface natural fracture systems using borehole imaging logs are critical for the success of CO 2 sequestration in geologic formations, optimization of engineered geothermal systems, and hydrocarbon production enhancement. However, traditional interpretation processes suffer from time-consuming procedures and human bias. To address these challenges and expedite fracture analysis, we investigated the application of integrated computer vision and DL workflows to automate image log analysis. Specifically, the design of our workflow was crafted to swiftly detect fractures and baffles by using actual electrical resistivity of borehole wall from microresistivity imaging device alongside their binary representation. This novel approach significantly reduces computational time while providing invaluable insights. By incorporating conventional logging and microseismic data, we present a regional subsurface natural fracture mapping technique. Through the minimization of human bias in image log analysis, our automated workflow achieves reduced fracture interpretation time and costs while ensuring robust and reproducible results. We demonstrated the efficacy of our approach by applying the workflow to the Illinois Basin-Decatur Project site. The automated workflow successfully identified major fractured zones, multiple baffles, and an interbedded layer with a high resolution of 0.01 ft or 0.12 in. (0.3 cm) and can be upscaled to any desired resolution. Validation through microseismic and image log interpretations allows for accurate and near-real-time mapping of fractures and baffles, significantly enhancing CO 2 pressure forecasting and postinjection site care. Our approach stands out due to its robustness, consistency, and reduced computational cost compared with alternative feature extraction technologies. It presents exciting possibilities for advancing CO 2 sequestration and engineered geothermal efforts by offering comprehensive and efficient fracture mapping solutions. This technology can contribute significantly to the optimization of CO 2 sequestration projects, facilitating sustainable environmental practices, and combating climate change.

Geochemistry & Geophysics↗

Raw electron microscopy images for "The Importance of Nano-edges in Atomic Stencilling and Chiroptically Active Assembly of Patchy Gold Tetrahedra"

This dataset contains the raw transmission electron microscopy (TEM) and scanning electron microscopy (SEM) images used in the main figures of the paper “The Importance of Nano-edges in Atomic Stencilling and Chiroptically Active Assembly of Patchy Gold Tetrahedra (2026).” All the images were acquired at the Materials Research Laboratory, University of Illinois at Urbana-Champaign, by Qian Chen group. 1. We provide five subfolders, each named according to the corresponding figure numbers in the paper. 2. All files in the subfolders for Figures 1–3 and 5 are named as "Panel [letter]_*", where [letter] (e.g., a, b, c) represents the raw images used for the corresponding panels. 3. All files in the subfolder for Figure 4 correspond to panel f and show the configurations of patchy tetrahedra synthesized at varying concentrations of iodide and 2-naphthalenethiol. They are named "Experiment_[number]", where [number] represents the corresponding data points in the phase diagram. 4. In TEM images, the bright and dark regions indicate the polymer patches and nanoparticle cores, respectively. 5. In SEM images, the bright and dark regions indicate the nanoparticle cores and polymer patches, respectively. 6. Abbreviations in file names: HAADF-STEM (high-angle annular dark-field scanning transmission electron microscopy), PINEM (photon-induced near-field electron microscopy), and RCP/LCP (left-/right-handed circularly polarized).

chirality↗

Wavelength domain spatial frequency modulation imaging: enabling fiber optic delivery and detection

Spatial frequency modulation imaging (SPIFI) provides a simple architecture for modulating an extended illumination source that is compatible with single pixel imaging. We demonstrate wavelength domain SPIFI (WD-SPIFI) by encoding time-varying spatial frequencies in the spectral domain that can produce enhanced resolution images, like its spatial domain counterpart, spatial domain (SD) SPIFI. However, contrary to SD-SPIFI, WD-SPIFI enables remote delivery by single mode fiber, which can be attractive for applications where free-space imaging is not practical. Finally, we demonstrate a cascaded system incorporating WD-SPIFI in-line with SD-SPIFI enabling single pixel 2D imaging without any beam or sample scanning.

47 OTHER INSTRUMENTATION↗

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

60 APPLIED LIFE SCIENCES↗

Single-shot imaging with randomized structured illumination at a free electron laser

Stroboscopic nanoscale imaging with free electron laser light is revolutionizing our understanding of fast dynamics in heterogeneous systems. The short wavelength of X-ray and extreme ultraviolet radiation makes it possible to achieve nanoscale resolution, while resonance with atomic transitions gives access to electronic and magnetic degrees of freedom. Here, we report on our implementation of a recently developed imaging method, randomized probe imaging, at a free electron laser. The advantage of randomized probe imaging over existing methods is its compatibility with extended and strongly scattering samples. Our implementation delivers robust single-shot reconstructions at up to a full-pitch resolution of 400 nm over a field of view with a 40 µm diameter. We also demonstrate single-shot imaging of magnetic domain structures using circular dichroism at resonance, paving the way to future time-resolved studies of magnetic dynamics, shock physics, and the dynamics of collective electronic phases.

47 OTHER INSTRUMENTATION↗