Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

TXM-Sandbox : an open-source software for transmission X-ray microscopy data analysis

A transmission X-ray microscope (TXM) can investigate morphological and chemical information of a tens to hundred micrometre-thick specimen on a length scale of tens to hundreds of nanometres. It has broad applications in material sciences and battery research. TXM data processing is composed of multiple steps. A workflow software has been developed that integrates all the tools required for general TXM data processing and visualization. The software is written in Python and has a graphic user interface in Jupyter Notebook . Users have access to the intermediate analysis results within Jupyter Notebook and have options to insert extra data processing steps in addition to those that are integrated in the software. The software seamlessly integrates ImageJ as its primary image viewer, providing rich image visualization and processing routines. As a guide for users, several TXM specific data analysis issues and examples are also presented.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Image Alignment and Flat-Field Correction of Film and Computed Radiography Images on the LLNL Flash Testbed

Computed radiography (CR) imaging plates and film are used in HEAF firing tanks and in the NDE group. The imaging plates allow for the creation of high-resolution digital images with flash X-ray (FXR). A typical treatment of flash X-ray radiographs is flat-field correction, where the image from an experiment is normalized by a “flat-field” or “bright-field” image. This flat-field image is taken in an identical configuration to the experimental image, but without the object or experiment in the field of view (FOV). This treatment reduces spatial effects from the FXR spot size and detector misalignment, as each pixel value in the corrected image represents a ratio of collected radiation with the object in FOV to the collected radiation without the object in FOV. One challenge in the creation of a corrected image is the misalignment of the CR plate or film pack between capturing the flat-field image and the experimental image. Fiducial structures can remedy this issue. Small (3.18mm) stainless steel ball bearings serve as good fiducial structures due to their small size and high radiographic contrast. Spheres are view-agnostic geometry, always presenting a circular cross section no matter the orientation. This process was developed for images from the flash X-ray testbed. The flash testbed was used to compare the X-ray transmission at different thicknesses of aluminum and copper step wedges. Each step wedge section is a rectangular shape, so evaluation is made much simpler if the rectangles are not rotated with respect to the image. This alignment process aligns the object and flat-field images together and leaves the rectangles of each step aligned with the image.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning

Cover cropping between cash crop growing seasons is a multifunctional conservation practice. Timely and accurate monitoring of cover crop traits, notably aboveground biomass and nutrient content, is beneficial to agricultural stakeholders to improve management and understand outcomes. Currently, there is a scarcity of spatially and temporally resolved information for assessing cover crop growth. Remote sensing has a high potential to fill this need, but conventional empirical regression operated with coarse-resolution multispectral data has large uncertainties. Therefore, this study utilized airborne hyperspectral imaging techniques and developed new process-guided machine learning approaches (PGML) for cover crop monitoring. Specifically, we deployed an airborne hyperspectral system covering visible to shortwave-infrared wavelengths (400–2400 nm) to acquire high spatial (0.5 m) and spectral (3–5 nm) resolution reflectance over 23 cover crop fields across Central Illinois in March and April of 2021. Airborne hyperspectral surface reflectance with high spectral and spatial resolution can be well matched with field data to quantify cover crop traits. Furthermore, the PGML models were pre-trained by synthetic data from soil-vegetation radiative transfer modeling (one million records), and then fine-tuned with field data of cover crop biomass and nutrient content. Results show that airborne hyperspectral data with PGML can achieve high accuracy to predict cover crop aboveground biomass (R 2 = 0.72, relative RMSE = 15.16%) and nitrogen content (R 2 = 0.69, relative RMSE = 16.59%) through leave-one-field-out cross-validation. Unlike the pure data-driven approach (e.g., partial least-squares regression), PGML incorporated radiative transfer knowledge and obtained higher predictive performance with fewer field data. Meanwhile, with field data for model fine-tuning, PGML predicted biomass more accurately than the inversion of radiative transfer models. Here we also found that the red edge has a high contribution in quantifying aboveground biomass and nitrogen content, followed by green and shortwave spectra. This study demonstrated the first attempt of utilizing hyperspectral remote sensing to accurately quantify cover crop traits. We highlight the strength of PGML in exploiting sensing data to quantify ecosystem variables to advance agroecosystem monitoring for sustainable agricultural management.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Imaging high jitter, very fast phenomena: A remedy for shutter lag

Dielectric breakdown is an example of a natural phenomenon that occurs on very short time scales, making it incredibly difficult to capture optical images of the process. Event initiation jitter is one of the primary challenges, as even a microsecond of jitter time can cause the imaging attempt to fail. Initial attempts to capture images of dielectric breakdown using a gigahertz frame rate camera and an exploding bridge wire initiation were stymied by high initiation jitter. Subsequently, a novel optical delay line apparatus was developed in order to effectively circumvent the jitter and reliably image dielectric breakdown. Here, the design and performance of the optical delay line apparatus are presented. The optical delay line increased the image capture success rate from 25% to 94% while also permitting enhanced temporal resolution and has application in imaging other high-jitter, extremely fast phenomena.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Atomic force microscopy phase imaging of epitaxial graphene films

Abstract Dynamic mode atomic force microscopy phase imaging is known to produce distinct contrast between graphene areas of different atomic thickness. But the intrinsic complexity of the processes controlling the tip motion and the phase angle shift excludes its use as an independent technique for a quantitative type of analysis. By investigating the relationship between the phase shift, the tip-surface interaction, and the thickness of the epitaxial graphene areas grown on silicon carbide, we shed light on the origin of such phase contrast, and on the complex energy dissipation processes underlying phase imaging. In particular, we study the behavior of phase shift and energy dissipation when imaging the interfacial buffer layer, single-layer, and bilayer graphene regions as a function of the tip-surface separation and the interaction forces. Finally, we compare these results with those obtained on differently-grown quasi free standing single- and bilayer graphene samples.

Lavini, Francesco (ORCID:0000000257223040)↗
DOE OSTI2021

Detecting Low Surface Brightness Galaxies with Mask R-CNN

Low surface brightness galaxies (LSBGs), galaxies that are fainter than the dark night sky, are famously difficult to detect. However, studies of these galaxies are essential to improve our understanding of the formation and evolution of low-mass galaxies. In this work, we train a deep learning model using the Mask R-CNN framework on a set of simulated LSBGs inserted into images from the Dark Energy Survey (DES) Data Release 2 (DR2). This deep learning model is combined with several conventional image pre-processing steps to develop a pipeline for the detection of LSBGs. We apply this pipeline to the full DES DR2 coadd image dataset, and preliminary results show the detection of 22 large, high-quality LSBG candidates that went undetected by conventional algorithms. Furthermore, we find that Galactic cirrus represents the largest contaminant in our resulting candidate list.

Levy, Caleb↗
DOE OSTI2020

Machine Learning Algorithms for Automated NIF Capsule Mandrel Selection

Small shells, approximately 2 mm in diameter, made from Poly(α-methylstyrene) (PAMS) are used as mandrels in the production of glow discharge polymer capsules located at the center of inertial confinement fusion experiments. The visual inspection process of microscope images of these shell mandrels, including detection of micron-sized defects on the shell surface as well as the handling and sorting, is a very labor-intensive, repetitive, and highly subjective process that stands to benefit greatly from automation. As part of an effort to decrease the number of labor hours spent in capsule handling, inspection, and metrology, the development of robotic systems was presented in a paper by Carlson et al., “Automation in Target Fabrication” [Fusion Sci. Technol., Vol. 70, p. 274 (2016)]. The current work expands the automated image acquisition systems developed previously and adds the use of convolutional neural networks to select capsules best suited for use in the downstream production process. Through the use of these machine learning algorithms, the selection process becomes robust, repeatable, and operator independent. Finally, as an added benefit the system developed as part of this work is able to provide defect statistics on entire shell batches and feed this information upstream to the production team.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

The Urban Observatory: A Multi-Modal Imaging Platform for the Study of Dynamics in Complex Urban Systems

We describe an “Urban Observatory” facility designed for the study of complex urban systems via persistent, synoptic, and granular imaging of dynamical processes in cities. An initial deployment of the facility has been demonstrated in New York City and consists of a suite of imaging systems—both broadband and hyperspectral—sensitive to wavelengths from the visible (∼400 nm) to the infrared (∼13 micron) operating at cadences of ∼0.01–30 Hz (characteristically ∼0.1 Hz). Much like an astronomical survey, the facility generates a large imaging catalog from which we have extracted observables (e.g., time-dependent brightnesses, spectra, temperatures, chemical species, etc.), collecting them in a parallel source catalog. We have demonstrated that, in addition to the urban science of cities as systems, these data are applicable to a myriad of domain-specific scientific inquiries related to urban functioning including energy consumption and end use, environmental impacts of cities, and patterns of life and public health. We show that an Urban Observatory facility of this type has the potential to improve both a city’s operations and the quality of life of its inhabitants.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis

In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗
DOE OSTI2020

Multimodal Imaging of Autofluorescent Sites Reveals Varied Chemical Speciation in SSZ-13 Crystals

Here, a multimodal imaging study of chabazite is used to show the distribution of and discriminate between different emissive deposits arising as a result of the detemplation process. 3D confocal imaging, fluorescence lifetime imaging, spectral imaging, and Raman mapping are used to show three different types of emissive behaviours each characterised by different spatial distributions, trends in lifetime, spectral signals, and Raman signatures. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits, which experience lifetime augmentation due to spatial confinement. The distribution of organic residue throughout the crystal volume is comparable to XRF mapping that shows Si enrichment on the outer edges and higher Al content through the centre, demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Direct evidence of the dominant role of multiphoton permanent-dipole transitions in strong-field dissociation of NO 2 +

We study laser-induced dissociation of a metastable NO 2+ ion-beam target into N + +O + , focusing on the prominent contribution by molecules breaking parallel to the polarization at high peak laser intensity (~10 15 W/cm 2 ). Our experimental results and time-dependent Schrödinger equation calculations show that, contrary to commonly held intuition that electronic transitions always prevail, the dominant process underlying this highly aligned dissociation is a multiphoton permanent-dipole transition involving only the electronic ground state and leading to its vibrational continuum. Strong-field permanent-dipole transitions should thus be considered generally, as they may play a significant role in other heteronuclear molecules. Moreover, their role should only grow in importance for longer wavelengths, a trending direction in ultrafast laser studies.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2026

Conditional Latent Diffusion for High-Resolution Prediction of Electrochemical Surface Morphology

A conditionally guided generative latent diffusion process that is trained on a set of experimental processing parameters and their associated resulting electron microscope images of the electrodeposition process is able to interpolate between processing parameters in a physically consistent way. Electrodeposition of rhenium with pulse and pulse-reverse waveforms is used as a model system, and the process is adaptable to other electrodeposition, electropolishing, or corrosion processes. The method is able to extrapolate, predicting estimates of material morphologies for experimental setups unseen in the training data. The results are demonstrated with experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Quantifying Moss Response to Metal Contaminant Exposure Using Laser-Induced Fluorescence

Tracing sources of contamination, including potentially toxic elements (PTEs), has historically been achieved through sampling and analysis of soil or biota, which are labor-intensive, costly, and destructive methods. Thus, availability of a non-destructive in situ remote sensing method for monitoring metals deposited in biota is of great interest. Laser-induced fluorescence (LIF) is an emerging spectroscopic and imaging technique that documents changes in molecular energy level in plants as a biological response to metal contamination. For a proof-of-concept study and preliminary experiment, moss was selected for experimentation due to its long history of use in tracing atmospheric deposition of PTEs. Consecutive treatments of copper chloride (CuCl2) were administered to three moss samples, simulating wet deposition every 48 h over 10 days until reaching cumulative Cu concentrations of 2.690 to 8.075 μmol/cm2. While these Cu amounts are above environmentally relevant concentrations, they allowed the best conditions for testing and fine tuning of the imaging and data processing protocols presented in this paper. Moss fluorescence was induced using both 532 nm green and 355 nm UV lasers. A CMOS camera captured images of the LIF response, and red–green–blue (RGB) decimal code values were extracted for each pixel in the images, and pixel densities of color channels from treated and untreated moss samples were compared. Results show a shift towards lower color decimal codes corresponding to increased Cu concentration. We developed and contrasted multiple quantitative analyses of color distributions and demonstrated that LIF shows great promise for remote sensing of Cu accumulation in moss at μmol/cm2 levels. Though currently, the method would be limited to highly toxic sites, it illustrates the possibility and provides a framework for development of higher-sensitivity methods to detect nmol/cm2 that are viable for urban contamination level monitoring.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2023

Proof of principle study: synchrotron X-ray fluorescence microscopy for identification of previously radioactive microparticles and elemental mapping of FFPE tissues

Biobanks containing formalin-fixed, paraffin-embedded (FFPE) tissues from animals and human atomic-bomb survivors exposed to radioactive particulates remain a vital resource for understanding the molecular effects of radiation exposure. These samples are often decades old and prepared using harsh fixation processes which limit sample imaging options. Optical imaging of hematoxylin and eosin (H&E) stained tissues may be the only feasible processing option, however, H&E images provide no information about radioactive microparticles or radioactive history. Synchrotron X-ray fluorescence microscopy (XFM) is a robust, non-destructive, semi-quantitative technique for elemental mapping and identifying candidate chemical element biomarkers in FFPE tissues. Still, XFM has never been used to uncover distribution of formerly radioactive micro-particulates in FFPE canine specimens collected more than 30 years ago. In this work, we demonstrate the first use of low-, medium-, and high-resolution XFM to generate 2D elemental maps of ~ 35-year-old, canine FFPE lung and lymph node specimens stored in the Northwestern University Radiobiology Archive documenting distribution of formerly radioactive micro-particulates. Additionally, we use XFM to identify individual microparticles and detect daughter products of radioactive decay. The results of this proof-of-principle study support the use of XFM to map chemical element composition in historic FFPE specimens and conduct radioactive micro-particulate forensics.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗
DOE OSTI2021

An Artificial Intelligence-Assisted Method for Dementia Detection Using Images from the Clock Drawing Test

Background: Widespread dementia detection could increase clinical trial candidates and enable appropriate interventions. Since the Clock Drawing Test (CDT) can be potentially used for diagnosing dementia-related disorders, it can be leveraged to develop a computer-aided screening tool. Objective: To evaluate if a machine learning model that uses images from the CDT can predict mild cognitive impairment or dementia. Methods: Images of an analog clock drawn by 3,263 cognitively intact and 160 impaired subjects were collected during in-person dementia evaluations by the Framingham Heart Study. We processed the CDT images, participant’s age, and education level using a deep learning algorithm to predict dementia status. Results: When only the CDT images were used, the deep learning model predicted dementia status with an area under the receiver operating characteristic curve (AUC) of 81.3% ± 4.3%. A composite logistic regression model using age, level of education, and the predictions from the CDT-only model, yielded an average AUC and average F1 score of 91.9% ±1.1% and 94.6% ±0.4%, respectively. Conclusion: Our modeling framework establishes a proof-of-principle that deep learning can be applied on images derived from the CDT to predict dementia status. When fully validated, this approach can offer a cost-effective and easily deployable mechanism for detecting cognitive impairment.

Neurosciences & Neurology↗