SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2021

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗

DOE OSTI2020

Machine learning-based multidomain processing for texture-based image segmentation and analysis

Atomic and molecular resolved atomic force microscopy (AFM) images offer unique insights into materials' properties such as local ordering, molecular orientation, and topological defects, which can be used to pinpoint physical and chemical interactions occurring at the surface. Utilizing machine learning for extracting underlying physical parameters increases the throughput of AFM data processing and eliminates inconsistencies intrinsic to manual image analysis, thus enabling the creation of reliable frameworks for qualitative and quantitative evaluation of experimental data. Here, we present a robust and scalable approach to the segmentation of AFM images based on flexible pre-selected classification criteria. The usage of supervised learning and feature extraction allows us to retain the consideration of specific problem-dependent features (such as types of periodical structures observed in the images and the associated numerical parameters: spacing, orientation, etc.). We highlight the applicability of this approach for the segmentation of molecular resolved AFM images based on the crystal orientation of the observed domains, automated selection of boundaries, and collection of relevant statistics. Finally, we outline a general strategy for machine learning-enabled analysis of nanoscale systems exhibiting periodic order that could be applied to any analytical imaging technique

36 MATERIALS SCIENCE↗

DOE OSTI2025

Computing virtual dark-field X-ray microscopy images of complex discrete dislocation structures from large-scale molecular dynamics simulations

Dark-field X-ray microscopy (DFXM) is a novel diffraction-based imaging technique that non-destructively maps the local deformation from crystalline defects in bulk materials. While studies have demonstrated that DFXM can spatially map 3D defect geometries, it is still challenging to interpret DFXM images of the high-dislocation-density systems relevant to macroscopic crystal plasticity. This work develops a scalable forward model to calculate virtual DFXM images for complex discrete dislocation structure(s) (DDS) obtained from atomistic simulations. Our new DDS-DFXM model integrates a non-singular formulation for calculating the local strain from the DDS and an efficient geometrical optics algorithm for computing the DFXM image from the strain field. We apply the model to complex DDS obtained from a large-scale molecular dynamics simulation of compressive loading on single-crystal silicon. Simulated DFXM images exhibit prominent contrast for dislocation features between the multiple slip systems, demonstrating the potential of DFXM to resolve features from dislocation multiplication. In conclusion, the integrated DDS-DFXM model provides a toolbox for DFXM experimental design and image interpretation in the context of bulk crystal plasticity for a range of measurements across shock plasticity and the broader materials science community.

X-ray imaging↗

DOE OSTI2025

Ultraviolet Fluorescence Imaging for Photovoltaic Module Metrology: Best Practices and Survey of Features Observed in Fielded Modules

As the photovoltaics (PV) industry grows in sophistication, so must the extent to which systems are characterized. UV Fluorescence (UVF) imaging is a valuable, easy-to-perform, high-throughput, nonintrusive technique for characterizing modules in the field and in the lab. However, UVF is still a relatively new technique, and many in the PV industry are still unaware of its potential. We provide a guideline for obtaining, processing, and interpreting UVF images. We have provided a list of considerations for imaging hardware and settings, a suggested pipeline for image processing, and details on a survey of features shown in UVF images. As a result, a new database with UVF images of 7190 modules and another database curated by BrightSpot Automation are publicly available.

14 SOLAR ENERGY↗

DOE OSTI2024

MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis

Deep neural networks have demonstrated impressive results in medical image analysis, but designing suitable architectures for each specific task is expertise dependent and time consuming. Neural architecture search (NAS) offers an effective means of discovering architectures. It has been highly successful in numerous applications, particularly in natural image classification. Yet, medical images possess unique characteristics, such as small regions and a wide variety of lesion sizes, that differentiate them from natural images. Furthermore, most current NAS methods struggle with high computational costs, especially when dealing with high-resolution image datasets. In this article, we present a novel evolutionary NAS method called multiscale training-free neural architecture search (MSTF-NAS) to address these challenges. Specifically, to accommodate the broad range of lesion region sizes in disease diagnosis, we develop a new reduction cell search space that enables the search algorithm to explicitly identify the optimal scale combination for multiscale feature extraction. Further, to overcome the issue of high computational costs, we utilize training-free indicators as performance measures for candidate architectures, which allows us to search for the optimal architecture more efficiently. More specifically, by considering the capability and simplicity of various networks, we formulate a multiobjective optimization problem that involves two training-free indicators and model complexity for candidate architectures. Extensive experiments on a large medical image benchmark and a publicly available breast cancer detection dataset are conducted. The empirical results demonstrate that our MSTF-NAS outperforms both human-designed architectures and current state-of-the-art NAS algorithms on both datasets, indicating the effectiveness of our proposed method.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Light-sheet autofluorescence lifetime imaging with a single-photon avalanche diode array

Significance: Fluorescence lifetime imaging microscopy (FLIM) of the metabolic co-enzyme nicotinamide adenine dinucleotide (phosphate) [NAD(P)H] is a popular method to monitor single-cell metabolism within unperturbed, living 3D systems. However, FLIM of NAD(P)H has not been performed in a light-sheet geometry, which is advantageous for rapid imaging of cells within live 3D samples. Aim: We aim to design, validate, and demonstrate a proof-of-concept light-sheet system for NAD(P)H FLIM. Approach: A single-photon avalanche diode camera was integrated into a light sheet microscope to achieve optical sectioning and limit out-of-focus contributions for NAD(P)H FLIM of single cells. Results: An NAD(P)H light-sheet FLIM system was built and validated with fluores cence lifetime standards and with time-course imaging of metabolic perturbations in pancreas cancer cells with 10 s integration times. NAD(P)H light-sheet FLIM in vivo was demonstrated with live neutrophil imaging in a larval zebrafish tail wound also with 10 s integration times. Finally, the theoretical and practical imaging speeds for NAD(P)H FLIM were compared across laser scanning and light-sheet geometries, indicating a 30× to 6× acquisition speed advantage for the light sheet compared to the laser scanning geometry. Conclusions: FLIM of NAD(P)H is feasible in a light-sheet geometry and is attrac tive for 3D live cell imaging applications, such as monitoring immune cell metabolism and migration within an organism.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Three-Dimensional Imaging Lidar for Characterizing Particle Fields and Organisms in the Mesopelagic Zone

The ocean’s mesopelagic zone is largely uncharacterized despite its vital role in sustaining ocean ecosystems. The composition, cycling, and fate of particle fields in the mesopelagic lacks an integrative multi-scale understanding of organism migration patterns, distribution, and diversity. This problem is addressed by combining complementary technologies with overlapping size spectra, including profiler mounted optical scattering sensors, profiler, and ship mounted acoustic devices, and a custom Unobtrusive Multi-Static Lidar Imager (UMSLI). This unique sensor suite can observe distributions of particles including organisms over a six order of magnitude dynamic size range, from microns to meters. Overlapping size ranges between different methods allows for cross-validation. This work focuses on the lidar imaging measurements and optical backscattering and attenuation, covering a combined particle size range of 0.1 mm to several cm. Particles at the small end of this range are sized using an existing backscattering time series inversion method after Briggs et al. (2013). Larger particles are resolved with UMSLI over an expanding volume using three-dimensional photo-realistic laser serial imaging. UMSLI’s image rectifying ability over time allows for derivation of particle concentration, size, and spatial distribution. Technical details on the development and post-processing methods for the novel UMSLI system are provided. Image resolved particle size distributions (PSDs) revealed a size shift from smaller to larger particles (>0.5 mm) as indicated by flatter slopes from dawn (slope = 2.6) to dusk (slope = 3.0). PSD trends are supported by an optical backscatter and transmissometer time series inversion analysis. Size shifts in the particle field are largely attributed to aggregation effects. Images support evidence of temporal variation between dusk and dawn stations through statistical analysis of particle concentrations for particle sizes 0.50–5.41 mm. Spatial analysis of the particle field revealed a dominantly uniform distributed marine snow background. The importance and potential of integrated approaches to studying particle and organism dynamics in ocean environments are discussed.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Improved Localization Precision and Angular Resolution of a Cylindrical, Time-Encoded Imaging System From Adaptive Detector Movements

To the first order, the localization precision and angular resolution of a cylindrical, time-encoded imaging (c-TEI) system is governed by the geometry of the system. Improving either measure requires increasing the mask radius or decreasing the detector diameter, both of which are undesirable. Here, we propose an alternative option of repositioning the detector within the mask to increase the detector-to-mask distance in the direction of a source, thereby improving the localization precision and angular resolution in that direction. Since the detector-to-mask distance only increases for a small portion of the field of view (FOV), we propose implementing adaptive imaging where one leverages data collected during the measurement to optimize the system configuration. This article utilizes both simulations and experiments to set upper bounds on the potential gain from adaptive detector movements for one and two sources in the FOV. When only one source is present, adaptive detector movements can improve the localization precision and angular resolution by 20% for a source at 90 cm and by 32% for a far-field source. When two sources are present, adaptive detector movements can improve localization precision and angular resolution by up to 50% for sources that are ~10° apart (90 cm from the system). We experimentally verify these results through maximum likelihood estimation of the source position(s) and image reconstruction of point sources that are close together. As a demonstration of an adaptive imaging algorithm, we image a complex arrangement of special nuclear material at the Zero Power Physics Reactor facility at Idaho National Laboratory.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

DOE OSTI2025

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems↗

DOE OSTI2020

Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification

Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion-activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best-practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open-grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A Machine Learning Approach to Quantitative Analysis of Enamel Microstructure from Scanning Electron Microscopy Images

Dental enamel, the outermost tissue of mammalian teeth, must withstand a lifetime of wear and cyclic contact. To meet this demand, enamel possesses a combination of high hardness and resistance to fracture, properties that are typically mutually exclusive. The impressive damage tolerance has been attributed largely to decussation of the enamel rods, the principal unit of its microstructure. As such, enamel is inspiring the design of next‐generation structural materials. However, quantitative descriptions of the decussated enamel rod microstructure remain limited due to challenges encountered in applying computed tomography and in acquiring quality images appropriate for traditional digital processing methods. Here, a machine learning segmentation method is applied to images of the enamel obtained using scanning electron microscopy to support quantitative analysis of the microstructure. A pretrained convolutional neural network is used to expand the input training image dataset to allow the training of a random forest classifier, which ultimately segments the image with a very small training set ( n = 3 images). A validation of this segmentation method is presented, in addition to its application to calculate relevant microstructural parameters for images of tooth enamel from selected mammalian species. The methodology applied here is equally applicable to other hard tissues.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Application of unsupervised deep learning to image segmentation and in-situ contact angle measurements in a CO 2 -water-rock system

Rock surface wettability is a critical property that regulates multiphase flows in porous media, which can be quantified using the surface contact angle (CA). X-ray micro-computed tomography (μCT) provides an effective approach to in-situ measurements of surface CAs. However, the CA measurement accuracy depends significantly on the quality of CT image segmentation, which is the clustering of CT pixels into separate phases. Inspired by this, we developed a deep learning (DL)-based CA measurement workflow. Motivated by the recent tremendous progress in unsupervised learning techniques and aiming to avoid expensive manual data annotations, an unsupervised DL pipeline for CT image segmentation was proposed and implemented, which includes unsupervised model training and post-processing. The unsupervised model training was driven by a novel loss function constrained with feature similarity and spatial continuity and implemented by iterative forward and backward paths; the former clustered the pixel-wise feature vectors extracted by convolution neural networks, whereas the latter updated the parameters using gradient descent. An over-segmentation strategy was adopted for model training. The post-processing steps based on agglomerative hierarchical clustering (AHC) were implemented to further merge the over-segmented model output to the desired cluster number, which is intended to improve the efficiency of image segmentation. The developed unsupervised DL pipeline was compared with other commonly-used image segmentation methods using pixel-wise and physics-based evaluation metrics on a synthetic raw-image dataset, which had a known ground truth. The unsupervised DL pipeline showed the best performance. Next, the segmented images were input to an automatic CA measurement tool, and the results were validated by comparisons with manual measurements. The CA values from the manual and automatic measurements showed similar distributions and statistical properties. The automatic measurement demonstrated a wider spectrum because of the much larger number of measurement data points. The primary novelty of the unsupervised DL pipeline developed in this study lies in the novel loss function and the over-segmentation strategy associated with AHC post-processing. Finally, the workflow has been proven an efficient tool for pore-scale wettability characterization, which has a wide range of applications in fundamental studies of multiphase flows in natural porous media, which have critical implications to geological carbon sequestration, hydrocarbon energy recovery, and contaminant transport in groundwater.

42 ENGINEERING↗

DOE OSTI2023

NeRVI: Compressive neural representation of visualization images for communicating volume visualization results

We present NeRVI, a new deep-learning approach that compresses a large collection of visualization images generated from time-varying data for communicating volume visualization results. Based on an image-based implicit neural representation, our approach represents tens of thousands of high-resolution rendering images parametrized by different parameters via a hybrid model of multilayer perceptrons and convolutional neural networks. Here, our model predicts images and corresponding masks, and the masks are utilized for loss computation and network training to capture fine structural details and small components. In conjunction with model quantization and weight encoding, NeRVI yields highly compact compressive neural representations while preserving the image fidelity well. We demonstrate the effectiveness of NeRVI with isosurface rendering and direct volume rendering images generated from multiple data sets and compare NeRVI with other state-of-the-art deep learning-based (InSituNet, SIREN, NeRF, and NeRV) methods. Quantitative and qualitative results show that NeRVI provides an alternative solution that augments domain scientists' ability to manage, represent, and communicate scientific visualization output.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Two-phase accurate multiplexed structured image capture (2pAc-MUSIC)

Multiplexed Structural Image Capture (MUSIC) technique uses modulation of light from a scene prior to imaging to encode the temporal evolution of target into spatial frequency shifts, with each shift corresponding to a unique time and resulting in individual distinct snapshots. Computational-processing of the multiplexed single-shot image can recover the nanosecond-resolution scene evolution. One of the limitations is the loss of spatial resolution of the recovered image due to limitations of the low-pass spatial frequency filtering depth. Here we demonstrated that two images with complementary spatial phases can be used to enhance the spatial resolutions. For this application, 2 Phase Accurate (2pAc)-MUSIC is implemented that a scene is encoded with two complementary phases. The increased spatial information captured reduces the lower frequency noise in the Fourier domain found in single-phase MUSIC. A recovery algorithm combines the 180-degree spatial frequency shifted images into a single scene and applies a spatial filter in the Fourier domain that has a larger depth than previously possible to achieve a scene with increased spatial resolution. The 2pAc-MUSIC can effectively enhance the spatial resolution by removing the overlapping zero-order spatial frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Visualizing the Three-Dimensional Arrangement of Hydrogen Atoms in Organic Molecules by Coulomb Explosion Imaging

Structure-sensitive methods based on femtosecond light or electron pulses are now making it possible to measure how molecular structures change during light-induced processes. Despite significant progress, high-fidelity imaging of nuclear positions remains a challenge even for relatively small molecular systems and, notably, regarding the positions of hydrogen atoms. As demonstrated in recent work, X-ray-induced Coulomb explosion imaging (CEI) may overcome this obstacle, as its sensitivity does not depend on the mass of the imaged atoms. The photoinduced ring opening of the heterocyclic molecule 2(5 H )-thiophenone has attracted recent interest. Here, in this work, we show that CEI offers a powerful route to imaging the peripheral H atoms in this molecule and thus, more generally, to tracking detailed nuclear motions (e.g., isomerizations) in organic molecules on ultrafast time scales. Specifically, we record momentum-space Coulomb explosion images that report on the three-dimensional positioning of all nuclei within the molecule, for instance, distinguishing H atoms in C–H bonds that lie within or are directed out of the plane defined by the heavy atoms. The prospect of imaging peripheral H atoms to probe photochemical dynamics is explored by coupling ab initio molecular dynamics with classical Coulomb explosion simulations, thereby differentiating potential photoproduct isomers, including those whose structures primarily differ in the position of the hydrogens.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

macroMS: Image-Guided Analysis of Random Objects by Matrix-Assisted Laser Desorption/Ionization Time-of-Flight Mass Spectrometry

Mass spectrometry imaging is well-suited to characterizing sample surfaces for their chemical content in a spatially resolved manner. However, when the surface contains small objects with significant empty spaces between them, more efficient approaches to sample acquisition are possible. Image-guided mass spectrometry (MS) enables high-throughput analysis of a diverse range of sample types, such as microbial colonies, liquid microdroplets, and others, by recognizing and analyzing selected location targets in an image. Here, we describe an imaging protocol and macroMS, an online software suite that can be used to enhance MS measurements of macroscopic samples that are imaged by a camera or a flatbed scanner. Furthermore, the web-based tool enables users to find and filter targets from the optical images, correct optical distortion issues for improved spatial location of selected targets, input the custom geometry files into an MS device to acquire spectra at the selected locations, and finally, perform limited data analysis and use visualization tools to aid locating samples containing compounds of interest. Using the macroMS suite, an enzyme mutant library of Saccharomyces cerevisiae and nL droplet arrays of Escherichia coli and Pseudomonas fluorescens have been assayed at a rate of ~2 s/sample.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

X-ray free-electron lasers offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate free-electron lasers enable single particle imaging, where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray single particle reconstruction algorithms, which estimate the particle orientation for each image independently, are slow and memory-intensive when handling the massive datasets generated by emerging free-electron lasers. Here, we introduce X-RAI (X-Ray single particle imaging with Amortized Inference), an online reconstruction framework that estimates the structure of 3D macromolecules from large X-ray single particle datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray single particle imaging towards real-time reconstruction.

Computer science↗

DOE OSTI2020

Multi-beam X-ray ptychography for high-throughput coherent diffraction imaging

X-ray ptychography is a rapidly developing coherent diffraction imaging technique that provides nanoscale resolution on extended field-of-view. However, the requirement of coherence and the scanning mechanism limit the throughput of ptychographic imaging. Herein, we propose X-ray ptychography using multiple illuminations instead of single illumination in conventional ptychography. Multiple locations of the sample are simultaneously imaged by spatially separated X-ray beams, therefore, the obtained field-of-view in one scan can be enlarged by a factor equal to the number of illuminations. We have demonstrated this technique experimentally using two X-ray beams focused by a house-made Fresnel zone plate array. Two areas of the object and corresponding double illuminations were successfully reconstructed from diffraction patterns acquired in one scan, with image quality similar with those obtained by conventional single-beam ptychography in sequence. Multi-beam ptychography approach increases the imaging speed, providing an efficient way for high-resolution imaging of large extended specimens.

47 OTHER INSTRUMENTATION↗