Engineering PapersSearch

SEARCH · Engineering Papers

Results for “IMAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). Imaging systematics refers to the false fluctuation of galaxy densities due to varying observing conditions and astrophysical foregrounds corresponding to the imaging surveys from which DESI LRG target galaxies are selected. We update the Obiwan pipeline, which we previously developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition allows simulating the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We inject these data evenly throughout the DESI Legacy Imaging Survey footprint at declinations between -30 and 32.375 degrees. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing source of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying systematic contamination in the Galactic extinction maps is a likely root cause (e.g., Cosmic-Infrared Background, dust temperature correction). We additionally observe a morphological change of the DESI LRGs population evidenced by a correlation between OII emission line average intensity and the size of the z-band PSF. This effect most likely results from uncertainties in background subtraction. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRGs sample.

79 ASTRONOMY AND ASTROPHYSICS

Neutron and Gamma-Ray Imaging of Th-232 and Cm-244 Using Organic Glass Scintillators

Modern nuclear safeguards require detection and characterization capabilities suitable for a wide variety of radiation sources and applications. Field-deployable detection systems have also had to modernize to meet changing needs. Recent developments in organic scintillator technology have resulted in the creation of an organic glass scintillator (OGS) at Sandia National Laboratory which is composed of a 9:1 mixture of glass compounds C42H36Si and C51H44Si. The novel scintillator composition was implemented into the design for a dual-particle capable imaging system at the University of Michigan. This work presents new results from two experiments demonstrating the gamma-ray and fast-neutron imaging capabilities of the organic glass system. Gamma spectroscopy was also performed using CeBr3 scintillators that are part of the imager design. Measurements were performed at Lawrence Livermore National Laboratory using 232Th metal hemishells and an encapsulated 244Cm oxide source. Successful gamma-ray imaging of the 232Th distributed sources is demonstrated with the glass imager, but there were no appreciable neutrons from the 232Th for neutron imaging. Promising neutron and gamma-ray imaging results of 244Cm are demonstrated despite limited imaging event statistics available in this measurement. Gamma-ray spectroscopy results were able to identify 232Th using prominent emissions at 239, 338, 583, and 911 keV. 244Cm was identified from emissions of 43, 99, and 153 keV. These results demonstrate the potential of organic glass imaging for nuclear nonproliferation or characterization efforts.

Lopez, Ricardo [Univ. of Michigan, Ann Arbor, MI (

Ultra-high Information-content Chemical Imaging with Broadband Coherent Anti-Stokes Raman and Two-photon Fluorescence Lifetime Microscopy

Raman fingerprint spectroscopy and fluorescence lifetime imaging are emerging tools for studying metabolic profiles of biological specimens. While Raman fingerprint spectroscopy detects intrinsic molecular vibrations that reflect the molecular composition and chemical environment of a sample, fluorescence lifetime imaging measures changes in the excited-state lifetime of fluorophores that are sensitive to their microenvironments. Here, we present a multimodal imaging platform combining broadband coherent anti-Stokes Raman scattering (BCARS) and two-photon fluorescence lifetime imaging (2p-FLIM) microscopy that can acquire biologically relevant Raman fingerprint spectra and fluorescence lifetime signals in vivo and simultaneously. The tremendous chemical information obtained from spatially co-registered BCARS and 2p-FLIM images allows us to characterize the subtle differences between sub-cellular compartments and verify the potential false-positive results generated by fluorescence imaging alone. This is demonstrated by directly comparing the BCARS, 2p-FLIM, and two-photon excitation fluorescence(TPEF) signals simultaneously obtained from the same dye-stained organelle in the live, intact C. elegans expressing a green fluorescent protein (GFP) marker. In this work, we introduce the BCARS/2p-FLIM/TPEF setup scheme, the image acquisition steps, data processing, and representative results showing that the cross-modality imaging method enables rigorous characterization and in vivo detection at sub-cellular resolution. Furthermore, this protocol provides a framework for simultaneous chemical and fluorescence lifetime imaging to improve the accuracy of biological interpretation in complex living systems.

Xu, Haoyu [Georgia Institute of Technology, Atlant

Original images, ground truth annotations, and precited masks from U-NET for a fungal species x nitrogen experiment

This document describes the “MicroVision-MV003” dataset. This folder contains three subfolders: “originals”, “predicted_masks”, and “gt_masks”. The “originals” folder contains 720 original images acquired using two imaging modalities: 360 images from overhead imaging and 360 images from transmission (raw) imaging. Naming scheme:YYYY-MM-dd__plate_strain_nitrogen-level_replication_experiment_imaging-modalityYYYY-MM-dd: 2024-12-20, 2024-12-21, 2024-12-22,2024-12-23,2024-12-24,2024-12-25,2024-12-26,2024-12-27,2024-12-28,2024-12-29,2024-12-30,2024-12-31.plate: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30.strain: FG, LE.nitrogen-level: N-1, N-10, N-100.replication: 1, 2, 3, 4, 5.experiment: MV.003.imaging-modality: overhead, transmission (raw). For example, the image2024-12-20__1_FG_N-10_3_MV.003_overheadwas taken on 2024-12-20. The plate number is 1, the fungal strain is FG, the nitrogen treatment is N-10, and the replication number is 3 for experiment MV.003, acquired using the overhead imaging modality. The “predicted_masks” folder contains masks generated by a trained U-Net model for the transmission imaging modality.The “gt_masks” folder contains 326 human hand-traced masks that serve as ground truth.

09 BIOMASS FUELS

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne

Single-Objective Airy Light-Sheet Imaging

Despite its massive potential, standard light-sheet imaging (LSI) faces key challenges, such as the incompatibility with common sample mounting techniques and low-resolution imaging. Single-objective LSI attempts to address these issues but often suffers from limited fields-of-view and throughput rates, or requires multiple optics that increase costs, alignment complexity, and losses. To overcome these challenges of standard single-objective LSI, we introduce single-objective Airy light-sheet imaging (SoALSI). SoALSI leverages the extraordinary self-acceleration properties of the Airy beam, achieving 5× higher imaging rates and enhanced imaging efficiency than standard single-objective LSI. Here, we demonstrate SoALSI’s versatility through rigorous contrast and resolution characterizations and by high-resolution imaging of diverse biological specimens, including malaria parasite-infected red blood cells and plant root tissue. SoALSI seamlessly integrates with any standard inverted microscope frame, enabling broader accessibility for the bioimaging community to explore biological processes in a wide range of specimens with enhanced resolution and imaging contrast.

airy beam

High-speed quantitative X-ray multi-contrast imaging with deep learning based modulated pattern analysis

The advent of X-ray multi-contrast imaging methods, providing absorption, phase, and dark-field images, holds tremendous promise for complementary and non-destructive visualization of inner structures within materials and bio-samples. However, the low efficiency in measuring and analyzing X-ray modulated patterns has hindered their application in high-resolution in situ imaging. In this work, the Enhanced Scanning Pattern-based Imaging Neural Network (ESPINNet) is introduced as a powerful tool for achieving high-speed, high-resolution quantitative imaging. ESPINNet is faster than correlation-based speckle tracking methods such as XSVT and UMPA, and provides a balanced performance in terms of resolution and speed for data collection by using fewer scanning images. In comparison with our previously developed neural network, ESPINNet introduces the capability to generate dark-field images, further enhancing its versatility. By leveraging scanning patterns, ESPINNet significantly improves resolution and measurement precision. Furthermore, its adaptability to various modulation patterns, including those produced by sandpaper, coded masks, or gratings, ensures broad applicability. These features enable real-time 2D and 3D multi-contrast imaging, positioning ESPINNet as a transformative solution for applications in materials science and biomedical research, particularly for high-speed and in situ measurements.

X-ray at-wavelength metrology

Zone plate-based extreme ultraviolet mask microscope with through-pellicle imaging capability

Mirror-based and zone plate-based imaging systems are being used in actinic extreme ultraviolet (EUV) reticle review tools. With regard to zone plates, a short working distance is advantageous in terms of the required spectral bandwidth, manufacturability, and potential throughput and imaging performance. Zone plates therefore typically have a short working distance. The industry has adopted the use of an EUV pellicle to protect the photomask. Imaging photomask through-pellicle requires a working distance larger than 2.5 mm. A zone-plate-based EUV mask microscope with a 3-mm working distance has been commissioned at beamline 11.3.2 of the Advanced Light Source. Through-pellicle imaging at an exposure time of 2 s is demonstrated. The instrument achieves an image contrast of 95% on large features on a photomask with a tantalum-based absorber. Imaging down to 45-nm half pitch (mask scale) is demonstrated. A NILS of 2.55 is achieved on 60-nm half-pitch (mask scale) lines and spaces. These results demonstrate that zone-plate-based imaging systems can meet the requirements of an actinic EUV mask review tool in terms of imaging performance and throughput in an instrument compatible with EUV pellicles.

Extreme ultraviolet

End–to–End Metasurface Design for Temperature Imaging via Broadband Planck‐Radiation Regression

A theoretical framework is presented for temperature imaging from long-wavelength infrared (LWIR) thermal radiation (e.g., 8–12 µm) through the end-to-end design of a metasurface-optics frontend and a computational-reconstruction backend. A new nonlinear reconstruction algorithm, “Planck regression”, is introduced to reconstruct the temperature map from a gray scale sensor image, even in the presence of severe chromatic aberration, by exploiting black body and optical physics particular to thermal imaging. This algorithm is combined with an end-to-end approach that optimizes manufacturable, single-layer metasurfaces to yield the most accurate reconstruction. The designs demonstrate high-quality, noise-robust reconstructions of arbitrary temperature maps (including completely random images) in simulations of an ultra-compact thermal-imaging device. Here, it is also shown that Planck regression is much more generalizable to arbitrary images than a straightforward neural-network reconstruction, which requires a large training set of domain-specific images.

36 MATERIALS SCIENCE

Multimodal Defect Imaging of Pure Tungsten Components Fabricated via Electron Beam Powder Bed Fusion

The utilization of additive manufacturing (AM) techniques for refractory materials in high-temperature environments has significantly expanded because of the ability to fabricate geometrically complex components. Electron beam powder bed fusion (EB-PBF), which provides lower residual stress, a cleaner vacuum environment, and better efficiency for high melting point, is one of the best-suited AM methods to produce advanced refractory components. However, the property variation attributed to the heterogeneous microstructure and process-induced defects has hindered the widespread adoption of EB-PBF-produced material like tungsten. While numerous in-situ monitoring and defect detection methods have been demonstrated for EB-PBF, a workflow that compares and evaluates process-induced abnormalities from different imaging perspectives is still limited. This study examines a feature-embedded tungsten component manufactured via the EB-PBF process to demonstrate the defect detection capabilities of a multimodal defect imaging workflow. The predefined and process-induced defects are evaluated by harnessing various imaging techniques, including in-situ electron imaging, layerwise near-infrared (NIR) imaging, post-build high-energy x-ray computed tomography (CT), and conventional destructive metallography. The results highlight the strengths and limitations of distinctive defect imaging techniques concerning specific defect types, sizes, and conditions. It was found that electron imaging can provide more abnormal detection capabilities while maintaining a higher measuring accuracy, against the conventional metallography in this case study, compared with NIR and CT imaging techniques.

36 MATERIALS SCIENCE

Toward more-robust, AI-enabled subsurface seismic imaging for geotechnical applications

Non-invasive seismic imaging has the potential to cost-effectively evaluate large volumes of subsurface material to inform geotechnical site investigation. However, seismic imaging using full waveform inversion (FWI) requires significant computational time and is dependent on an initial starting model. As a result, FWI has not yet been widely adopted into geotechnical practice. Previous efforts, on relatively simple two-layered models, indicate that data-driven artificial intelligence (AI) models may be as effective as FWI at predicting 2D images of shear wave velocity (V s ). Furthermore, the AI model predictions can be made almost instantaneously after data acquisition and do not require an initial starting model. We examine the generality of these findings by developing a new AI model for subsurface seismic imaging, whereby we make several notable contributions. First, we architect a multimodal AI model that combines time- and frequency-domain representations of the seismic wavefield to predict a 50 m by 20 m subsurface image of V s . Second, we developed a new diverse dataset of 100,000 images with their corresponding seismic wavefields to train the AI model. Third, we propose four physics-informed data augmentations for data-driven seismic imaging. Fourth, we develop two prediction consistency tests to evaluate the model’s performance when the true subsurface is unknown. Our final model, which has been made publicly available, is capable of predicting a subsurface V s image from a single seismic wavefield with an average, mean absolute percent error (MAPE) of 24 %. The predictive model is applied to a field dataset and shown to be consistent with local geology and shear-wave refraction measurements from the same location.

Artificial intelligence

Advanced multi-modal mass spectrometry imaging reveals functional differences of placental villous compartments at microscale resolution

The placenta is a complex and heterogeneous organ that links the mother and fetus, playing a crucial role in nourishing and protecting the fetus throughout pregnancy. Integrative spatial multi-omics approaches can provide a systems-level understanding of molecular changes underlying the mechanisms leading to the histological variations of the placenta during healthy pregnancy and pregnancy complications. Herein, we advance our metabolome-informed proteome imaging (MIPI) workflow to include lipidomic imaging, while also expanding the molecular coverage of metabolomic imaging by incorporating on-tissue chemical derivatization (OTCD). The improved MIPI workflow advances biomedical investigations by leveraging state-of-the-art molecular imaging technologies. Lipidome imaging identifies molecular differences between two morphologically distinct compartments of a placental villous functional unit, syncytiotrophoblast (STB) and villous core. Next, our advanced metabolome imaging maps villous functional units with enriched metabolomic activities related to steroid and lipid metabolism, outlining distinct molecular distributions across morphologically different villous compartments. Complementary proteome imaging on these villous functional units reveals a plethora of fatty acid- and steroid-related enzymes uniquely distributed in STB and villous core compartments. Integration across our advanced MIPI imaging modalities enables the reconstruction of active biological pathways of molecular synthesis and maternal-fetal signaling across morphologically distinct placental villous compartments with micrometer-scale resolution.

60 APPLIED LIFE SCIENCES

Radiation image reconstruction and uncertainty quantification using a Gaussian process prior

We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie

Deciphering Discrepancies: A Comparative Analysis of Docker Image Security

As the use of microservices continues to grow and become a foundational approach to architecting software solutions, ensuring the security of microservices is paramount. Docker images have emerged as the predominant solution to containerize microservices–and thus, Docker images are becoming a large attack surface. Thus, reducing vulnerabilities in Docker images will reduce microservice cyberattacks. A common way to find vulnerabilities in Docker images employs static analysis tools like Trivy and Grype. However, these tools frequently generate disparate vulnerability reports when analyzing the same Docker image, thus causing uncertainty in tool selection. We collected 927 Docker images, analyzed them with Trivy and Grype, and compared the vulnerabilities reported in each image. Among the 865 images found to have vulnerabilities, Trivy and Grype disagreed on both the number of vulnerabilities and the vulnerability IDs found therein. Since both tools interface with external vulnerability databases, some discrepancies can be attributed to how the tools interface with these external resources. The external vulnerability databases partially overlap and frequently contradict one another, thereby creating challenges for static analysis tool developers and end users alike. This New Ideas and Emerging Results (NIER) study contains new and critical information that practitioners need for selecting and using static analysis tools–given that increases in the use of Docker technologies means increases in the size of the attack surfaces.

Boles, Brittany [Montana State University]

Live cell imaging of cellular dynamics in poplar wood using computational cannula microscopy

This study presents significant advancements in computational cannula microscopy for live imaging of cellular dynamics in poplar wood tissues. Leveraging machine-learning models such as pix2pix for image reconstruction, we achieved high-resolution imaging with a field of view of 55µm using a 50µm-core diameter probe. Our method allows for real-time image reconstruction at 0.29 s per frame with a mean absolute error of 0.07. We successfully captured cellular-level dynamics in vivo , demonstrating morphological changes at resolutions as small as 3µm. We implemented two types of probabilistic neural network models to quantify confidence levels in the reconstructed images. This approach facilitates context-aware, human-in-the-loop analysis, which is crucial for in vivo imaging where ground-truth data is unavailable. Using this approach we demonstrated deep in vivo computational imaging of living plant tissue with high confidence (disagreement score ⪅0.2). This work addresses the challenges of imaging live plant tissues, offering a practical and minimally invasive tool for plant biologists.

Ingold, Alexander (ORCID:0009000752380016)