Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Convolutional neural network based non-iterative reconstruction for accelerating neutron tomography *

Abstract Neutron computed tomography (NCT), a 3D non-destructive characterization technique, is carried out at nuclear reactor or spallation neutron source-based user facilities. Because neutrons are not severely attenuated by heavy elements and are sensitive to light elements like hydrogen, neutron radiography and computed tomography offer a complementary contrast to x-ray CT conducted at a synchrotron user facility. However, compared to synchrotron x-ray CT, the acquisition time for an NCT scan can be orders of magnitude higher due to lower source flux, low detector efficiency and the need to collect a large number of projection images for a high-quality reconstruction when using conventional algorithms. As a result of the long scan times for NCT, the number and type of experiments that can be conducted at a user facility is severely restricted. Recently, several deep convolutional neural network (DCNN) based algorithms have been introduced in the context of accelerating CT scans that can enable high quality reconstructions from sparse-view data. In this paper, we introduce DCNN algorithms to obtain high-quality reconstructions from sparse-view and low signal-to-noise ratio NCT data-sets thereby enabling accelerated scans. Our method is based on the supervised learning strategy of training a DCNN to map a low-quality reconstruction from sparse-view data to a higher quality reconstruction. Specifically, we evaluate the performance of two popular DCNN architectures—one based on using patches for training and the other on using the full images for training. We observe that both the DCNN architectures offer improvements in performance over classical multi-layer perceptron as well as conventional CT reconstruction algorithms. Our results illustrate that the DCNN can be a powerful tool to obtain high-quality NCT reconstructions from sparse-view data thereby enabling accelerated NCT scans for increasing user-facility throughput or enabling high-resolution time-resolved NCT scans.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep Learning Analysis of Polaritonic Wave Images

Deep learning (DL) is an emerging analysis tool across the sciences and engineering. Encouraged by the successes of DL in revealing quantitative trends in massive imaging data, we applied this approach to nanoscale deeply subdiffractional images of propagating polaritonic waves in complex materials. Utilizing the convolutional neural network (CNN), we developed a practical protocol for the rapid regression of images that quantifies the wavelength and the quality factor of polaritonic waves. Using simulated near-field images as training data, the CNN can be made to simultaneously extract polaritonic characteristics and material parameters in a time scale that is at least 3 orders of magnitude faster than common fitting/processing procedures. The CNN-based analysis was validated by examining the experimental near-field images of charge-transfer plasmon polaritons at graphene/α-RuCl3 interfaces. Our work provides a general framework for extracting quantitative information from images generated with a variety of scanning probe methods.

97 MATHEMATICS AND COMPUTING↗

Wide Dynamic Range, 10 kHz Framing Detector for 4D-STEM

Hybrid pixel array detectors (PADs) have expanded the fidelity, frame rate and dynamic range for diffractive imaging in electron microscopes. With their high detective quantum efficiencies (DQE), the noise performance limited is by counting statistics. Consequently, improving the precision and quality of high-speed images requires increasing the linear dynamic range and the maximum usable beam current. Here we describe a new prototype hybrid PAD, our next-generation electron microscope pixel array detector (NG-EMPAD) that expands both the framing speed and dynamic range of our earlier EMPAD design. Like the EMPAD, electrons are detected directly in a 500 μm thick silicon sensor bonded pixel-by-pixel to a custom signal processing integrated circuit (IC). Each pixel in the IC integrates charge carriers produced by the high-energy incident electrons. Here, in-pixel circuitry uses a combination of techniques to extend the dynamic range, including adaptive gain switching and the quantitative excess charge dumping similar to the EMPAD. In-pixel buffering of signals during readout allows acquiring a new image while reading out the previously collected image, yielding an image collection duty cycle of nearly 100%.

36 MATERIALS SCIENCE↗

Tomographic Sparse View Selection Using the View Covariance Loss

Standard computed tomography (CT) reconstruction algorithms such as filtered back projection (FBP) and Feldkamp-Davis-Kress (FDK) require many views for producing high-quality reconstructions, which can slow image acquisition and increase cost in non-destructive evaluation (NDE) applications. Over the past 20 years, a variety of methods have been developed for computing high-quality CT reconstructions from sparse views. However, the problem of how to select the best views for CT reconstruction remains open. In this paper, we present a novel view covariance loss (VCL) function that measures the joint information of a set of views by approximating the normalized mean squared error (NMSE) of the reconstruction. We present fast algorithms for computing the VCL along with an algorithm for selecting a subset of views that approximately minimizes its value. Our experiments on simulated and measured data indicate that for a fixed number of views our proposed view covariance loss selection (VCLS) algorithm results in reconstructions with lower NRMSE, fewer artifacts, and greater accuracy than current alternative approaches.

Lin, Jingsong [Purdue University]↗

Detection of Foreign Materials on Broiler Breast Meat Using a Fusion of Visible Near-Infrared and Short-Wave Infrared Hyperspectral Imaging

Foreign material (FM) found on a poultry product lowers the quality and safety of the product. We developed a fusion method combining two hyperspectral imaging (HSI) modalities in the visible-near infrared (VNIR) range of 400–1000 nm and the short-wave infrared (SWIR) range of 1000–2500 nm for the detection of FMs on the surface of fresh raw broiler breast fillets. Thirty different types of FMs that could be commonly found in poultry processing plants were used as samples and prepared in two different sizes (5 × 5 mm 2 and 2 × 2 mm 2 ). The accuracies of the developed Fusion model for detecting 2 × 2 mm 2 pieces of polymer, wood, and metal were 95%, 95%, and 81%, respectively, while the detection accuracies of the Fusion model for detecting 5 × 5 mm 2 pieces of polymer, wood, and metal were all 100%. The performance of the Fusion model was higher than the VNIR- and SWIR-based detection models by 18% and 5%, respectively, when F1 scores were compared, and by 38% and 5%, when average detection rates were compared. The study results suggested that the fusion of two HSI modalities could detect FMs more effectively than a single HSI modality.

36 MATERIALS SCIENCE↗

Multispectral and thermal surface imagery and surface elevation mosaics (camspec-air)

This dataset contains high resolution image products (orthomosaics) acquired from midsized uncrewed aerial systems, which have been processed for value added quality. The instrument itself, a multispectral imager, the Altum by Micasense, captures 6 spectral bands (red, green blue, NIR, red edge, and LWIR/thermal1) as radiance, which is converted to reflectance. The code used to develop these images first uses tools from the Micasense python library2 to apply dark level corrections, row gradient corrections, and radiometric corrections. Next it uses the processing API from Agisoft Metashape software to align and mosaic the processed imagery, following the processes developed by the USGS' structure from motion workflow documentation3. Captures at different altitudes (recorded in MSL) produce an orthomosaic, a tif image containing information related to the 6 spectral bands, and a digital elevation model (DEM), a tif image containing information related to the elevation of the surveyed terraine. Metadata included in every image can be used to extract lat, lon, and reflectance values. 1https://www.arm.gov/publications/tech_reports/handbooks/doe-sc-arm-tr-281.pdf 2https://micasense.github.io/imageprocessing/MicaSense%20Image%20Processing%20Setup.html 3https://pubs.usgs.gov/of/2021/1039/ofr20211039.pdf

54 ENVIRONMENTAL SCIENCES↗

Deep-learning-based image registration for nano-resolution tomographic reconstruction

Nano-resolution full-field transmission X-ray microscopy has been successfully applied to a wide range of research fields thanks to its capability of non-destructively reconstructing the 3D structure with high resolution. Due to constraints in the practical implementations, the nano-tomography data is often associated with a random image jitter, resulting from imperfections in the hardware setup. Without a proper image registration process prior to the reconstruction, the quality of the result will be compromised. Here a deep-learning-based image jitter correction method is presented, which registers the projective images with high efficiency and accuracy, facilitating a high-quality tomographic reconstruction. This development is demonstrated and validated using synthetic and experimental datasets. We report the method is effective and readily applicable to a broad range of applications. Together with this paper, the source code is published and adoptions and improvements from our colleagues in this field are welcomed.

deep learning↗

Ultrafast method for scanning tunneling spectroscopy

A scanning tunneling microscope (STM) combines unique capabilities in imaging and spectroscopy with atomic precision, and it can obtain energy-resolved spectroscopic data with atomic resolution. In this paper, we utilize a recently proposed modification to the STM feedback control loop to acquire high quality d 2 I/dV 2 images. We have developed a constant differential conductance imaging method by closing the STM feedback loop with a high precision dI/dV measurement. In this mode, the tip’s vertical position is adjusted so as to keep the differential conductance constant during raster scanning of the surface. Based on this imaging mode, we propose a new technique to acquire fast and reliable scanning tunneling spectroscopy (STS) data simultaneously with the imaging.

47 OTHER INSTRUMENTATION↗

High-Resolution Scanning Coded-Mask-Based X-ray Multi-Contrast Imaging and Tomography

Near-field X-ray speckle tracking has been used in phase-contrast imaging and tomography as an emerging technique, providing higher contrast images than traditional absorption radiography. Most reported methods use sandpaper or membrane filters as speckle generators and digital image cross-correlation for phase reconstruction, which has either limited resolution or requires a large number of position scanning steps. Recently, we have proposed a novel coded-mask-based multi-contrast imaging (CMMI) technique for single-shot measurement with superior performance in efficiency and resolution compared with other single-shot methods. We present here a scanning CMMI method for the ultimate imaging resolution and phase sensitivity by using a coded mask as a high-contrast speckle generator, the flexible scanning mode, the adaption of advanced maximum-likelihood optimization to scanning data, and the multi-resolution analysis. Scanning CMMI can outperform other speckle-based imaging methods, such as X-ray speckle vector tracking, providing higher quality absorption, phase, and dark-field images with fewer scanning steps. Scanning CMMI is also successfully demonstrated in multi-contrast tomography, showing great potentials in high-resolution full-field imaging applications, such as in vivo biomedical imaging.

Qiao, Zhi (ORCID:0000000233928732)↗

Multispectral and thermal surface imagery and surface elevation mosaics - SGP July 2022

This data set contains high-resolution image products (orthomosaics) acquired from midsized uncrewed aerial systems that have been processed for value-added quality. The instrument itself, a multispectral imager, the Altum by Micasense, captures six spectral bands (red, green blue, NIR, red edge, and LWIR/thermal1) as radiance, which is converted to reflectance via custom code. The code used to develop these images first uses tools from the Micasense Python library2 to apply dark level corrections, row gradient corrections, and radiometric corrections. Next, it uses the processing API from Agisoft Metashape software to align and mosaic the processed imagery, following the processes developed by the USGS' structure from motion workflow documentation.3 Captures at different altitudes (recorded in MSL) produce an orthomosaic, a tif image containing information related to the six spectral bands, and a digital elevation model (DEM), a tif image containing information related to the elevation of the surveyed terraine. Metadata included in every image can be used to extract lat, lon, and reflectance values. 1 https://www.arm.gov/publications/tech_reports/handbooks/doe-sc-arm-tr-281.pdf 2 https://micasense.github.io/imageprocessing/MicaSense%20Image%20Processing%20Setup.html 3 https://pubs.usgs.gov/of/2021/1039/ofr20211039.pdf

54 ENVIRONMENTAL SCIENCES↗

Do Remote Camera Arrangements and Image Capture Settings Improve Individual Identification of Golden Eagles?

Individual identification of animals from camera traps has become an important task in wildlife research, but camera deployment methods often do not facilitate this important undertaking. Identification of individual golden eagles (Aquila chrysaetos) is possible using uniquely marked rectrices, but no studies have explored methods to maximize the rate of individual identification from camera images. Furthermore, our objectives were to assess whether different camera heights (1 m vs. 3 m), image capture settings (one image after a 1-min delay vs. burst of 5 images after a 30 sec delay), and arrangements relative to bait (dorsally vs. ventrally aimed) affected views of rectrices on golden eagles and our ability to identify individuals. We conducted our study from 15 December 2016 to 3 March 2017 on the Savannah River Site, South Carolina. First, we developed a scoring system based on views of rectrices and used a linear mixed-effects model to compare image scores among different camera arrangements and image settings. Next, after identifying individual eagles, we used generalized linear mixed-effects models to compare total individual eagle detections, total days an individual was detected, and probability of obtaining an unknown individual identification among camera arrangements and settings. Overall, we scored a total of 27,499 images, with 8,083 providing views of marked rectrices that allowed identification of 18 individual eagles. Average image scores and proportion of images suitable for individual identification were higher from elevated (3 m) camera arrangements than standard arrangements (1 m) across sites. Regardless of camera height, faster frequency of image capture provided more images that could be used to identify individuals and the most trap days per individual. Researchers and managers should consider deploying elevated cameras traps with faster frequency of image capture to improve data quality and potential for analysis of golden eagle populations and trends across the species’ range.

60 APPLIED LIFE SCIENCES↗

Di-CNN: Domain-Knowledge-Informed Convolutional Neural Network for Manufacturing Quality Prediction

In manufacturing, convolutional neural networks (CNNs) are widely used on image sensor data for data-driven process monitoring and quality prediction. However, as purely data-driven models, CNNs do not integrate physical measures or practical considerations into the model structure or training procedure. Consequently, CNNs’ prediction accuracy can be limited, and model outputs may be hard to interpret practically. This study aims to leverage manufacturing domain knowledge to improve the accuracy and interpretability of CNNs in quality prediction. A novel CNN model, named Di-CNN, was developed that learns from both design-stage information (such as working condition and operational mode) and real-time sensor data, and adaptively weighs these data sources during model training. It exploits domain knowledge to guide model training, thus improving prediction accuracy and model interpretability. A case study on resistance spot welding, a popular lightweight metal-joining process for automotive manufacturing, compared the performance of (1) a Di-CNN with adaptive weights (the proposed model), (2) a Di-CNN without adaptive weights, and (3) a conventional CNN. The quality prediction results were measured with the mean squared error (MSE) over sixfold cross-validation. Model (1) achieved a mean MSE of 6.8866 and a median MSE of 6.1916, Model (2) achieved 13.6171 and 13.1343, and Model (3) achieved 27.2935 and 25.6117, demonstrating the superior performance of the proposed model.

47 OTHER INSTRUMENTATION↗

Amorphous Ag 2-x Cu x S quantum dots: “all-in-one” theranostic nanomedicines for near-infrared fluorescence/photoacoustics dual-modal-imaging-guided photothermal therapy

Integrating dual-modal imaging and photothermal effect within a single nanosystem is an enormous challenge for current nanomedicine application. In this study, non-toxic amorphous Ag 2-x Cu x S quantum dots (QDs) possessing near-infrared fluorescence (NIRF), enhanced photothermal and photoacoustic (PA) performance, as “one-in-all” nanomedicines, are designed and obtained. Cu doping in amorphous Ag 2 S QDs causes red-shift of NIRF to the lowest tissue absorption wavelength in so called “first biowindow” (~820 nm) and improves photothermal conversion efficiency to 44.0% simultaneously. Density functional theory simulation results suggest the fluorescence red-shift and enhanced photothermal/photoacoustics properties can be attributed to the generation of intragap states introduced by Cu doping. The amorphous Ag 2-x Cu x S QDs exhibit high long-term biocompatibility. Under a single laser irradiation with relatively low power density, an effective tumor ablation induced by high photothermal effect of amorphous Ag 2-x Cu x S QDs is achieved in vivo. Simultaneously, the PTT process can be guided by high quality NIRF/PA dual-modal-imaging.

36 MATERIALS SCIENCE↗

Comparison of open‐source three‐dimensional reconstruction pipelines for maize‐root phenotyping

Abstract Understanding three‐dimensional (3D) root traits is essential to improve water uptake, increase nitrogen capture, and raise carbon sequestration from the atmosphere. However, quantifying 3D root traits by reconstructing 3D root models for deeper field‐grown roots remains a challenge due to the unknown tradeoff between 3D root‐model quality and 3D root‐trait accuracy. Therefore, we performed two computational experiments. We first compared the 3D model quality generated by five state‐of‐the‐art open‐source 3D model reconstruction pipelines on 12 contrasting genotypes of field‐grown maize roots. These pipelines included COLMAP, COLMAP+PMVS (Patch‐based Multi‐View Stereo), VisualSFM, Meshroom, and OpenMVG+MVE (Multi‐View Environment). The COLMAP pipeline achieved the best performance regarding 3D model quality versus computational time and image number needed. In the second test, we compared the accuracy of 3D root‐trait measurement generated by the Digital Imaging of Root Traits 3D pipeline (DIRT/3D) using COLMAP‐based 3D reconstruction with our current DIRT/3D pipeline that uses a VisualSFM‐based 3D reconstruction on the same dataset of 12 genotypes, with 5–10 replicates per genotype. The results revealed that (1) the average number of images needed to build a denser 3D model was reduced from 3000 to 3600 (DIRT/3D [VisualSFM‐based 3D reconstruction]) to around 360 for computational test 1, and around 600 for computational test 2 (DIRT/3D [COLMAP‐based 3D reconstruction]); (2) denser 3D models helped improve the accuracy of the 3D root‐trait measurement; (3) reducing the number of images can help resolve data storage problems. The updated DIRT/3D (COLMAP‐based 3D reconstruction) pipeline enables quicker image collection without compromising the accuracy of 3D root‐trait measurements.

09 BIOMASS FUELS↗

Defect-specific strength factors and superposition model for predicting strengthening of ion irradiated Fe18Cr alloy

Here, a high-purity binary alloy Fe18Cr was subjected to heavy-ion irradiation in order to provide improved understanding of the irradiation effect on radiation hardening associated with dislocation loop and network formation, α’ precipitation. The specimens were irradiated with 8 MeV Fe ions (~2 μm ion range) to midrange doses of 0.37 and 3.7 dpa at 300, 350 and 450 °C using dose rates of ~10 –5 –10 –3 dpa/s. Nanoindentation testing was performed to extract the bulk equivalent hardness at low depth from these ion irradiated specimens. High-quality transmission electron microscopy (TEM) images were acquired by utilizing a flash electropolishing method on the Focused Ion Beam (FIB) prepared liftouts. An accurate calculation of the strength factor was provided based on detailed TEM characterization of the irradiated microstructures. A newly refined hardening superposition method was applied to combine the strengthening components from each microstructure. The good agreement between microstructure predicted strength and measured strength further demonstrated the fidelity to use hardening model to quantify the mechanical properties of ion irradiated materials.

36 MATERIALS SCIENCE↗

Fourier method for 3-dimensional data fusion of X-ray Computed Tomography and ultrasound

X-ray Computed Tomography (CT) is essential for nondestructive inspection of many manufactured components but is susceptible to various forms of artifacts and noise. In particular, multi-detector row cone-beam CT systems can suffer from so called “cone-beam” artifacts and partial volume effects, particularly on planar edges at the periphery of the field of view in the cone angle dimension. Uni-directional ultrasonic testing methods generally have extremely accurate in-plane depth resolution but poorer lateral resolution due to physical and geometric constraints. This paper presents a novel technique called Computed Tomographic Fusion (CT-F) which uses three-dimensional Fourier filtering to combine x-ray cone-beam CT reconstructions and ultrasound data in the frequency space. The result is a single image with improved accuracy and quality. CT-F mitigates artifacts while allowing for rapid, accurate characterization of large three-dimensional CT volumes. Finally, using simulations and experiments, we demonstrate artifact reduction and edge contrast improvement in volumetric reconstructions.

42 ENGINEERING↗

A coded aperture with sub-mean-free-path thickness for implosion geometry imaging on ICF and IFE experiments

Inertial confinement fusion and inertial fusion energy experiments diagnose the geometry of the fusion region through imaging of the neutrons released through fusion reactions. Pinhole arrays typically used for such imaging require thick substrates to obtain high contrast along with a small pinhole diameter to obtain high resolution capability, resulting in pinholes that have large aspect ratios. This leads to expensive pinhole arrays that have small solid angles and are difficult to align. Here, we propose a coded aperture with scatter and partial attenuation (CASPA) for fusion neutron imaging that relaxes the thick substrate requirement for good image contrast. These coded apertures are expected to scale to larger solid angles and are easier to align without sacrificing imaging resolution or throughput. We use Monte Carlo simulations (Geant4) to explore a coded aperture design to measure neutron implosion asymmetries on fusion experiments at the National Ignition Facility (NIF) and discuss the viability of this technique, matching the current nominal resolution of 10 µm. The results show that a 10 mm thick tungsten CASPA can image NIF implosions with neutron yields above 10 14 with quality comparable to unprocessed data from a current NIF neutron imaging aperture. Furthermore, this CASPA substrate is 20 times thinner than the current aperture arrays for fusion neutron imaging and less than one mean free-path of 14.1 MeV neutrons through the substrate. Since the resolution, solid angle, and throughput are decoupled in coded aperture imaging, the resolution and solid angle achievable with future designs will be limited primarily by manufacturing capability.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗