Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Astronomical image time series classification using CONVolutional attENTION (ConvEntion)

Aims: The treatment of astronomical image time series has won increasing attention in recent years. Indeed, numerous surveys following up on transient objects are in progress or under construction, such as the Vera C. Rubin Observatory Legacy Survey for Space and Time (LSST), which is poised to produce huge amounts of these time series. The associated scientific topics are extensive, ranging from the study of objects in our galaxy to the observation of the most distant supernovae for measuring the expansion of the universe. With such a large amount of data available, the need for robust automatic tools to detect and classify celestial objects is growing steadily. Methods: This study is based on the assumption that astronomical images contain more information than light curves. In this paper, we propose a novel approach based on deep learning for classifying different types of space objects directly using images. We named our approach ConvEntion, which stands for CONVolutional attENTION. It is based on convolutions and transformers, which are new approaches for the treatment of astronomical image time series. Our solution integrates spatio-temporal features and can be applied to various types of image datasets with any number of bands. Results: In this work, we solved various problems the datasets tend to suffer from and we present new results for classifications using astronomical image time series with an increase in accuracy of 13%, compared to state-of-the-art approaches that use image time series, and a 12% increase, compared to approaches that use light curves.

79 ASTRONOMY AND ASTROPHYSICS↗

AI-enabled high-resolution scanning coherent diffraction imaging

Ptychographic imaging is a powerful means of imaging beyond the resolution limits of typical x-ray optics. Capturing recovered images from raw ptychographic data, however, requires the solution of an inverse problem, namely, phase retrieval. Phase retrieval algorithms are computationally expensive, which precludes real-time imaging. In this work, we propose PtychoNN, an approach to solve the ptychography data inversion problem based on a deep convolutional neural network. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. Our results demonstrate the practical application of machine learning to recover high fidelity amplitude and phase contrast images of a real sample hundreds of times faster than current ptychography reconstruction packages. Furthermore, by overcoming the constraints of iterative model-based methods, we can significantly relax sampling constraints on data acquisition while still producing an excellent image of the sample. Besides drastically accelerating acquisition and analysis, this capability has profound implications for the imaging of dose sensitive, dynamic, and extremely voluminous samples.

47 OTHER INSTRUMENTATION↗

Multiplexed structured imaging of laser induced fluorescence at 10 GHz rate

The frame rate of conventional high-speed imaging devices is limited by exposure time and signal read-out time. Structured imaging is able to push the frame rate beyond the limit of the imaging device. This work demonstrates the feasibility of potential TeraHz rate structured imaging with a multiplexed structured imaging setup. In this work, a multiplexed structured image capture system was employed to image UV laser induced krypton-II emission lines at 10 GHz. The measured emission intensity of the 764 nm line over time suggests a temporal resolution of 97 ps. The temporal resolution is adjustable, and the frame rate can be further increased to the TeraHz level.

47 OTHER INSTRUMENTATION↗

Quantum imaging with positronium-decay-emitted gamma rays

The use of entangled gamma rays from positronium decay for quantum-enhanced imaging of dense materials is demonstrated. Quantum ghost images, where only one of the entangled 511-keV photons interacts with the object, are obtained for tantalum samples of varying density using a 210-ps time-resolution dual detector system and a Na-22 positron source. An analysis comparing both classical and quantum imaging modalities is employed to isolate true 511-keV events from background noise. Image quality is quantitatively assessed using transmission ratios and the Michelson contrast. Quantum-correlated images are found to exhibit superior (up to approximately 1.7x, from 0.49 to 0.83 in the thickest sample measured) contrast compared to classical methods and align well with theoretical expectations. These results suggest that quantum ghost imaging with positronium-based entangled gamma rays could significantly enhance noninvasive imaging of high-density objects, with potential applications in areas such as cargo inspection and security screening.

36 MATERIALS SCIENCE↗

UIR-Net: Object Detection in Infrared Imaging of Thermomechanical Processes in Automotive Manufacturing

Thermomechanical processes (TMPs) such as resistance spot welding (RSW) and hot stamping are widely used in automotive manufacturing. Recent advancement in sensing technology has led to an increasing adoption of thermographic cameras to capture the infrared (IR) radiation of a metal part (or component of a part) during its thermomechanical processing or immediately after the process when the part is still hot. Detecting the object(s) of interest from raw IR images is an essential step in analyzing these data. Deep learning (DL) has been a recent success for object detection (OD), but the application of DL-based OD for industrial IR images in manufacturing is largely lagging behind. The major contribution of this work, which is also the distinction from previous OD studies, is the capability of building the OD model with unlabeled IR images, i.e., imaging data without accurate information indicating the object position. Here, the architecture of Unsupervised IR Image Net (UIR-Net) is designed to accommodate the unique characteristics of IR images from TMPs in manufacturing. This study presents a novel method for OD in unlabeled IR images from TMPs. The proposed method, called UIR-Net, consists of two components: label generation and DL model construction. Two case studies from automotive manufacturing, RSW and hot stamping, are reported to demonstrate the feasibility and effectiveness of the proposed method.

42 ENGINEERING↗

Divide and conquer: using RhizoVision Explorer to aggregate data from multiple root scans using image concatenation and statistical methods

Roots are important in agricultural and natural systems for determining plant productivity and soil carbon inputs. Sometimes, the amount of roots in a sample is too much to fit into a single scanned image, so the sample is divided among several scans, and there is no standard method to aggregate the data. Here, we describe and validate two methods for standardizing measurements across multiple scans: image concatenation and statistical aggregation. We developed a Python script that identifies which images belong to the same sample and returns a single, larger concatenated image. These concatenated images and the original images were processed with RhizoVision Explorer, a free and open-source software. An R script was developed, which identifies rows of data belonging to the same sample and applies correct statistical methods to return a single data row for each sample. These two methods were compared using example images from switchgrass, poplar, and various tree and ericaceous shrub species from a northern peatland and the Arctic. Most root measurements were nearly identical between the two methods except median diameter, which cannot be accurately computed by statistical aggregation. We believe the availability of these methods will be useful to the root biology community.

59 BASIC BIOLOGICAL SCIENCES↗

Imaging of multiple fluorescent proteins in canopies enables synthetic biology in plants

Reverse genetics approaches have revolutionized plant biology and agriculture. Phenomics has the prospect of bridging plant phenotypes with genes, including transgenes, to transform agricultural fields. Genetically encoded fluorescent proteins (FPs) have revolutionized plant biology paradigms in gene expression, protein trafficking and plant physiology. While the first instance of plant canopy imaging of green fluorescent protein (GFP) was performed over 25 years ago, modern phenomics has largely ignored fluorescence as a transgene expression device despite the burgeoning FP colour palette available to plant biologists. Here, we show a new platform for stand-off imaging of plant canopies expressing a wide variety of FP genes. The platform-the fluorescence-inducing laser projector (FILP)-uses an ultra-low-noise camera to image a scene illuminated by compact diode lasers of various colours, coupled with emission filters to resolve individual FPs, to phenotype transgenic plants expressing FP genes. Each of the 20 FPs screened in plants were imaged at >3 m using FILP in a laboratory-based laser range. We also show that pairs of co-expressed fluorescence proteins can be imaged in canopies. The FILP system enabled a rapid synthetic promoter screen: starting from 2000 synthetic promoters transfected into protoplasts to FILP-imaged agroinfiltrated Nicotiana benthamiana plants in a matter of weeks, which was useful to characterize a water stress-inducible synthetic promoter. FILP canopy imaging was also accomplished for stably transformed GFP potato and in a split-GFP assay, which illustrates the flexibility of the instrument for analysing fluorescence signals in plant canopies.

abiotic stress↗

Effect of image resolution on automated classification of chest X-rays

Deep learning (DL) models have received much attention lately for their ability to achieve expert-level performance on the accurate automated analysis of chest X-rays (CXRs). Recently available public CXR datasets include high resolution images, but state-of-the-art models are trained on reduced size images due to limitations on graphics processing unit memory and training time. As computing hardware continues to advance, it has become feasible to train deep convolutional neural networks on high-resolution images without sacrificing detail by downscaling. This study examines the effect of increased resolution on CXR classification performance. We used the publicly available MIMIC-CXR-JPG dataset, comprising 377,110 high resolution CXR images for this study. We applied image downscaling from native resolution to 2048 × 2048 pixels, 1024 × 1024 pixels, 512 × 512 pixels, and 256 × 256 pixels and then we used the DenseNet121 and EfficientNet-B4 DL models to evaluate clinical task performance using these four downscaled image resolutions. We find that while some clinical findings are more reliably labeled using high resolutions, many other findings are actually labeled better using downscaled inputs. We qualitatively verify that tasks requiring a large receptive field are better suited to downscaled low resolution input images, by inspecting effective receptive fields and class activation maps of trained models. Lastly, we show that stacking an ensemble across resolutions outperforms each individual learner at all input resolutions while providing interpretable scale weights, indicating that diverse information is extracted across resolutions.

47 OTHER INSTRUMENTATION↗

Airy light-sheet Raman imaging

Light-sheet fluorescence microscopy has greatly improved the speed and overall photostability of optically sectioning cellular and multi-cellular specimens. Similar gains have also been conferred by light-sheet Raman imaging; these schemes, however, rely on diffraction limited Gaussian beams that hinder the uniformity and size of the imaging field-of-view, and, as such, the resulting throughput rates. Here, we demonstrate that a digitally scanned Airy beam increases the Raman imaging throughput rates by more than an order of magnitude than conventional diffraction-limited beams. Overall, this, spectrometer-less, approach enabled 3D imaging of microparticles with high contrast and 1 µm axial resolution at 300 msec integration times per plane and orders of magnitude lower irradiation density than coherent Raman imaging schemes. We detail the apparatus and its performance, as well as its compatibility with fluorescence light-sheet and quantitative-phase imaging towards rapid and low phototoxicity multimodal imaging.

47 OTHER INSTRUMENTATION↗

Metaoptics Enabled Multifunctional Imaging

Despite the fact that most microorganisms occupy two- and three-dimensional space in heterogeneous arrangements and in proximity to other microorganisms of different species, much of our current knowledge about their metabolic processes is derived from homogenizing, then analyzing, the chemical content of cultures containing a single microbial species. This project addressed this fundamental dichotomy by developing a set of optical imaging principles combining multiple new technologies. The imaging strategies developed in this project combine metaoptics structures with active in situ nanoscale control of the chemical environment and applied them to a microbial system, Myxococcus xanthus, with particular relevance to the DoE mission. The combination of metaoptical architectures and nanoscale control over the molecular environment enables: (a) precise control over the electromagnetic (EM) field at length scales smaller than the wavelength of light; (b) control of the interaction of the EM field with critical molecular systems in DOE relevant microbes; (c) control over the chemical environment – especially the presence and quantity of reactive oxygen species (ROS) that can affect redox homeostasis; and (d) the ability to ask new kinds of questions not accessible to ‘omics’ approaches or standard methods of biological imaging. These capabilities are applicable to detailed studies of metabolic pathways in microbes and to lignocellulosic biomass deconstruction. To accomplish these objectives, we pursued two over-arching technical goals: (1) the development of new metaoptics-enabled approaches to imaging and spectroscopic characterization; and (2) the development of tools to control the chemical environment of a microbial sample with nanometer-scale precision. Goal 1 was addressed through the design, fabrication, and characterization of new metasurfaces capable of super-resolution imaging through extreme confinement of the optical field. Goal 2 was addressed by controlling the redox potential on the nanoscale in microbial communities and characterizing their effect on intrinsic bacterial fluorophores which act as molecular sentinels and through characterization of soluble factors secreted by Myxococcus xanthus by confocal Raman imaging. The optical imaging/sensing approaches developed here make it possible to use these powerful new imaging and sensing modalities in metabolic studies by making it possible to visualize and track the spatial and temporal expression patterns of natural or engineered pathways in microorganisms.

09 BIOMASS FUELS↗

Evaluation of 134 Ce/ 134 La as a PET Imaging Theranostic Pair for 225 Ac α-Radiotherapeutics

225 Ac-targeted α-radiotherapy is a promising approach to treating malignancies, including prostate cancer. However, α-emitting isotopes are difficult to image because of low administered activities and a low fraction of suitable γ-emissions. The in vivo generator 134 Ce/ 134 La has been proposed as a potential PET imaging surrogate for the therapeutic nuclides 225 Ac and 227 Th. In this report, we detail efficient radiolabeling methods using the 225 Ac-chelators DOTA and MACROPA. These methods were applied to radiolabeling of prostate cancer imaging agents, including PSMA-617 and MACROPA-PEG 4 -YS5, for evaluation of their in vivo pharmacokinetic characteristics and comparison to the corresponding 225 Ac analogs. Methods: Radiolabeling was performed by mixing DOTA/MACROPA chelates with 134 Ce/ 134 La in NH 4 OAc, pH 8.0, at room temperature, and radiochemical yields were monitored by radio–thin-layer chromatography. In vivo biodistributions of 134 Ce-DOTA/MACROPA.NH 2 complexes were assayed through dynamic small-animal PET/CT imaging and ex vivo biodistribution studies over 1 h in healthy C57BL/6 mice, compared with free 134 CeCl 3 . In vivo, preclinical imaging of 134 Ce-PSMA-617 and 134 Ce-MACROPA-PEG 4 -YS5 was performed on 22Rv1 tumor–bearing male nu/nu-mice. Ex vivo biodistribution was performed for 134 Ce/ 225 Ac-MACROPA-PEG 4 -YS5 conjugates. Results: 134 Ce-MACROPA.NH 2 demonstrated near-quantitative labeling with 1:1 ligand-to-metal ratios at room temperature, whereas a 10:1 ligand-to-metal ratio and elevated temperatures were required for DOTA. Rapid urinary excretion and low liver and bone uptake were seen for 134 Ce/ 225 Ac-DOTA/MACROPA. NH 2 conjugates in comparison to free 134 CeCl 3 confirmed high in vivo stability. An interesting observation during the radiolabeling of tumor-targeting vectors PSMA-617 and MACROPA-PEG 4 -YS5—that the daughter 134 La was expelled from the chelate after the decay of parent 134 Ce—was confirmed through radio–thin-layer chromatography and reverse-phase high-performance liquid chromatography. Both conjugates, 134 Ce-PSMA-617 and 134 Ce-MACROPA-PEG 4 -YS5, displayed tumor uptake in 22Rv1 tumor–bearing mice. The ex vivo biodistribution of 134 Ce-MACROPA.NH 2 , 134 Ce-DOTA and 134 Ce-MACROPA-PEG 4 -YS5 corroborated well with the respective 225 Ac-conjugates. Conclusion: These results demonstrate the PET imaging potential for 134 Ce/ 134 La-labeled small-molecule and antibody agents. The similar 225 Ac and 134 Ce/ 134 La-chemical and pharmacokinetic characteristics suggest that the 134 Ce/ 134 La pair may act as a PET imaging surrogate for 225 Ac-based radioligand therapies.

07 ISOTOPE AND RADIATION SOURCES↗

Imaging Complex Subsurface Structures for Geothermal Exploration at Pirouette Mountain and Eleven-Mile Canyon in Nevada

Accurate imaging of subsurface complex structures with faults is crucial for geothermal exploration because faults are generally the primary conduit of hydrothermal flow. It is very challenging to image geothermal exploration areas because of complex geologic structures with various faults and noisy surface seismic data with strong and coherent ground-roll noise. In addition, fracture zones and most geologic formations behave as anisotropic media for seismic-wave propagation. Properly suppressing ground-roll noise and accounting for subsurface anisotropic properties are essential for high-resolution imaging of subsurface structures and faults for geothermal exploration. We develop a novel wavenumber-adaptive bandpass filter to suppress the ground-roll noise without affecting useful seismic signals. This filter adaptively exploits both characteristics of the lower frequency and the smaller velocity of the ground-roll noise than those of the signals. Consequently, this filter can effectively differentiate the ground-roll noise from the signal. We use our novel filter to attenuate the ground-roll noise in seismic data along five survey lines acquired by the U.S. Navy Geothermal Program Office at Pirouette Mountain and Eleven-Mile Canyon in Nevada, United States. We then apply our novel anisotropic least-squares reverse-time migration algorithm to the resulting data for imaging subsurface structures at the Pirouette Mountain and Eleven-Mile Canyon geothermal exploration areas. The migration method employs an efficient implicit wavefield-separation scheme to reduce image artifacts and improve the image quality. Our results demonstrate that our wavenumber-adaptive bandpass filtering method successfully suppresses the strong and coherent ground-roll noise in the land seismic data, and our anisotropic least-squares reverse-time migration produces high-resolution subsurface images of Pirouette Mountain and Eleven-Mile Canyon, facilitating accurate fault interpretation for geothermal exploration.

15 GEOTHERMAL ENERGY↗

Deep-Learning-Based Segmentation of Keyhole in In-Situ X-ray Imaging of Laser Powder Bed Fusion

In laser powder bed fusion processes, keyholes are the gaseous cavities formed where laser interacts with metal, and their morphologies play an important role in defect formation and the final product quality. The in-situ X-ray imaging technique can monitor the keyhole dynamics from the side and capture keyhole shapes in the X-ray image stream. Keyhole shapes in X-ray images are then often labeled by humans for analysis, which increasingly involves attempting to correlate keyhole shapes with defects using machine learning. However, such labeling is tedious, time-consuming, error-prone, and cannot be scaled to large data sets. To use keyhole shapes more readily as the input to machine learning methods, an automatic tool to identify keyhole regions is desirable. In this paper, a deep-learning-based computer vision tool that can automatically segment keyhole shapes out of X-ray images is presented. The pipeline contains a filtering method and an implementation of the BASNet deep learning model to semantically segment the keyhole morphologies out of X-ray images. The presented tool shows promising average accuracy of 91.24% for keyhole area, and 92.81% for boundary shape, for a range of test dataset conditions in Al6061 (and one AliSi10Mg) alloys, with 300 training images/labels and 100 testing images for each trial. Prospective users may apply the presently trained tool or a retrained version following the approach used here to automatically label keyhole shapes in large image sets.

36 MATERIALS SCIENCE↗

Fatigue-Crack Detection and Monitoring through the Scattered-Wave Two-Dimensional Cross-Correlation Imaging Method Using Piezoelectric Transducers

Piezoelectric transducers are convenient enablers for generating and receiving Lamb waves for damage detection. Fatigue cracks are one of the most common causes for the failure of metallic structures. Increasing emphasis on the integrity of critical structures creates an urgent need to monitor structures and to detect cracks at an early stage to prevent catastrophic failures. This paper presents a two-dimensional (2D) cross-correlation imaging technique that can not only detect a fatigue crack but can also precisely image the fatigue cracks in metallic structures. The imaging method was based on the cross-correlation algorithm that uses incident waves and the crack-scattered waves of all directions to generate the crack image. Fatigue testing for crack generation was then conducted in both an aluminum plate and a stainless-steel plate. Piezoelectric wafer transducer was used to actuate the interrogating Lamb wave. To obtain the scattered waves as well as the incident waves, a scanning laser Doppler vibrometer was adopted for acquiring time-space multidimensional wavefield, followed with frequency-wavenumber processing. The proof-of-concept study was conducted in an aluminum plate with a hairline fatigue crack. A frequency-wavenumber filtering method was used to obtain the incident wave and the scattered wave wavefields for the cross-correlation imaging. After this, the imaging method was applied to evaluate cracks on a stainless-steel plate generated during fatigue loading tests. The presented imaging method showed successful inspection and quantification results of the crack and its growth.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

First experimental study of multiple orientation muon tomography, with image optimization in sparse data environments

Due to the high penetrating power of cosmic ray muons, they can be used to probe very thick and dense objects. As charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object, particle direction changes can be used to extract scattering information within an object. This can be used to produce a scattering intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies have been published with multi-orientation tomography, which can form a three-dimensional representation faster than a single orientation view. In this work we present the first experimental multiple orientation muon tomography study. Experimental muon-scatter based tomography was performed using a concrete filled steel drum with several different metal wedges inside, between detector planes. Data was collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were then combined using two different tomographic methods. Results showed that using a combination of multiple depth-of-field reconstructions, rather than a traditional inverse Radon transform approach used for CT, resulted in more useful images for sparser data. As cosmic ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedge compositions.

Applied Physics (physics.app-ph)↗

Is the spatial distribution of brain lesions associated with closed-head injury predictive of subsequent development of attention-deficit/hyperactivity disorder? Analysis with brain-image database

PURPOSE: To determine whether there is an association between the spatial distribution of lesions detected at magnetic resonance (MR) imaging of the brain in children after closed-head injury and the development of secondary attention-deficit/hyperactivity disorder (ADHD). MATERIALS AND METHODS: Data obtained from 76 children without prior history of ADHD were analyzed. MR images were obtained 3 months after closed-head injury. After manual delineation of lesions, images were registered to the Talairach coordinate system. For each subject, registered images and secondary ADHD status were integrated into a brain-image database, which contains depiction (visualization) and statistical analysis software. Using this database, we assessed visually the spatial distributions of lesions and performed statistical analysis of image and clinical variables. RESULTS: Of the 76 children, 15 developed secondary ADHD. Depiction of the data suggested that children who developed secondary ADHD had more lesions in the right putamen than children who did not develop secondary ADHD; this impression was confirmed statistically. After Bonferroni correction, we could not demonstrate significant differences between secondary ADHD status and lesion burdens for the right caudate nucleus or the right globus pallidus. CONCLUSION: Closed-head injury-induced lesions in the right putamen in children are associated with subsequent development of secondary ADHD. Depiction software is useful in guiding statistical analysis of image data.

NASA Discipline Neuroscience↗

A back-illuminated megapixel CMOS image sensor

In this paper, we present the test and characterization results for a back-illuminated megapixel CMOS imager. The imager pixel consists of a standard junction photodiode coupled to a three transistor-per-pixel switched source-follower readout [1]. The imager also consists of integrated timing and control and bias generation circuits, and provides analog output. The analog column-scan circuits were implemented in such a way that the imager could be configured to run in off-chip correlated double-sampling (CDS) mode. The imager was originally designed for normal front-illuminated operation, and was fabricated in a commercially available 0.5 pn triple-metal CMOS-imager compatible process. For backside illumination, the imager was thinned by etching away the substrate was etched away in a post-fabrication processing step.

Complementary Metal Oxide Semiconductor imager (CM↗

Reaching the Diffraction Limit - Differential Speckle and Wide-Field Imaging for the WIYN Telescope

Speckle imaging allows telescopes to achieve diffraction limited imaging performance. The technique requires cameras capable of reading out frames at a very fast rate, effectively 'freezing out' atmospheric seeing. The resulting speckles can be correlated and images reconstructed that are at the diffraction limit of the telescope. These new instruments are based on the successful performance and design of the Differential Speckle Survey Instrument (DSSI).The instruments are being built for the Gemini-N and WIYN telescopes and will be made available to the community via the peer review proposal process. We envision their primary use to be validation and characterization of exoplanet targets from the NASA, K2 and TESS missions and RV discovered exoplanets. Such targets will provide excellent follow-up candidates for both the WIYN and Gemini telescopes. We expect similar data quality in speckle imaging mode with the new instruments. Additionally, both cameras will have a wide-field mode and standard SDSS filters. They will be highly versatile instruments and it is that likely many other science programs will request time on the cameras. The limiting magnitude for speckle observations will remain around 13-14th at WIYN and 16-17th at Gemini, while wide-field, normal CCD imaging operation should be able to go to much fainter, providing usual CCD imaging and photometric capabilities. The instruments will also have high utility as scoring cameras for telescope engineering purposes, or other applications where high time resolution is needed. Instrument support will be provided, including a software pipeline that takes raw speckle data to fully reconstructed images.

detector↗