Reconstruction of high-resolution atomic force microscopy measurements from fast-scan data using a Noise2Noise algorithm
Not Available
47 OTHER INSTRUMENTATION↗
SEARCH · Engineering Papers
Results for “Image reconstruction”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Three-Dimensional Reconstruction of Defects and Structures in Additively Manufactured Parts with Automated Serial Sectioning
Metal additive manufacturing (AM) processes have been demonstrated to be effective at reducing costs and lead times associated with complex components for space flight applications. Laser powderbed fusion (L-PBF) is a commonly used AM technology due to the ability to produce complex parts with fine feature resolution in a wide variety of alloys and applications. L-PBF, like many other manufacturing processes, can produce minor flaws in parts when in nominal operation as well as process-escape defects when process abnormalities occur. The effects of the flaws and methods of detecting the flaws are a subject of interest to understand the difficulties in detecting these flaws with current technology and how much risk the flaws or defects pose to potential flight parts. Using a RoboMet.3D automated serial sectioning system, seeded defects as well as minor process flaws can be imaged and reconstructed in three dimensions to compare to non-destructive evaluation (NDE) techniques, such as x-ray computed tomography (CT), neutron CT, and in-situ monitoring. The RoboMet automates the metallography process by automatically grinding, polishing, and imaging samples in a single system and providing the control data for NDE comparisons to know the real size of defects built into coupons. These comparisons provide an understanding behind the technological limitations of the NDE techniques for different alloys. The same serial sectioning methods have also been utilized to characterize the surfaces of parts to reconstruct the surfaces and take measurements of internal features not easily examined with non-destructive methods. Using the RoboMet, fine lattice structures built with L-PBF have been characterized to determine the actual thicknesses of struts and density of the lattice structures. These structures have been used as finer build supports for the L-PBF process, designs for fine catalysts, and other design considerations for small components. The RoboMet data helps to inform the modeling and design efforts around these fine components.
additive manufacturing↗
Bulk reconstruction and non-isometry in the backwards-forwards holographic black hole map
The backwards-forwards map, introduced as a generalization of the non-isometric holographic maps of the black hole interior of Akers, Engelhardt, Harlow, Penington, and Vardhan to include non-trivial dynamics in the effective description, has two possible formulations differing in when the post-selection is performed. While these two forms are equivalent on the set of dynamically generated states — states formed from unitary time evolution acting on well-defined initial configurations of infalling matter — they differ on the generic set of states necessary to describe the apparent world of the infalling observer. We show that while both versions successfully reproduce the Page curve, the version involving post-selection as the final step, dubbed the backwards-forwards-post-selection (BFP) map, has the desirable properties of being non-isometric but isometric on average and providing state-dependent reconstruction of bulk operators, while the other version does not. Thus the BFP map is a suitable non-isometric code describing the black hole interior including interior interactions.
3-D Image Reconstruction↗
Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)
Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.
36 MATERIALS SCIENCE↗
JWST NIRCam Defocused Imaging Photometric Stability Performance and How It Can Sense Mirror Tilts
We use JWST NIRCam short-wavelength photometry to capture a transit lightcurve of the exoplanet HAT-P-14 b to assess performance as part of instrument commissioning. The short-wavelength precision is 152 ppm per 27 s integration as measured over the full time series compared to a theoretical limit of 107 ppm, after corrections to spatially correlated 1/f noise. Persistence effects from charge trapping are well fit by an exponential function with short characteristic timescales, settling on the order of 5–15 minutes. The short-wavelength defocused photometry is also uniquely well suited to measure the real-time wave-front error of JWST. Analysis of the images and reconstructed wave-front maps indicates that two different hexagonal primary mirror segments exhibited “tilt events,” where they changed orientation rapidly in less than ∼1.4 s. In some cases, the magnitude and timing of the flux jumps caused by tilt events can be accurately predicted with a telescope model. These tilt events can be sensed by simultaneous longer-wavelength NIRCam grism spectral images alone in the form of changes to the point-spread function, diagnosed from the full width at half maximum. They can also be sensed with the fine guidance sensor instrument from difference images. Tilt events possibly from sudden releases of stress in the backplane structure behind the mirrors were expected during the commissioning period because they were found in ground-based testing. Tilt events have shown signs of decreasing in frequency but have not disappeared completely. The detectors exhibit some minor (less than 1%) deviations from linear behavior in the first few groups of each integration, potentially impacting absolute fluxes and transit depths on bright targets, where only a handful of groups are possible. Overall, the noise is within 50% of the theoretical photon noise and read noise. This bodes well for high-precision measurements of transiting exoplanets and other time variable targets.
Everett Schlawin↗
Two datasets are better than one: method of double moments for 3D reconstruction in cryo-EM
Cryo-electron microscopy is a powerful imaging technique for reconstructing three-dimensional molecular structures from noisy tomographic projection images of randomly oriented particles. We introduce a new data fusion framework, termed the method of double moments, which reconstructs molecular structures from two instances of the second-order moment of projection images obtained under distinct orientation distributions: one uniform, the other non-uniform and unknown. We prove that these moments generically uniquely determine the underlying structure, up to a global rotation and reflection, and we develop a convex-relaxation-based algorithm that achieves accurate recovery using only second-order statistics. Our results demonstrate the advantage of collecting and modeling multiple datasets under different experimental conditions, illustrating that leveraging dataset diversity can substantially enhance reconstruction quality in computational imaging tasks.
Kam’s method↗
Impact of simulated reduced injected dose on the assessment of amyloid PET scans
To investigate the impact of reduced injected doses on the quantitative and qualitative assessment of the amyloid PET tracers [ 18 F]flutemetamol and [ 18 F]florbetaben. Cognitively impaired and unimpaired individuals (N = 250, 36% Aβ-positive) were included and injected with [ 18 F]flutemetamol (N = 175) or [ 18 F]florbetaben (N = 75). PET scans were acquired in list-mode (90–110 min post-injection) and reduced-dose images were simulated to generate images of 75, 50, 25, 12.5 and 5% of the original injected dose. Images were reconstructed using vendor-provided reconstruction tools and visually assessed for Aβ-pathology. SUVRs were calculated for a global cortical and three smaller regions using a cerebellar cortex reference tissue, and Centiloid was computed. Absolute and percentage differences in SUVR and CL were calculated between dose levels, and the ability to discriminate between Aβ- and Aβ + scans was evaluated using ROC analyses. Finally, intra-reader agreement between the reduced dose and 100% images was evaluated. At 5% injected dose, change in SUVR was 3.72% and 3.12%, with absolute change in Centiloid 3.35CL and 4.62CL, for [ 18 F]flutemetamol and [ 18 F]florbetaben, respectively. At 12.5% injected dose, percentage change in SUVR and absolute change in Centiloid were < 1.5%. AUCs for discriminating Aβ- from Aβ + scans were high (AUC ≥ 0.94) across dose levels, and visual assessment showed intra-reader agreement of > 80% for both tracers. This proof-of-concept study showed that for both [ 18 F]flutemetamol and [ 18 F]florbetaben, adequate quantitative and qualitative assessments can be obtained at 12.5% of the original injected dose. However, decisions to reduce the injected dose should be made considering the specific clinical or research circumstances.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
Aperture codes for sensors viewing extended objects from space
The paper describes aperture codes viewing extended objects form space which find application in imaging an extended object which may have relatively low contrast, and whose lateral limits extend beyond the FOV of the sensor. Those elements of an extended object lying near the FOV limits are only partially coded, i.e., flux from those elements cannot cast a shadow of the entire aperture code onto the detector, as can elements near the center of the FOV. This has consequences for the algorithms used to reconstruct the image. The object field is divided into a number of elements which is smaller than the number of detector pixels, and a least squares fit to the data is performed. The methods used for choosing the matrices representing the aperture codes are discussed, and computer simulations of the effects of noise are described.
Curtis, C. C.↗
Neural-Based Compression Scheme for Solar Image Data
Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data. On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression. In this work, we propose a neural network-based lossy compression method to be used in NASA’s data-intensive imagery missions. We chose NASA’s Solar Dynamics Observatory (SDO) mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm. In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs. The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective. We also studied how optimizing perceptual losses could help our neural compressor to preserve high-frequency details of the data in the reconstructed compressed image. Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data. As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of ∼ 0.1 bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.
Image coding↗
Coded aperture imaging - Predicted performance of uniformly redundant arrays
It is noted that uniformly redundant arrays (URAs) have autocorrelation functions with perfectly flat sidelobes. A generalized signal-to-noise equation has been developed to predict URA performance. The signal-to-noise value is formulated as a function of aperture transmission or density, the ratio of the intensity of a resolution element to the integrated source intensity, and the ratio of detector background noise to the integrated intensity. It is shown that the only two-dimensional URAs known have a transmission of one half. This is not a great limitation because a nonoptimum transmission of one half never reduces the signal-to-noise ratio more than 30%. The reconstructed URA image contains practically uniform noise, regardless of the object structure. URA's improvement over the single-pinhole camera is much larger for high-intensity points than for low-intensity points.
Fenimore, E. E.↗
A physical comparison of a fluoroscopic CAT system and the EMI head scanner
A quantitative comparison of the capabilities to produce computerized tomograms was made between the EMI head scanner and reconstructions from images provided by a large screen low light level-TV camera fluoroscopic system. A phantom made from lucite containing rods of various materials and sizes was used. The computer printout of each was analyzed and a correlation of 0.8 was noted between the results of both systems. The differential attenuation detectability of the fluoroscopic system was found to be comparable to or better than the EMI unit. As expected from a consideration of the quantum statistics for each system, the noise in the obtained reconstructions was also comparable. It is concluded that such a fluoroscopic system performs favorably when compared to the presently available commercial systems.
Baily, N. A.↗
Nondestructive Damage Detection of Concrete With Alkali-Silica Reactions Using Coda Wave and Anomaly Detection
An anomaly detection model for early damage detection for concrete structures undergoing alkali-silica reaction (ASR) is presented. It is difficult to detect ASR initiation and early damage without a reference expansion measurement. Coda waves, or the multiply scattered portion of ultrasonic waves, have been found to be indicative of small changes in complex material such as concrete. The relationship between concrete damage and relative velocity change and decorrelation of coda waves has been studied, but a generalized model which detects when damage occurs in a concrete structure is still lacking. The presented method uses features extracted from coda waves to detect early damage in concrete structures. The model uses unsupervised learning and only requires data from undamaged structures for training. During the training process, the reconstruction error of the training data is minimized. When the data collected from damaged concrete structures is used as an input of the model, it returns high reconstruction errors that indicate the occurrence of damage in the structures. The performance of the model is validated using experimental studies and has been shown to generalize across two different ASR specimens.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Three-dimensional bubble reconstruction in high burnup UO 2
In light water reactor (LWR) UO 2 fuels, the evolution of volatile fission products is one of the critical areas of fuel behavior that is yet to be fully understood. In UO 2 irradiated to high burnups, it is well known that most released fission gases come from the central region of the fuel as opposed to the highly porous high burnup structure (HBS) on the periphery of the pellets. However, fuels with and without interconnected bubble networks at the fuel center showed high to moderate release fractions, which conceals the mechanisms responsible for the gas release in the latter scenario. In this work, focused ion beam tomography was used to investigate the three-dimensional bubble structure in an irradiated LWR UO 2 fuel pellet with high degree of fission gas retention so that the degree of bubble interconnection could be assessed. Six radial locations with different burnups and temperatures were serially sectioned and imaged to reconstruct the three-dimensional bubble structure. As expected, the highest porosity was observed at the periphery of the fuel (HBS). Here, the porosity then decreased towards the pellet center, except for the centermost location. This location had a slightly higher porosity than its adjacent mid-radial location, which was attributed to the temperature difference between the two locations. This study provides a first-time volumetric evaluation of the porosity at different radial locations on a UO 2 fuel pellet. During this investigation, no significant bubble interconnection was noted at any of the six radial locations.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
LABQ3: Bayesian method for quantification of mineral compositions and nano-scale elemental mapping of 3D synchrotron XCT data
Quantitative analysis of mineral compositions is essential in understanding geochemical, mineralogical and environmental processes. Fine-resolution 3D imaging is widely done using synchrotron X-ray computed tomography (XCT), but existing analyses are limited to visualization and segmentation. This paper presents a new method, Linear Attenuation Bayesian Quantitative 3D-mapper (LABQ3), based on the linearity of X-ray attenuation with respect to elemental concentrations. To address the random variability in attenuation measurements, LABQ3 employs Bayesian decision theory to minimize classification error, using reference attenuation distributions from scans of pure mineral standards. To demonstrate LABQ3 and test its performance, we studied precipitated carbonate samples. XCT scans were done at multiple energies using the transmission X-ray microscope (TXM) at beamline 32-ID-C of the Advanced Photon Source at Argonne National Laboratory. The reconstructed 3D images have a voxel size of 20 nm. Analyses revealed rich nano-scale compositional heterogeneity within individual particles. A mixture of calcium and cadmium produced an overall stoichiometric composition of (Ca 0.78 ,Cd 0.22 )CO 3 , with some voxels containing nearly pure CdCO 3 . The addition of zinc led to an overall stoichiometric composition of 33% Ca, 28% Cd, 39% Zn, with a nearly pure CaCO 3 core and compositional zonation through the rim. These compositional gradients are related to temporal sequences of carbonate mineral formation where Cd precipitated at the beginning in (Ca,Cd)CO 3 , while Cd and Zn precipitated at the end in (Ca, Cd,Zn)CO 3 . Results differ from bulk analyses using Inductively Coupled Plasma-Mass Spectrometry (ICP-MS), showing that LABQ3 provides particle-specific insights. LABQ3 distinguishes itself by quantifying chemical compositions along a continuum, making it different from XCT analyses based on segmentation. LABQ3 allows simultaneous acquisition of morphology and chemical composition in 3D, facilitating the interpretation of chemical gradients of trace elements, quantification of solid solution compositions, inferences about temporal sequences of mineral precipitation, and addressing other concerns about solid-phase chemistry.
58 GEOSCIENCES↗
Learning Canonical Embeddings for Unsupervised Shape Correspondence With Locally Linear Transformations
We present a new approach to unsupervised shape correspondence learning between pairs of point clouds. We make the first attempt to adapt the classical locally linear embedding algorithm (LLE)-originally designed for nonlinear dimensionality reduction-for shape correspondence. The key idea is to find dense correspondences between shapes by first obtaining high-dimensional neighborhood-preserving embeddings of low-dimensional point clouds and subsequently aligning the source and target embeddings using locally linear transformations. We demonstrate that learning the embedding using a new LLE-inspired point cloud reconstruction objective results in accurate shape correspondences. More specifically, the approach comprises an end-to-end learnable framework of extracting high-dimensional neighborhood-preserving embeddings, estimating locally linear transformations in the embedding space, and reconstructing shapes via divergence measure-based alignment of probability density functions built over reconstructed and target shapes. Our approach enforces embeddings of shapes in correspondence to lie in the same universal/canonical embedding space, which eventually helps regularize the learning process and leads to a simple nearest neighbors approach between shape embeddings for finding reliable correspondences. Comprehensive experiments show that the new method makes noticeable improvements over state-of-the-art approaches on standard shape correspondence benchmark datasets covering both human and nonhuman shapes.
deformation↗
High resolution and image processing of otoconia matrix
This study was designed to investigate patterns of fibrils organization in histochemically stained otoconia. Transmission electron microscope and video imaging were used. These data indicate that otoconia of the chick (Gallus domesticus) inner ear may have central cores in vivo. The data also show that the ultrastructural organization of fibrils fixed with aldehydes and histochemical stains follows trajectories that conform to the hexagonal shape of otoconia. These changes in direction may contribute to the formation of a central core. The existence of central cores is important for the in vivo buoyancy of otoconia. Packing of fibrils is tighter after phosphotungstic acid (PTA) stained otoconia than with other histochemical stains, which usually produce looser packing of fibrils and seemingly larger central core. TEM of tilted and untilted material showed that turning of fibrils occurs at the points where the face angles of otoconia form and where central cores exist. Video image processing of the images allowed reconstructing a template which, if assumed to repeat and change trajectories, would fit the pattern of fibrils seen in fixed otoconia. Since it is highly unlikely that aldehyde primary fixation or PTA stain caused such drastic change in the direction of fibrils, the template derived from these results may closely approximate patterns of otoconia fibrils packing in vivo. However, if the above is correct, the perfect crystallographic diffraction pattern of unfixed otoconia do not correspond to patterns of fixed fibrils.
NASA Discipline Neuroscience↗
Dose-efficient automatic differentiation for ptychographic reconstruction
Ptychography, as a powerful lensless imaging method, has become a popular member of the coherent diffractive imaging family over decades of development. The ability to utilize low-dose X-rays and/or fast scans offers a big advantage in a ptychographic measurement (for example, when measuring radiation-sensitive samples), but results in low-photon statistics, making the subsequent phase retrieval challenging. Here, we demonstrate a dose-efficient automatic differentiation framework for ptychographic reconstruction (DAP) at low-photon statistics and low overlap ratio. As no reciprocal space constraint is required in this DAP framework, the framework, based on various forward models, shows superior performance under these conditions. It effectively suppresses potential artifacts in the reconstructed images, especially for the inherent periodic artifact in a raster scan. We validate the effectiveness and robustness of this method using both simulated and measured datasets.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
The Fourier-Kelvin Stellar Interferometer (FKSI): A Discovery Class TPF/DARWIN Pathfinder Mission Concept
The Fourier-Kelvin Stellar Interferometer (FKSI) is a mission concept for an imaging and nulling interferometer for the mid-infrared spectral region (5-30 microns). FKSI is conceived as a scientific and technological pathfinder to TPF/DARWIN as well as SPIRIT, SPECS, and SAFIR. It will also be a high angular resolution system complementary to NGST. The scientific emphasis of the mission is on the evolution of protostellar systems, from just after the collapse of the precursor molecular cloud core, through the formation of the disk surrounding the protostar, the formation of planets in the disk, and eventual dispersal of the disk material. FKSI will also search for brown dwarfs and Jupiter mass and smaller planets, and could also play a very powerful role in the investigation of the structure of active galactic nuclei and extra-galactic star formation. We have been studying alternative interferometer architectures and beam combination techniques, and evaluating the relevant science and technology tradeoffs. Some of the technical challenges include the development of the cryocooler systems necessary for the telescopes and focal plane array, light and stiff but well-damped truss systems to support the telescopes, and lightweight and coolable optical telescopes. We present results of detailed design studies of the FKSI starting with a design consisting of five one meter diameter telescopes arranged along a truss structure in a linear non-redundant array, cooled to 35 K. A maximum baseline of 20 meters gives a nominal resolution of 26 mas at 5 microns. Using a Fizeau beam combination technique, a simple focal plane camera could be used to obtain both Fourier and spectral data simultaneously for a given orientation of the array. The spacecraft will be rotated to give sufficient Fourier data to reconstruct complex images of a broad range of astrophysical sources. Alternative and simpler three and two telescope designs emphasizing nulling and spectroscopy also have been investigated and will be discussed.
Danchi, W. C.↗