Complex imaging of phase domains by deep neural networks
Explore the source record for details and available documents.
Wu, Longlong↗
SEARCH · Engineering Papers
Results for “Image Transforms”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Quantitative x ray phase contrast imaging of oblique shock wave–interface interactions
Oblique shock wave–interface interactions of gases and liquids have been extensively studied in shock tubes using optical methods to measure equation-of-state (EOS) parameters. However, this is difficult with solids due to their opaqueness to visible light. X ray phase contrast imaging (XPCI) has the penetrative strength to probe solids while still being sensitive to mass density and enhancing the visibility of material boundaries. We investigate the accuracy and repeatability of measuring the mean value of the average mass density (areal density divided by thickness) over region S (B S ) and flow deflection angle (θ) from XPCI images of a sample. To that end, a Hough transform-based method for measuring θ is developed. To measure B S , the XPCI image intensity probability density function (PDF) is modeled accounting for the spatial distribution of x ray energy, scintillator response, and pulse-to-pulse variation in the x ray intensity. In addition, a Monte Carlo-based algorithm for computing the B S PDF is developed. Both methods are validated on an impact-generated oblique shock wave interacting at a solid polymer-to-polymer interface. Furthermore this is accomplished through a comparison to hydrodynamic simulations using well-established EOS. Under the modeling framework for the XPCI image intensity, B S is computed with an accuracy of < 0.1% and precision of 3%–5%, while θ has an uncertainty of 0.2°, respectively. This shows that the XPCI-based model that is developed here could be an invaluable tool for high-fidelity testing of hydrodynamic models in shock polar configurations.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Deep Deception: Exemplars of Adversarial Machine Learning and Countermeasures Applicable to International Safeguards
As a follow-up to our more comprehensive report on Adversarial Machine Learning (AML), here we provide demonstrations of AML attacks against the Limbo image database of UF6 cylinders in a variety of orientations and amongst a variety of distractor images. We demonstrate the Carlini & Wagner AML attack against a subset of Limbo images, with 100% attack success rate; meaning all attacked images were misclassified by a highly accurate trained model, yet the image changes were imperceptible to the human eye. We also demonstrate successful attacks against segmented images (images with more than one targeted object). Finally, we demonstrated the Fast Fourier Transform countermeasure that can be used to detect AML attacks on images. The intent of this and our previous report is to inform the IAEA and stakeholders of both the promise of machine learning, which could greatly improve the efficiency of surveillance monitoring, but also of the real threat of AML and potential defenses.
97 MATHEMATICS AND COMPUTING↗
Experimental and theoretical analysis of carbon driven detonation waves in a heterogeneously premixed Rotating Detonation Engine
Coal dust explosions can be hazardous; however, they can also generate a significant rise in stagnation pressure if adequately harnessed. Rotating detonation combustors seek to take advantage of the stagnation pressure rise phenomenon in a more sustained and controlled manner via confinement to a physical annulus, leading to increased overall thermodynamic efficiency. Here this investigation presents an analysis of detonations fueled by Carbon Black, a solid particulate consisting of virtually pure carbon molecules and lean Hydrogen-Air mixtures. It is realized that with the addition of Carbon Black, an increase of lean mixture detonability and detonation velocities extending the operating limit over that of a pure hydrogen-air mixture is experienced. For all testing conditions, the total equivalence ratio is held at φ = 1, while the fuel mixture's carbon mass fraction is increased from 0 to 0.7 while the hydrogen is decreased. Detonation wave velocities are extracted from high-speed imaging through applying a Discrete Fourier Transform algorithm to determine changes to the wave speed as Carbon Black particles are introduced. As a result, due to the addition of Carbon Black as an auxiliary fuel source, detonations were formed instead of deflagrations in operating conditions where one would expect deflagrations at the same hydrogen-air equivalence ratios without Carbon Black addition. The detonation formation provides evidence that the coal particles are reacting within the detonation wave in a large enough capacity to support a detonation wave within the annulus. Furthermore, the wave speed is shown to increase with the additional of carbon particles. At a constant global equivalence ratio, the detonation wave velocities were found to decrease with hydrogen's incremental replacement with coal particles. Whereby, through a theoretical comparison of the heat of combustion as computed from the experimentally derived detonation wave velocities, a linear relationship of the two was shown to exist. Therefore, the heat of combustion has the potential to describe an operational limit to sustaining a detonation wave.
42 ENGINEERING↗
Comparison of automated chemical-guided segmentation and human annotation of soil organic matter in X-ray microcomputed tomography imaging in contrasted soil types
Soil organic matter (OM) formation and persistence is strongly influenced by the spatial distribution of organic substrates and microscale soil heterogeneity by dictating OM accessibility to microorganisms. However, traditional size and/or density fractionation techniques disrupt aggregate architecture, eliminating spatial information needed to fully understand intra-aggregate OM distribution. To quantify three-dimensional OM spatial distribution and automate segmentation in X-ray microcomputed tomography (µCT) imaging without human annotation bias, we developed an iodine gas vapor (I2) based staining workflow that eliminates labor-intensive manual annotation while maintaining segmentation accuracy, using aggregates from four taxonomically diverse soils (Xerofluvent, Haploxeroll Sphagnofibrist, Palehumult) with an 8-fold range of soil organic carbon. Human annotation of 10 µCT slices by the experienced and inexperienced annotators resulted in variations up to 3% in the Dice similarity coefficient (DSC), reflecting a degree of inherent subjectivity of manual labeling. Such inconsistencies are expected to compound as the number of manually annotated slices increases. Dual-energy µCT imaging at 33.1 keV (below the iodine (I) K-edge) and 33.2 keV (above the I K-edge) was used to resolve aggregate microstructure following I2 staining. The automated image subtraction pipeline identified OM regions by the I Kedge induced brightness increases, achieving DSC values of 0.58–0.83 relative to an experienced annotator. Sensitivity analyses revealed that the reconstruction alpha value—optimized via the open-source tool TomocuPy—and the 3D registration slice count were the primary determinants of accuracy, providing a novel benchmark for dual-energy soil imaging. The pipeline without GPU acceleration achieved 9.6 to 43.2 times faster than manual annotation. Using GPU-accelerated image post-processing and affine transformation matrices, the pipeline successfully segmented OM elements for large-scale datasets (3232×3232 pixel, 2048 slices) within ~5200 s from raw file acquisition to segmented output. The high-throughput approach enables the quantification of OM spatial distribution across diverse and heterogeneous soil.
Soil microbial biomass↗
Quantification of strain and its impact on the phase stabilization of all-inorganic cesium lead iodide perovskites
Not Available
36 MATERIALS SCIENCE↗
Foundations of machine learning for low-temperature plasmas: methods and case studies
Abstract Machine learning (ML) and artificial intelligence have proven to be an invaluable tool in tackling a vast array of scientific, engineering, and societal problems. The main drivers behind the recent proliferation of ML in practically all aspects of science and technology can be attributed to: (a) improved data acquisition and inexpensive data storage; (b) exponential growth in computing power; and (c) availability of open-source software and resources that have made the use of state-of-the-art ML algorithms widely accessible. The impact of ML on the field of low-temperature plasmas (LTPs) could be particularly significant in the emerging applications that involve plasma treatment of complex interfaces in areas ranging from the manufacture of microelectronics and processing of quantum materials, to the LTP-driven electrification of the chemical industry, and to medicine and biotechnology. This is primarily due to the complex and poorly-understood nature of the plasma-surface interactions in these applications that pose unique challenges to the modeling, diagnostics, and predictive control of LTPs. As the use of ML is becoming more prevalent, it is increasingly paramount for the LTP community to be able to critically analyze and assess the concepts and techniques behind data-driven approaches. To this end, the goal of this paper is to provide a tutorial overview of some of the widely-used ML methods that can be useful, amongst others, for discovering and correlating patterns in the data that may be otherwise impractical to decipher by human intuition alone, for learning multivariable nonlinear data-driven prediction models that are capable of describing the complex behavior of plasma interacting with interfaces, and for guiding the design of experiments to explore the parameter space of plasma-assisted processes in a systematic and resource-efficient manner. We illustrate the utility of various supervised, unsupervised and active learning methods using LTP datasets consisting of commonly-available, information-rich measurements (e.g. optical emission spectra, current–voltage characteristics, scanning electron microscope images, infrared surface temperature measurements, Fourier transform infrared spectra). All the ML demonstrations presented in this paper are carried out using open-source software; the datasets and codes are made publicly available. The FAIR guiding principles for scientific data management and stewardship can accelerate the adoption and development of ML in the LTP community.
Physics↗
Using onset times from frequent seismic surveys to understand fluid flow at the Peace River Field, Canada
With our limited knowledge of the relationship between changes in the state of an aquifer or reservoir and the corresponding changes in the elastic moduli, that is the rock physics model, hampers the effective use of time-lapse seismic observations for estimating flow properties within the Earth. A central problem is the complicated dependence of the magnitude of time-lapse changes on the saturation, pressure, and temperature changes within an aquifer or reservoir. We describe an inversion methodology for reservoir characterization that uses onset times, the calendar time of the change in seismic attributes, rather than the magnitude of the changes. We find that onset times are much less sensitive than magnitudes to the rock physics model used to relate time-lapse observations to changes in saturation, temperature and fluid pressure. We apply the inversion scheme to observations from daily monitoring of enhanced oil recovery at the Peace River field in Canada. An array of 1492 buried hydrophones record seismic signals from 49 buried sources. Time-shifts for elastic waves traversing the reservoir are extracted from the daily time-lapse cubes. In our analysis 175 images of time-shifts are transformed into a single map of onset times, leading to a substantial reduction in the volume of data. These observations are used in conjunction with bottom hole pressure data to infer the initial conditions prior to the injection, and to update the reservoir permeability model. The combination of a global and local inversion scheme produces a collection of reservoir models that are best described by three clusters. The updated model leads to a nearly 70 percent reduction in seismic data misfit. The final set of solutions successfully predict the observed normalized pressure history during the soak and flow-back into the wells between 82 and 175 days into the cyclic steaming operation.
58 GEOSCIENCES↗
Rapid detection of rare events from in situ X-ray diffraction data using machine learning
High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.
Zheng, Weijian↗
Improving the Concrete Crack Detection Process via a Hybrid Visual Transformer Algorithm
Inspections of concrete bridges across the United States represent a significant commitment of resources, given their biannual mandate for many structures. With a notable number of aging bridges, there is an imperative need to enhance the efficiency of these inspections. This study harnessed the power of computer vision to streamline the inspection process. Our experiment examined the efficacy of a state-of-the-art Visual Transformer (ViT) model combined with distinct image enhancement detector algorithms. We benchmarked against a deep learning Convolutional Neural Network (CNN) model. These models were applied to over 20,000 high-quality images from the Concrete Images for Classification dataset. Traditional crack detection methods often fall short due to their heavy reliance on time and resources. This research pioneers bridge inspection by integrating ViT with diverse image enhancement detectors, significantly improving concrete crack detection accuracy. Notably, a custom-built CNN achieves over 99% accuracy with substantially lower training time than ViT, making it an efficient solution for enhancing safety and resource conservation in infrastructure management. These advancements enhance safety by enabling reliable detection and timely maintenance, but they also align with Industry 4.0 objectives, automating manual inspections, reducing costs, and advancing technological integration in public infrastructure management.
42 ENGINEERING↗
BM3DORNL
BM3DORNL is a high-performance, open-source library for removing streak and ring artifacts from computed-tomography (CT) data, developed for neutron imaging at Oak Ridge National Laboratory's Spallation Neutron Source (VENUS beamline) and applicable to X-ray CT as well. Ring artifacts — concentric rings in reconstructed slices caused by detector pixel-to-pixel response non-uniformities — appear as vertical streaks in the sinogram and degrade both image quality and quantitative analysis. BM3DORNL operates in the sinogram domain using an adaptation of the BM3D (block-matching and 3D collaborative filtering) algorithm (Dabov et al., 2007). It provides a dedicated streak-removal mode, a true multi-scale BM3D variant (after Mäkinen et al., 2021) that suppresses wide streaks single-scale methods miss, and an alternative Fourier–SVD method (~2.6× faster) combining FFT-based energy detection with rank-1 SVD. The computationally intensive core is implemented in Rust with parallel (Rayon) block matching, integral-image pre-screening, and optimized transforms, and is exposed through a simple Python API (with an optional GUI) so it integrates directly into existing tomography reconstruction pipelines. It processes both 2D sinograms and 3D sinogram stacks, is pip-installable for Linux and macOS, and is documented at https://bm3dornl.readthedocs.io.
Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗
Machine Vision-based Robot Manipulators for Nuclear Applications - 20370
Decommissioning and dismantling of nuclear facilities are major challenges facing the nuclear industry. Robot manipulators with capabilities of restoring nuclear structures and significantly prolonging nuclear power generation in addition to their applications in decommissioning and dismantling (D and D) would immensely ease the above-mentioned challenge. Ability to remotely sense/monitor and analyze dangerous and hazardous environments such as nuclear reactors as well as performing reparatory tasks in such environments using robot manipulators require additional information from vision sensors. Structural sample collection and inspection as well as restoration require object and position information. Computer vision is used to obtain precise 3D position information. The current work uses the Sawyer robot with the integrated Cognex camera. The research presents an approach to facilitate and improve operations in a nuclear reactor using robotic vision control. The vision control system is modeled with Augmented Image Space-based visual servoing approach. Results showing accurate robot control. Object recognition is used to recognize the image and calculate it poses. To transform coordinates of the object's pose from the camera frame to the robotic frame transformation matrices are employed. Future work will employ a 3D camera (with depth information) using Denso robot. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Computational scanning tunneling microscope image database
We introduce the systematic database of scanning tunneling microscope (STM) images obtained using density functional theory (DFT) for two-dimensional (2D) materials, calculated using the Tersoff-Hamann method. It currently contains data for 716 exfoliable 2D materials. Examples of the five possible Bravais lattice types for 2D materials and their Fourier-transforms are discussed. All the computational STM images generated in this work are made available on the JARVIS-STM website ( https://jarvis.nist.gov/jarvisstm ). We find excellent qualitative agreement between the computational and experimental STM images for selected materials. As a first example application of this database, we train a convolution neural network model to identify the Bravais lattice from the STM images. We believe the model can aid high-throughput experimental data analysis. These computational STM images can directly aid the identification of phases, analyzing defects and lattice-distortions in experimental STM images, as well as be incorporated in the autonomous experiment workflows.
47 OTHER INSTRUMENTATION↗
Towards AI Based Data Classification for Decision Making During Testing
During the development of high-consequence items, test systems should be capable of differentiating between test failures resulting from narrowly missing requirements versus those indicating potentially catastrophic faults. In many instances, classifying the data corresponds to simply identifying whether measured waveforms have approximately the anticipated shape. Cast in this light, the problem reduces to converting raw data into a form optimal for use with neural network classifiers. This manuscript investigates different means of representing raw data for image classification. Raw data plots and Short Time Fourier Transform (STFT) spectrograms are classified by both custom built, small-scale, Convolution Neural Networks (CNN) and open-source, multi-million parameter, pre-trained deep CNNs. In the case of time varying frequency content, the STFTs provide images with greater detail and can be accurately classified with simpler networks. This requires less memory and runs faster than classifying the raw data using the more sophisticated options—making STFTs optimal for applications with memory constraints. STFTs are not a panacea. In some cases the time-domain signal contains useful information that should not be discarded. Rather than using raw data or STFTs, the images can be constructed from both by using red and green channels of an RGB image to visualize the real and imaginary components of the transform, with the raw data occupying the blue channel.
97 MATHEMATICS AND COMPUTING↗
Multiplexing and Demultiplexing Signals for Radiography Application Using the Discrete Fourier Transform
Our goal is to develop an X-ray phase-contrast imaging system that can provide excellent soft tissue contrast of phase, attenuation, and small-angle scatter. We propose to replace the common system of G0, G1, and G2 gradings with a biprism array to replace the G1 grading and introduce a novel X-ray tube designed to replace the motion of the phase stepping grading G2. The proposed X-ray tube uses temporal multiplexing to provide simultaneous virtual “electronic phase stepping.” In this work the discrete Fourier transform is used to separate from the composite measurement individual X-ray phase contrast measurements sampled at different frequencies. The method performs a discrete Fourier transform of a composite refence sequence to obtain using the frequency amplitudes calibration factors needed to extract the X-ray phase contrast measurement amplitudes from the composite image. The composite reference sequence is the sum of the individual sequences, at different frequencies, with amplitudes of one. The method takes the discrete Fourier transform of this composite reference sequence; whereby, the amplitude of each frequency component is compared with the total sum of its stand-alone sequence amplitude. A calibration factor is determined so that the amplitude of this composite reference frequency times the calibration factor must equal the total sum of the sequence amplitude—the zero-frequency amplitude of the discrete Fourier transform of its stand-alone sequence. To demultiplex the composite measured signal these calibration factors are multiplied by the amplitudes of the frequency components of the discrete Fourier transform of the composite X-phase-contrast measurement to obtain the amplitude of each frequency encoded measurement. Using these calibration factors, we demonstrate with the discrete Fourier transform in Mathematica the extraction of individual images from a composite image that one would expect obtaining from our proposed new X-ray phase contrast imaging system. We then demonstrate as an example how using images from X-ray phase contrast data one can calculate phase, attenuation and the dark field images using grading phase step data supplied to use from Microworks, GmbH in Karlsruhe, Germany.
42 ENGINEERING↗
Astronomical image time series classification using CONVolutional attENTION (ConvEntion)
Aims: The treatment of astronomical image time series has won increasing attention in recent years. Indeed, numerous surveys following up on transient objects are in progress or under construction, such as the Vera C. Rubin Observatory Legacy Survey for Space and Time (LSST), which is poised to produce huge amounts of these time series. The associated scientific topics are extensive, ranging from the study of objects in our galaxy to the observation of the most distant supernovae for measuring the expansion of the universe. With such a large amount of data available, the need for robust automatic tools to detect and classify celestial objects is growing steadily. Methods: This study is based on the assumption that astronomical images contain more information than light curves. In this paper, we propose a novel approach based on deep learning for classifying different types of space objects directly using images. We named our approach ConvEntion, which stands for CONVolutional attENTION. It is based on convolutions and transformers, which are new approaches for the treatment of astronomical image time series. Our solution integrates spatio-temporal features and can be applied to various types of image datasets with any number of bands. Results: In this work, we solved various problems the datasets tend to suffer from and we present new results for classifications using astronomical image time series with an increase in accuracy of 13%, compared to state-of-the-art approaches that use image time series, and a 12% increase, compared to approaches that use light curves.
79 ASTRONOMY AND ASTROPHYSICS↗
Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)
Biological processes such as processive enzyme turnover and intracellular cargo tracking involve the dynamic motion of a small "article" along a curvilinear biopolymer track. To understand these processes that occur across multiple length and time scales, one must acquire both the trajectory of the particle and the position of the track along which it moves, possibly by combining high-resolution single-particle tracking with conventional microscopy. Yet, usually there is a significant resolution mismatch between these modalities: while the tracked particle is localized with a precision of 10 nm, the image of the surroundings is limited by optical difraction, with 200 nm lateral and 500 nm axial resolutions. Compared to the particle's trajectory, the surrounding curvilinear structure appears as a blurred and noisy image. This disparity in the spatial resolutions of the particle trajectory and the surrounding curvilinear structure image makes data reconstruction, as well as interpretation, particularly challenging. Analysis is further complicated when the curvilinear structures are oriented arbitrarily in 3D space. Here, we present a prior-apprised unsupervised learning (PAUL) approach to extract information from 3D images where the underlying features resemble a curved line such as a filament or microtubule. This three-stage framework starts with a Hessian-based feature enhancement, which is followed by feature registration, where local line segments are detected on repetitively sampled subimage tiles. In the final stage, statistical learning, segments are clustered based on their geometric relationships. Principal curves are then approximated from each segment group via statistical tools including principal component analysis, bootstrap and kernel transformation. This procedure is characterized on simulated images, where sub-voxel medium deviations from true curves have been achieved. The 3D PAUL approach has also been implemented for successful line localization in experimental 3D images of gold nanowires obtained using a multifocal microscope. Lastly, this work not only bridges the resolution gap between two microscopy modalities, but also allows us to conduct 3D super line-localization imaging experiments, without using super-resolution techniques.
42 ENGINEERING↗
Goethite and Hematite Nucleation and Growth from Ferrihydrite: Effects of Oxyanion Surface Complexes
The presence of oxyanions, such as nitrate (NO 3 – ) and phosphate (PO 4 3– ), regulates the nucleation and growth of goethite (Gt) and hematite (Hm) during the transformation of ferrihydrite (Fh). Our previous studies showed that oxyanion surface complexes control the rate and pathway of Fh transformation to Gt and Hm. However, how oxyanion surface complexes control the mechanism of Gt and Hm nucleation and growth during the Fh transformation is still unclear. Here, we used synchrotron scattering methods and cryogenic transmission electron microscopy to investigate the effects of NO 3 – outer-sphere complexes and PO 4 3– inner-sphere complexes on the mechanism of Gt and Hm formation from Fh. Our TEM results indicated that Gt particles form through a two-step model in which Fh particles first transform to Gt nanoparticles and then crystallographically align and grow to larger particles by oriented attachment (OA). In contrast, for the formation of Hm, imaging shows that Fh particles first aggregate and then transform to Hm through interface nucleation. This is consistent with our X-ray scattering results, which demonstrate that NO 3 – outer-sphere and PO 4 3– inner-sphere complexes promote the formation of Gt and Hm, respectively. These results have implications for understanding the coupled interactions of oxyanions and iron oxy-hydroxides in Earth-surface environments.
54 ENVIRONMENTAL SCIENCES↗