Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Development of Multimodal Few-Shot Analytics for Electron Micrographs

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Attempts at creating a multimodal approach can provide further improvements to current models and help extract more salient features from data. In this vein, raw spectrum data was taken to provide an additional modality to our current pyCHIP classifier. Modifications in segmentation also show potential in improving the accuracy of the pyCHIP classifier. Classifier output was analyzed using network graphs and unsupervised clustering algorithms such as spectral clustering to detect better segmentation methods than the current “chipping” approach. We suggest that the chip selection process can be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗

Segmentation Model Distillation [Poster]

The process of training object detection (OD) or image segmentation model requires both a substantial amount of data and technical knowledge, which often creates challenges in applying these types of models to their full potential. In order to streamline the process of developing these models, we propose a new pipeline where a foundation model assists in the dataset generation. Then this resulting dataset is used to fine-tune a fast light-weight model to perform the custom segmentation or OD. This resulting model is also fit for real-time image segmentation, such as in a video stream.

97 MATHEMATICS AND COMPUTING↗

Correlating energy density induced residual stress, porosity, and mechanical property variations in directed energy deposition using neutron diffraction and imaging techniques

In a directed energy deposition (DED) process, the energy density deposited into the materials drives the structure and properties. The energy density is influenced by several printing parameters, such as laser power, hatch spacing, scanning speed, etc. In this study, 316L stainless steels samples were fabricated with varying hatch spacing aiming to induce variations in sample microstructure and properties. A combination of techniques including engineering neutron diffraction, neutron computed tomography, and tensile testing, were employed to correlate the structure and macroscopic properties. Porosity was predominantly observed at the bottom of the deposited materials and was effectively reduced by decreased hatch spacing. Correlatively, compressive residual stress was observed at the bottom of the specimens, while internal stress is largely determined by the hatch spacing. The residual stress in general decreases as the hatch spacing decreases. The maximum ultimate tensile strength (UTS) was found to increase from 517.4 to 528.6 MPa with a strain increased from 0.847 to 0.897 as the hatch spacing decreased from 0.45 to 0.42 mm. However, further increase in energy density by reducing the hatch spacing resulted in a significant decrease in UTS (as low as 452 MPa). This work provides new insights from bulk non-destructive techniques into correlating energy density induced residual stress, porosity, and mechanical property variations in directed energy deposition.

316L stainless steel↗

Biofouling of filtration membranes in wastewater reuse: In situ visualization with confocal laser scanning microscopy

The filtration membranes utilized in advanced treatment of municipal wastewater are prone to biological fouling. Permeability loss and water recovery limitations due to fouling necessitate additional pretreatment and membrane cleaning, which raise the cost of water reuse. Better fouling mitigation calls for a deeper understanding of biofilm behavior on water reuse membranes. This study uses confocal microscopy to monitor biofouling under realistic conditions. To simulate water reuse, a miniature flow cell with microfiltration and ultrafiltration membranes was operated under typical filtration conditions using secondary effluent from California's East Bay Municipal Utility District. The growing biofilms were stained for extracellular polymeric substances and live and dead cells, and they were monitored in situ under filtration conditions with a confocal laser scanning microscope to produce 2-D and 3-D images. In situ image series revealed biofilm growth and removal processes including internal and external fouling, extracellular polymeric substance production, wrinkling, delamination, and film re-deposition. Additionally, changes in biofilm morphology between in situ and ex situ images highlighted limitations of ex situ imaging. Here, these results provide insight into the physical and biological mechanisms of biofouling in hopes of informing the development of improved techniques for biofouling mitigation.

ultrafiltration↗

Two-phase accurate multiplexed structured image capture (2pAc-MUSIC)

Multiplexed Structural Image Capture (MUSIC) technique uses modulation of light from a scene prior to imaging to encode the temporal evolution of target into spatial frequency shifts, with each shift corresponding to a unique time and resulting in individual distinct snapshots. Computational-processing of the multiplexed single-shot image can recover the nanosecond-resolution scene evolution. One of the limitations is the loss of spatial resolution of the recovered image due to limitations of the low-pass spatial frequency filtering depth. Here we demonstrated that two images with complementary spatial phases can be used to enhance the spatial resolutions. For this application, 2 Phase Accurate (2pAc)-MUSIC is implemented that a scene is encoded with two complementary phases. The increased spatial information captured reduces the lower frequency noise in the Fourier domain found in single-phase MUSIC. A recovery algorithm combines the 180-degree spatial frequency shifted images into a single scene and applies a spatial filter in the Fourier domain that has a larger depth than previously possible to achieve a scene with increased spatial resolution. The 2pAc-MUSIC can effectively enhance the spatial resolution by removing the overlapping zero-order spatial frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Hyperstoichiometric Uranium Dioxides: Rapid Synthesis and Irradiation-Induced Structural Changes

Uranium dioxide (UO 2 ), the primary fuel for commercial nuclear reactors, incorporates excess oxygen forming a series of hyperstoichiometric oxides. Thin layers of these oxides, such as UO 2.12 , form readily on the fuel surface and influence its properties, performance, and potentially geologic disposal. This work reports a rapid and straightforward combustion process in uranyl nitrate–glycine–water solutions to prepare UO 2.12 nanomaterials and thin films. We also report on the investigation of the structural changes induced in the material by irradiation. Despite the simple processing aspects, the combustion synthesis of UO 2.12 has a sophisticated chemical mechanism involving several exothermic steps. Raman spectroscopy and single-crystal X-ray diffraction (XRD) measurements reveal the formation of a complex compound containing the uranyl moiety, glycine, H 2 O, and NO 3 – groups in reactive solutions and dried combustion precursors. Combustion diagnostic methods, gas-phase mass spectroscopy, differential scanning calorimetry (DSC), and extracted activation energies from DSC measurements show that the rate-limiting step of the process is the reaction of ammonia with nitrogen oxides formed from the decomposition of glycine and uranyl nitrate, respectively. However, the exothermic decomposition of the complex compound determines the maximum temperature of the process. In situ transmission electron microscopy (TEM) imaging and electron diffraction measurements show that the decomposition of the complex compound directly produces UO 2 . The incorporation of oxygen at the cooling stage of the combustion process is responsible for the formation of UO 2.12 . Spin coating of the solutions and brief annealing at 670 K allow the deposition of uniform films of UO 2.12 with thicknesses up to 300 nm on an aluminum substrate. Irradiation of films with Ar 2+ ions (1.7 MeV energy, a fluence of up to 1 × 10 17 ions/cm 2 ) shows unusual defect-simulated grain growth and enhanced chemical mixing of UO 2.12 with the substrate due to the high uranium ion diffusion in films. As a result, the method described in this work allows the preparation of actinide oxide targets for fundamental nuclear science research and studies associated with stockpile stewardship.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Spatially resolved absolute quantitation in thin tissue by mass spectrometry

Mass spectrometry (MS) has become the de facto tool for routine quantitative analysis of biomolecules. MS is increasingly being used to reveal the spatial distribution of proteins, metabolites, and pharmaceuticals in tissue and interest in this area has led to a number of novel spatially resolved MS technologies. Most spatially resolved MS measurements are qualitative in nature due to a myriad of potential biases, such as sample heterogeneity, sampling artifacts, and ionization effects. As applications of spatially resolved MS in the pharmacological and clinical fields increase, demand has become high for quantitative MS imaging and profiling data. As a result, several varied technologies now exist that provide differing levels of spatial and quantitative information. Furthermore, this review provides an overview of MS profiling and imaging technologies that have demonstrated quantitative analysis from tissue. Focus is given on the fundamental processes affecting quantitative analysis in an array of MS imaging and profiling technologies and methods to address these biases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Squeezed Light Stimulated Raman Scattering (SRS) Microscopy for Bioenergy Applications

Stimulated Raman scattering (SRS) microscopy using picosecond near-IR pulses have provided a great penetration depth with reduced fluorescence interference when imaging biological samples for bioenergy applications. These tools have provided insight into 1) tracking the degradation of chemical composites in biomass feedstocks to investigate the recalcitrant factors during the deconstruction processes, 2) monitoring the production of chemicals in photosynthetic plants and wood-digesting microorganisms, and 3) probing plant-bacteria interactions. However, the above processes are usually slow and require continuous imaging for an extended period. This is challenging for classic SRS because the laser power needed to achieve enough sensitivity causes photodamage in the samples during such long experiments. Quantum-squeezed light with reduced noise in the intensity quadrature can improve the sensitivity of classic SRS microscopy beyond the shot noise limit. The successful squeezing of one of the picosecond pulses in the above SRS will improve sensitivity and reduce photodamage, greatly expanding the range of studies available to SRS microscopy.

BIOMASS FUELS↗

Improving 3D reconstruction quality for root phenotyping: assessing the impact of camera calibration and imaging parameters

Arate 3D reconstruction is essential for high-throughput plant phenotyping, particularly for studying complex structures such as root systems. While photogrammetry and Structure from Motion (SfM) techniques have become widely used for 3D root imaging, the camera settings used are often underreported in studies, and the impact of camera calibration on model accuracyccu remains largely underexplored in plant science. In this study, we systematically evaluate the effects of focus, aperture, exposure time, and gain settings on the quality of 3D root models made with a multi-camera scanning system. We show through a series of experiments that calibration significantly improves model quality, with focus misalignment and shallow depth of field (DoF) being the most important factors affecting reconstruction accuracy. Our results further show that proper calibration has a greater effect on reducing noise than filtering it during post-processing, emphasizing the importance of optimizing image acquisition rather than relying solely on computational corrections. This work improves the repeatability and accuracy of 3D root imaging for phenotyping pipelines by giving useful calibration guidelines. This leads to better trait quantification for use in crop research and plant breeding in downstream analysis.

3D reconstruction↗

FIRM image analysis: A machine learning workflow for quantifying extracellular matrix components from electron microscopy images

The extracellular matrix (ECM) is a complex network of biomolecules that plays an integral role in the structure, processes, and signaling mechanisms of cells and tissues. Identifying and quantifying changes in these matrix components provides insight into the mechanisms behind specific tissue remodeling processes; however, quantifying these changes is challenging due to difficult imaging conditions, complexity of the ECM, and the subtlety of these changes. Current imaging techniques allow us to visualize these critical remodeling events and developments in image analysis have employed a combination of analysis software and machine learning techniques to improve the efficiency and accuracy with which features are measured. Although image analysis has seen much improvement in recent years, there has been no technique developed to address ambiguity in feature edges in electron microscopy images. Presented here is a new machine learning-based workflow for the analysis of microscopy images named FIRM (Feature Identification from Raw Microscopy) that uses a random forest classifier to identify ECM features of interest and generate binary segmentation masks for quantification with ImageJ-FIJI. FIRM performed with an F1 score of 0.794 and greater than 80% accuracy for number and size of features detected. FIRM had similar deviation from the ground truth in the number of identified fibrils, fibril size, and size distributions when compared to human analyses. The results suggest that FIRM performs as well as manual analysis and requires a fraction of the time. This analysis technique is more efficient, eliminates user bias, and can be easily optimized to identify a variety of features, making it useful for any discipline requiring image analysis.

Science & Technology - Other Topics↗

Correlation of Early-Stage Growth Process Conditions with Dislocation Evolution in MOCVD-Based GaP/Si Heteroepitaxy

To identify the complex relationships between early-stage growth processes and the resultant defect microstructure in GaP/Si heteroepitaxy, a holistic study of several key metal-organic chemical vapor deposition (MOCVD) parameters was conducted, focusing on Si surface preparation and GaP atomic layer epitaxy (ALE) based nucleation processes. Here, crystalline defects related to the lattice mismatch and/or interfacial heterovalency, namely misfit dislocations (MD), threading dislocations (TD), and stacking fault pyramids (SFP), were quantitatively characterized via electron channeling contrast imaging (ECCI) and correlated against the different process variations. Choice of Si surface preparation method between the two examined (dilute SiH4 annealing versus Si2H6 based homoepitaxy) had little impact on resultant GaP film morphology and defect content, whereas differing GaP ALE nucleation conditions produced much more substantial changes. In particular, the initial precursor species (tert-butylphosphine versus triethygallium) and ALE cycle purge times both yielded significant influence over threading dislocation densities (TDD) in thin (100 nm), post-critical thickness GaP/Si films, with TDD spanning two orders of magnitude, from 6.7×10 7 cm -2 to 7.1×10 5 cm -2 , depending on the specific process conditions employed. SFP densities were also found to follow a similar trend, ranging from 2.0×10 7 cm -2 to 1.8×10 5 cm -2 , but with no apparent causal relationship between SFP density and TDD. To help explain the dramatic differences observed, detailed, large-area MD network characterization was used to provide statistically-relevant quantitative analyses of the critical dislocation dynamics (introduction rates and glide velocities) associated with the different process variants. These extracted values are then correlated against the ALE process variants to provide insight into the potential mechanistic roles of the different growth processes.

36 MATERIALS SCIENCE↗

Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)

Biological processes such as processive enzyme turnover and intracellular cargo tracking involve the dynamic motion of a small "article" along a curvilinear biopolymer track. To understand these processes that occur across multiple length and time scales, one must acquire both the trajectory of the particle and the position of the track along which it moves, possibly by combining high-resolution single-particle tracking with conventional microscopy. Yet, usually there is a significant resolution mismatch between these modalities: while the tracked particle is localized with a precision of 10 nm, the image of the surroundings is limited by optical difraction, with 200 nm lateral and 500 nm axial resolutions. Compared to the particle's trajectory, the surrounding curvilinear structure appears as a blurred and noisy image. This disparity in the spatial resolutions of the particle trajectory and the surrounding curvilinear structure image makes data reconstruction, as well as interpretation, particularly challenging. Analysis is further complicated when the curvilinear structures are oriented arbitrarily in 3D space. Here, we present a prior-apprised unsupervised learning (PAUL) approach to extract information from 3D images where the underlying features resemble a curved line such as a filament or microtubule. This three-stage framework starts with a Hessian-based feature enhancement, which is followed by feature registration, where local line segments are detected on repetitively sampled subimage tiles. In the final stage, statistical learning, segments are clustered based on their geometric relationships. Principal curves are then approximated from each segment group via statistical tools including principal component analysis, bootstrap and kernel transformation. This procedure is characterized on simulated images, where sub-voxel medium deviations from true curves have been achieved. The 3D PAUL approach has also been implemented for successful line localization in experimental 3D images of gold nanowires obtained using a multifocal microscope. Lastly, this work not only bridges the resolution gap between two microscopy modalities, but also allows us to conduct 3D super line-localization imaging experiments, without using super-resolution techniques.

42 ENGINEERING↗

Parameters, Properties, and Process: Conditional Neural Generation of Realistic SEM Imagery Toward ML-Assisted Advanced Manufacturing

Abstract The research and development cycle of advanced manufacturing processes traditionally requires a large investment of time and resources. Experiments can be expensive and are hence conducted on relatively small scales. This poses problems for typically data-hungry machine learning tools which could otherwise expedite the development cycle. We build upon prior work by applying conditional generative adversarial networks (GANs) to scanning electron microscope (SEM) imagery from an emerging advanced manufacturing process, shear-assisted processing and extrusion (ShAPE). We generate realistic images conditioned on temper and either experimental parameters or material properties. In doing so, we are able to integrate machine learning into the development cycle, by allowing a user to immediately visualize the microstructure that would arise from particular process parameters or properties. This work forms a technical backbone for a fundamentally new approach for understanding manufacturing processes in the absence of first-principle models. By characterizing microstructure from a topological perspective, we are able to evaluate our models’ ability to capture the breadth and diversity of experimental scanning electron microscope (SEM) samples. Our method is successful in capturing the visual and general microstructural features arising from the considered process, with analysis highlighting directions to further improve the topological realism of our synthetic imagery.

36 MATERIALS SCIENCE↗

Grain2mesh: A Python and cubit mesh generator from unprocessed mesoscale images

Predicting bulk behavior from microscale features constitutes a key objective in multiscale modeling research, often involving numerical models composed of finite elements that capture the diversity of constituent phases, shapes, and orientations within the material. The Grain2mesh toolbox allows the user to input unprocessed mesoscopic images for automatic segmentation, pre-processing, quality control, and numerical mesh generation. The numerical mesh generation incorporates Cubit routines to generate robust multi-phase mesh structure for use in computational mechanics solvers. The python classes developed contain detailed documentation and examples to support standard usage and case-specific alternative options.

58 GEOSCIENCES↗

Time-resolved site-selective imaging of predissociation and charge transfer dynamics: the CH 3 I B-band

The predissociation dynamics of the 6s (B 2 E) Rydberg state of gas-phase CH 3 I were investigated by time-resolved Coulomb-explosion imaging using extreme ultraviolet (XUV) free-electron laser pulses. Inner-shell ionization at the iodine 4d edge was utilized to provide a site-specific probe of the ensuing dynamics. The combination of a velocity-map imaging (VMI) spectrometer coupled with the pixel imaging mass spectrometry (PImMS) camera permitted three-dimensional ionic fragment momenta to be recorded simultaneously for a wide range of iodine charge states. In accord with previous studies, initial excitation at 201.2 nm results in internal conversion and subsequent dissociation on the lower-lying A-state surface on a picosecond time scale. Examination of the time-dependent yield of low kinetic energy iodine fragments yields mechanistic insights into the predissociation and subsequent charge transfer following multiple ionization of the iodine products. The effect of charge transfer was observed through differing delay-dependencies of the various iodine charge states, from which critical internuclear distances for charge transfer could be inferred and compared to a classical over-the-barrier model. Time-dependent photofragment angular anisotropy parameters were extracted from the central slice of the Newton sphere, without Abel inversion, and highlight the effect of rotation of the parent molecule before dissociation, as observed in previous works. Our results demonstrate the ability to perform three-dimensional ion imaging at high event rates and showcase the potential benefits of this approach, particularly in relation to further time-resolved studies at free-electron laser facilities.

74 ATOMIC AND MOLECULAR PHYSICS↗