Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Plasmonics-Enhanced Optical Imaging Systems for Bioenergy Research

This final report summarizes the key accomplishments of the project entitled “Plasmonics-Enhanced Optical Imaging Systems for Bioenergy Research”. The goal of this project is aimed at developing innovative and improved imaging instrumentation for visualization and quantitative characterization of biomarkers related to molecular processes and cellular function in living plants. This project focused on three specific aims: 1) Development of Advanced Multimodal Optical Sensing And Imaging Combinatory (MOSAIC) System for SERS biosensing and bioimaging. 2) Evaluation of MOSAIC technologies for sensing and imaging gene expression in plant systems using plasmonic nanoprobes. 3) Application of MOSAIC techniques to bioenergy research.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Serendipita indica Drives Sulfur-Related Microbiota in Enhancing Growth of Hyperaccumulator Sedum alfredii and Facilitating Soil Cadmium Remediation

Endophytic fungus Serendipita indica can bolster plant growth and confer protection against various biotic and abiotic stresses. However, S. indica -reshaped rhizosphere microecology interactions and root-soil interface processes in situ at the submicrometer scale remain poorly understood. Here, we combined amplicon sequencing and high-resolution nano X-ray fluorescence (nano-XRF) imaging of the root-soil interface to reveal cadmium (Cd) rhizosphere processes. S. indica can successfully colonize the roots of Sedum alfredii Hance, which induces a remarkable increase in shoot biomass by 211.32% and Cd accumulation by 235.72%. Nano-XRF images showed that S. indica colonization altered the Cd distribution in the rhizosphere and facilitated the proximity of more Cd and sulfur (S) to enter the roots and transport to the shoot. Furthermore, the rhizosphere-enriched microbiota demonstrated a more stable network structure after the S. indica inoculation. Keystone species were strongly associated with growth promotion and Cd absorption. For example, Comamonadaceae are closely related to the organic acid cycle and S bioavailability, which could facilitate Cd and S accumulation in plants. Meanwhile, Sphingomonadaceae could release auxin and boost plant biomass. In summary, we construct a mutualism system for beneficial fungi and hyperaccumulation plants, which facilitates high-efficient remediation of Cd-contaminated soils by restructuring the rhizosphere microbiota.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

ThermoPore: Predicting part porosity based on thermal images using deep learning

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R 2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Deep learning↗
DOE OSTI2020

Transport Simulations on Scanning Transmission Electron Microscope Images of Nanoporous Shale

Digital rock physics is an often-mentioned approach to better understand and model transport processes occurring in tight nanoporous media including the organic and inorganic matrix of shale. Workflows integrating nanometer-scale image data and pore-scale simulations are relatively undeveloped, however. In this paper, a workflow is demonstrated progressing from sample acquisition and preparation, to image acquisition by Scanning Transmission Electron Microscopy (STEM) tomography, to volumetric reconstruction to pore-space discretization to numerical simulation of pore-scale transport. Key aspects of the workflow include (i) STEM tomography in high angle annular dark field (HAADF) mode to image three-dimensional pore networks in µm-sized samples with nanometer resolution and (ii) lattice Boltzmann method (LBM) simulations to describe gas flow in slip, transitional, and Knudsen diffusion regimes. It is shown that STEM tomography with nanoscale resolution yields excellent representation of the size and connectivity of organic nanopore networks. In turn, pore-scale simulation on such networks contributes to understanding of transport and storage properties of nanoporous shale. Interestingly, flow occurs primarily along pore networks with pore dimensions on the order of tens of nanometers. Smaller pores do not form percolating pathways in the sample volume imaged. Apparent gas permeability in the range of 10−19 to 10−16 m2 is computed.

42 ENGINEERING↗
DOE OSTI2022

AXEAP : a software package for X-ray emission data analysis using unsupervised machine learning

The Argonne X-ray Emission Analysis Package ( AXEAP ) has been developed to calibrate and process X-ray emission spectroscopy (XES) data collected with a two-dimensional (2D) position-sensitive detector. AXEAP is designed to convert a 2D XES image into an XES spectrum in real time using both calculations and unsupervised machine learning. AXEAP is capable of making this transformation at a rate similar to data collection, allowing real-time comparisons during data collection, reducing the amount of data stored from gigabyte-sized image files to kilobyte-sized text files. With a user-friendly interface, AXEAP includes data processing for non-resonant and resonant XES images from multiple edges and elements. AXEAP is written in MATLAB and can run on common operating systems, including Linux, Windows, and MacOS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine Learning-Enabled Image Classification for Automated Electron Microscopy

Abstract Traditionally, materials discovery has been driven more by evidence and intuition than by systematic design. However, the advent of “big data” and an exponential increase in computational power have reshaped the landscape. Today, we use simulations, artificial intelligence (AI), and machine learning (ML) to predict materials characteristics, which dramatically accelerates the discovery of novel materials. For instance, combinatorial megalibraries, where millions of distinct nanoparticles are created on a single chip, have spurred the need for automated characterization tools. This paper presents an ML model specifically developed to perform real-time binary classification of grayscale high-angle annular dark-field images of nanoparticles sourced from these megalibraries. Given the high costs associated with downstream processing errors, a primary requirement for our model was to minimize false positives while maintaining efficacy on unseen images. We elaborate on the computational challenges and our solutions, including managing memory constraints, optimizing training time, and utilizing Neural Architecture Search tools. The final model outperformed our expectations, achieving over 95% precision and a weighted F-score of more than 90% on our test data set. This paper discusses the development, challenges, and successful outcomes of this significant advancement in the application of AI and ML to materials discovery.

Materials Science↗
DOE OSTI2020

In situ/operando synchrotron x-ray studies of metal additive manufacturing

Additive manufacturing (AM) comprises a group of transformative technologies that are likely to revolutionize manufacturing. In particular, laser-based metal AM techniques can not only fabricate parts with extreme complexity, but also provide innovative means for designing and processing new metallic systems. However, there are still several technical barriers that constrain metal AM. Overcoming these barriers requires a better understanding of the physics underlying the complex and dynamic laser–metal interaction at the heart of many AM processes. Furthermore, this article briefly describes the state of the art of in situ/operando synchrotron x-ray imaging and diffraction for studying metal AM, mostly the laser powder-bed fusion process. It highlights the immediate impact of operando synchrotron studies on the advancement of AM technologies, and presents future research challenges and opportunities.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Magnification Determination for AGHCF Metallographic Images

Metallographic images generated in the Alpha Gamma Hot Cell Facility (AGHCF) have been used for quantitative and qualitative characterization of irradiated metallic fuel pins. Individual high-magnification images (micrographs) contained in AGHCF file folders and experimental notebooks are in the form of polaroid photographs labeled with AGHCF identification number, magnification, and surface condition (as-polished or etched). Low magnification composite images (photomosaics) are also available for fuel cross sections, for radial strips from the fuel center to the cladding outer diameter, and for circumferential strips of the cladding and outer fuel region. The individual images do not have scale bars. Only a few of the composite images contain scale bars. The purpose of this work is to describe and apply methods for checking the magnification (50X to 500X) of individual images and for determining the magnification (~25X to ~100X) of composite images. The metallographic images used to verify and/or determine magnification were generated during the 1989 to 1993 timeframe for cross sections of U-10Zr/HT9 fuel rods irradiated in EBR-II and for cross sections of irradiated U-10Zr/HT9 fuel-rod samples following elevated-temperature tests conducted in the out-of-pile AGHCF Fuel Behavior Test Apparatus (FBTA). Procedures are documented in the AGHCF Operations Manual for preparation of metallographic samples, for calibration verification, and for constructing composites from individual images. Calibration verification of magnification was performed at least semiannually. One standard used for calibration verification was a glass slide with vertical lines indicating distances of 1 mm, 0.1 mm and 0.01mm. Guidance is provided in the current work for determining magnification from images of the standard. In addition to the periodic calibration verification, consistency checks are recommended to verify the magnification of images taken between the routine calibration verifications. For cladding samples with or without significant fuel-cladding chemical interaction (FCCI), images taken at different magnifications (e.g., 150X and 200X) of the unaffected cladding thickness can be compared. This process is independent of changes in cladding thickness due to swelling and creep. For images taken at only one magnification of cladding regions with no FCCI, the cladding thickness determined from the images may be compared to the nominal as-built cladding thickness (15.0 ± 0.5 mils for examples used in current work)). This procedure works best for cladding that has not experienced significant swelling and/or creep (e.g., ≤2% circumferential strain at the cladding outer surface). Composite images were constructed by pasting together higher magnification images and photographing the composite to generate a negative from which the hard-copy photograph was developed. The primary purpose of the composite images was to identify interesting areas of the fuel and cladding for imaging at higher magnification. However, procedures are recommended in the current work for determining composite magnifications to allow quantitative characterization of the fuel. Composites are not recommended for determining cladding thickness or FCCI depth because magnifications are too low (generally ≤110X) and image contrast is low. Fuel cross-section composites were created by pasting together 50X or 75X images. The nominal magnification for the photographed fuel cross-section composites is 25.4X. A more precise magnification can be determined by comparing the average cladding outer diameter measured from the composite to the average cladding outer diameter measured by profilometry. Radial-strip composites were constructed by pasting together high-magnification (150X or 250X) images. The nominal magnification of radial-strip composites photographs is about 100X. A more precise method for determining the magnification of radial strips is to compare the cladding thick

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Hyperspectral and Nanosecond Temporal Resolution Widefield Infrared Photothermal Heterodyne Imaging

Label-free, bond-selective imaging offers new opportunities for fundamental and applied studies in chemistry, biology, and materials science. Preventing its broader application to investigating spectrally congested specimens are issues related to low sensitivity as well as low spatial and temporal resolution. Here, we demonstrate a widefield, mid-infrared (MIR) photothermal imaging technique, called widefield Infrared Photothermal Heterodyne imaging (wIR-PHI), that massively parallelizes acquisition of MIR absorption data through use of a high-speed complementary metal-oxide-semiconductor camera. wIR-PHI possesses notable features that include: spatial resolution significantly below the MIR diffraction limit, hyperspectral imaging capabilities, high sensitivity, and ~100 ns temporal resolution. Here, the first two features are highlighted by hyperspectral imaging of proximally close poly(methyl methacrylate) (PMMA) and polystyrene (PS) nanoparticles where clear, bond-specific imaging of nanoparticles, separated by less than the MIR diffraction limit, is demonstrated. Sensitivity is highlighted by imaging individual PMMA and PS nanoparticles with radii between r = 97-556 nm. This leads to a current, peak absorption cross-section limit-of-detection of σ abs = 1.9× 10 –16 cm 2 . wIR-PHI's 100 ns temporal resolution is simultaneously demonstrated by observing the decay of photothermal contrast on individual nanoparticles on a ~200-6000 ns timescale. In whole, wIR-PHI’s dramatic increase in acquisition speed opens opportunities for future MIR kinetic imaging and spectroscopic studies of important chemical, biological, and material processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Advances in imaging of chemically reacting flows

Many important chemically reacting systems are inherently multi-dimensional with spatial and temporal variations in the thermochemical state, which can be strongly coupled to interactions with transport processes. Fundamental insights into these systems require multi-dimensional measurements of the thermochemical state as well as fluid dynamics quantities. Laser-based imaging diagnostics provide spatially and temporally resolved measurements that help address this need. The state of the art in imaging diagnostics is continually progressing with the goal of attaining simultaneous multi-parameter measurements that capture transient processes, particularly those that lead to stochastic events, such as localized extinction in turbulent combustion. Development efforts in imaging diagnostics benefit from advances in laser and detector technology. This article provides a perspective on the progression of increasing dimensionality of laser-based imaging diagnostics and highlights the evolution from single-point measurements to 1D and 2D multi-parameter imaging and 3D high-speed imaging. This evolution is demonstrated using highlights of laser-based imaging techniques in combustion science research as an exemplar of a complex multi-dimensional chemically reacting system with chemistry–transport coupling. Imaging diagnostics impact basic research in other chemically reacting systems as well, such as measurements of near-surface gases in heterogeneous catalysis. The expanding dimensionality of imaging diagnostics leads to larger and more complex datasets that require increasingly demanding approaches to data analysis and provide opportunities for increased collaboration between experimental and computational researchers in tackling these challenges.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

RU-net for automatic characterization of TRISO fuel cross sections

During irradiation, phenomena such as kernel swelling and buffer densification may impact the performance of tristructural isotropic (TRISO) particle fuel. Post-irradiation microscopy is often used to identify these irradiation-induced morphologic changes. However, each fuel compact generally contains thousands of TRISO particles. Manually performing the work to get statistical information on these phenomena is cumbersome and subjective. Here, to reduce the subjectivity inherent in that process and to accelerate data analysis, we used convolutional neural networks (CNNs) to automatically segment cross-sectional images of microscopic TRISO layers. CNNs are a class of machine-learning algorithms specifically designed for processing structured grid data. They have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we generated a large irradiated TRISO layer dataset with more than 2,000 microscopic images of cross-sectional TRISO particles and the corresponding annotated images. Based on these annotated images, we used different CNNs to automatically segment different TRISO layers. These CNNs include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net performs best in terms of Intersection over Union (IoU). Using CNN models, we can expedite the analysis of TRISO particle cross sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Computer-aided Veress needle guidance using endoscopic optical coherence tomography and convolutional neural networks

During laparoscopic surgery, the Veress needle is commonly used in pneumoperitoneum establishment. Precise placement of the Veress needle is still a challenge for the surgeon. In this study, a computer-aided endoscopic optical coherence tomography (OCT) system was developed to effectively and safely guide Veress needle insertion. This endoscopic system was tested by imaging subcutaneous fat, muscle, abdominal space, and the small intestine from swine samples to simulate the surgical process, including the situation with small intestine injury. Each tissue layer was visualized in OCT images with unique features and subsequently used to develop a system for automatic localization of the Veress needle tip by identifying tissue layers (or spaces) and estimating the needle-to-tissue distance. We used convolutional neural networks (CNNs) in automatic tissue classification and distance estimation. In conclusion, the average testing accuracy in tissue classification was 98.53 ± 0.39%, and the average testing relative error in distance estimation reached 4.42 ± 0.56% (36.09 ± 4.92 μm).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Evolution of global and local deformation in additively manufactured octet truss lattice structures

Additively manufactured lattice truss structures, often referred to as architected cellular materials, present significant advantages over conventional structures due to their unique characteristics such as high strength-to-weight ratios and surface area-to-volume ratios. These geometrically complex structures, however, come with concomitant challenges for qualification and inspection. In this study, compression testing interrupted with micro-computed tomography inspection was conducted to monitor the evolution of global and local deformation throughout the loading process of 304L stainless steel octet truss lattice structures. Both two- and three-dimensional image analysis techniques were leveraged to characterize geometric heterogeneities resulting from the laser powder bed fusion manufacturing process as well as track the structure throughout deformation. Variations from model-predicted behavior resulting from these heterogeneities are considered relative to the predicted and actual responses of the structures during compression to better understand, model, and predict the octet truss lattice structure compression response.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Visualizing the strong field–induced molecular breakup of C 60 via x-ray diffraction

Laser-driven dynamics in polyatomic molecules poses a complex many-body problem. Understanding intense light-matter interaction is crucial for steering intramolecular quantum dynamical processes. Here, we record time-resolved x-ray diffraction images of C 60 molecules during and after their interaction with intense near-infrared fields, giving direct access to structural changes of the molecules and their fragmentation in real time. Tuning the intensity of the excitation pulses, we uncover a transition from a weak-field regime of excited but stable molecules to a high-field regime dominated by Coulomb explosion. In the transition region, the molecules expand by up to 50% of their initial size within just 140 fs, with major fragmentation only setting in afterward. This work demonstrates that x-ray diffractive imaging is capable of retrieving time-resolved structural information of large molecules reshaped by intense laser fields. Laser-driven fragmentation is a first step toward observing molecular processes modified by laser fields of increasing intensity.

Schnorr, Kirsten [Paul Scherrer Inst. (PSI), Villi↗
DOE OSTI2022

In-situ imaging of nucleation and growth of superlattices from nanoscale colloidal nanoparticles

Nanoparticle-based superlattices have attracted extensive research efforts due to their versatile composition and packing-dependent optical, magnetic, electronic, catalytic, mechanical properties. Yet the experimental understanding of the thermodynamics and pathways of the crystallization processes for these systems, which govern their ultimate morphology, size, and packing structure, has for long remained underexplored. Here, this minireview highlights recent integration of liquid-phase transmission electron microscopy, which allows for real-space, real-time direct imaging of the crystallization processes at the single-particle level, with simulation and the conceptual framework established by pioneers such as Dr. A. A. Chernov. Different aspects of superlattice formation were revealed by direct imaging for the first time, such as the existence of prenucleation precursor in nonclassical crystallization, surface energy-dependent growth, and coalescence, allowing for the charting of phase coordinates and thermodynamic quantities at the nanoscale. We discuss the similarities and differences of crystal growth behaviors in atomic and nanoparticle systems, as well as engineering opportunities to fashion, shape, and achieve quality control in superlattice formation from nanoparticles, for next-generation optical and mechanical metamaterials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Operando Interaction and Transformation of Metastable Defects in Layered Oxides for Na‐Ion Batteries

Non-equilibrium defects often dictate the macroscopic properties of materials. They largely define the reversibility and kinetics of processes in intercalation hosts in rechargeable batteries. Recently, imaging methods have demonstrated that transient dislocations briefly appear in intercalation hosts during ion diffusion. Despite new discoveries, the understanding of impact, formation and self-healing mechanisms of transient defects, including and beyond dislocations, is lacking. Here, operando X-ray Bragg Coherent Diffractive Imaging (BCDI) and diffraction peak analysis capture the stages of formation of a unique metastable domain boundary, defect self-healing, and resolve the local impact of defects on ionic diffusion in Na x Ni 1-y MnyO 2 intercalation hosts in a charging sodium-ion battery. Results, applicable to a wide range of layered intercalation materials due to the shared nature of framework layers, elucidate new dynamics of transient defects and their connection to macroscopic properties, and suggest how to control the nanostructure dynamics.

36 MATERIALS SCIENCE↗