Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Spatial Glycomics and Kidney Disease

Glycans are critical for the kidney's physiological and pathological cellular functions, and our ability to reveal their spatial distributions within tissues has helped us reveal how these carbohydrate moieties are involved in many of these processes. This review discusses the role of different types of glycans in kidney biology and disease, common approaches used for glycan imaging, and how glycan imaging has helped us better understand kidney pathology. Here, we mainly focus on emerging methods using mass spectrometry imaging (MSI) because this technology is untargeted and provides complete information on glycan composition compared to the other methods, such as lectin and metabolite labeling, which are targeted and often inform only on the specific part of a glycan structure. We especially focus on protein N-glycosylation, as this is one of the most common post-translational modifications, and these moieties play a vital role in renal structure and function. The recent advancements in MSI of N-glycans we reviewed have provided new insights into the pathophysiology of the kidney and paved the way for clinical application.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Bragg Spot Finder (BSF): a new machine-learning-aided approach to deal with spot finding for rapidly filtering diffraction pattern images

Macromolecular crystallography contributes significantly to understanding diseases and, more importantly, how to treat them by providing atomic resolution 3D structures of proteins. This is achieved by collecting X-ray diffraction images of protein crystals from important biological pathways. Spotfinders are used to detect the presence of crystals with usable data, and the spots from such crystals are the primary data used to solve the relevant structures. Having fast and accurate spot finding is essential, but recent advances in synchrotron beamlines used to generate X-ray diffraction images have brought us to the limits of what the best existing spotfinders can do. This bottleneck must be removed so spotfinder software can keep pace with the X-ray beamline hardware improvements and be able to see the weak or diffuse spots required to solve the most challenging problems encountered when working with diffraction images. In this paper, we first present Bragg Spot Detection (BSD), a large benchmark Bragg spot image dataset that contains 304 images with more than 66 000 spots. We then discuss the open source extensible U-Net-based spotfinder Bragg Spot Finder (BSF), with image pre-processing, a U-Net segmentation backbone, and post-processing that includes artifact removal and watershed segmentation. Finally, we perform experiments on the BSD benchmark and obtain results that are (in terms of accuracy) comparable to or better than those obtained with two popular spotfinder software packages ( Dozor and DIALS ), demonstrating that this is an appropriate framework to support future extensions and improvements.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Phase-contrast 3D tomography of HeLa cells grown in PLLA polymer electrospun scaffolds using synchrotron X-rays

Advanced imaging is useful for understanding the three-dimensional (3D) growth of cells. X-ray tomography serves as a powerful noninvasive, nondestructive technique that can fulfill these purposes by providing information about cell growth within 3D platforms. There are a limited number of studies taking advantage of synchrotron X-rays, which provides a large field of view and suitable resolution to image cells within specific biomaterials. In this study, X-ray synchrotron radiation microtomography at Diamond Light Source and advanced image processing were used to investigate cellular infiltration of HeLa cells within poly L-lactide (PLLA) scaffolds. This study demonstrates that synchrotron X-rays using phase contrast is a useful method to understand the 3D growth of cells in PLLA electrospun scaffolds. Two different fiber diameter (2 and 4 µm) scaffolds with different pore sizes, grown over 2, 5 and 8 days in vitro , were examined for infiltration and cell connectivity. After performing visualization by segmentation of the cells from the fibers, the results clearly show deeper cell growth and higher cellular interconnectivity in the 4 µm fiber diameter scaffold. Finally, this indicates the potential for using such 3D technology to study cell–scaffold interactions for future medical use.

3D culture↗
DOE OSTI2020

Understanding ICF hohlraums using NIF gated laser-entrance-hole images

The newly available ns-gated laser-entrance-hole (LEH) imager on the National Ignition Facility provides routine, non-perturbative measurements of the x-ray emission from laser-heated plasmas inside the hohlraum as viewed at 19° to the hohlraum axis through one of its LEHs. Multiple images are acquired for a series of times and filter-selected x-ray energy bands within a single shot. The images provide time dependent data on phenomena including the effective radius of the LEH, the length of the gold-plasma “bubble” evolving off the interior wall surface heated by the outer beams, the evolving radius of the x-ray heated hohlraum wall, and the radius of the ablation front of the fusion capsule. Here, these measurements are explained and illustrated with sample data. These techniques are then applied to understand hohlraum behavior as a function of gas fill. For hohlraums with helium gas fill densities of 0.15 to 0.30 mg/cm 3 , synthetic images computed from simulations agree well with experimental gated LEH images when an inhibited heat transport model [Jones et al., Phys. Plasmas 24, 056312 (2017)] is used. This model can be adjusted to reproduce the expansion rate of the laser-heated plasma bubble in such a way as to improve agreement with the images. At the higher 0.6 mg/cc gas fill, the experimental images show more pronounced 3D features, resulting in slightly less good agreement with the 2D simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

2D-to-3D image translation of complex nanoporous volumes using generative networks

Image-based characterization offers a powerful approach to studying geological porous media at the nanoscale and images are critical to understanding reactive transport mechanisms in reservoirs relevant to energy and sustainability technologies such as carbon sequestration, subsurface hydrogen storage, and natural gas recovery. Nanoimaging presents a trade off, however, between higher-contrast sample-destructive and lower-contrast sample-preserving imaging modalities. Furthermore, high-contrast imaging modalities often acquire only 2D images, while 3D volumes are needed to characterize fully a source rock sample. In this work, we present deep learning image translation models to predict high-contrast focused ion beam-scanning electron microscopy (FIB-SEM) image volumes from transmission X-ray microscopy (TXM) images when only 2D paired training data is available. We introduce a regularization method for improving 3D volume generation from 2D-to-2D deep learning image models and apply this approach to translate 3D TXM volumes to FIB-SEM fidelity. We then segment a predicted FIB-SEM volume into a flow simulation domain and calculate the sample apparent permeability using a lattice Boltzmann method (LBM) technique. Results show that our image translation approach produces simulation domains suitable for flow visualization and allows for accurate characterization of petrophysical properties from non-destructive imaging data.

58 GEOSCIENCES↗
DOE OSTI2023

Synchrotron-based X-ray fluorescence microscopy mapping the ionome of a toxic freshwater cyanobacterium

Harmful algal blooms (HABs) pose a major environmental concern across the globe. In abundance, cyanobacteria, or so-called green-blue algae can produce extremely dangerous cyanotoxins that harm humans and animals. This study focused on the mapping and distribution of intracellular macro-and micronutrients of the widespread freshwater cyanobacteria Microcystis aeruginosa (M. aeruginosa). Towards a better understanding of trace metal uptake and homeostasis throughout the cell cycle, we quantitatively mapped the spatial distribution of the elements P, K, Fe, Ca, Zn, Mn, and Cu across the ultrastructure of frozen-hydrated single cells using state-of-theart X-ray nanofluorescence imaging at the Advanced Photon Source (APS) at Argonne National Laboratory. Further, bulk cellular nutrient and trace metal content correlated well with the total intracellular elemental content in individual cells obtained by quantitative synchrotron X-ray fluorescence measurements. Multi-dimensional mappings showed P and K atoms colocalized as discrete semicircular hotspots that were analyzed with respect to their stoichiometry. Elevated Cu and Ca concentrations were detected along division plane of cells. P and K were found to have similar spatial elemental distribution with about 65% and 69% of the total cellular P and K, respectively, located at the hotspots. The P and K colocalization were refined further using nanotomography, showing a K envelope surrounding the P core. Inorganic P and organic P compounds were specified using solution-state 31 P nuclear magnetic resonance (NMR) spectroscopy from M. aeruginosa. Of the total extracted P determined by 31 P NMR spectroscopy, 47% were found to be nucleotides while only 11% were polyphosphates. Multimodal X-ray imaging provides a better understanding of intracellular biochemical processes in cyanobacteria, helping us monitor and combat an emerging environmental threat.

31P NMR spectroscopy↗
DOE OSTI2026

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Tractometry of the Human Connectome Project: resources and insights

The Human Connectome Project (HCP) has become a keystone dataset in human neuroscience, with a plethora of important applications in advancing brain imaging methods and an understanding of the human brain. We focused on tractometry of HCP diffusion-weighted MRI (dMRI) data. We used an open-source software library (pyAFQ; https://yeatmanlab.github.io/pyAFQ) to perform probabilistic tractography and delineate the major white matter pathways in the HCP subjects that have a complete dMRI acquisition (n = 1,041). We used diffusion kurtosis imaging (DKI) to model white matter microstructure in each voxel of the white matter, and extracted tract profiles of DKI-derived tissue properties along the length of the tracts. We explored the empirical properties of the data: first, we assessed the heritability of DKI tissue properties using the known genetic linkage of the large number of twin pairs sampled in HCP. Second, we tested the ability of tractometry to serve as the basis for predictive models of individual characteristics (e.g., age, crystallized/fluid intelligence, reading ability, etc.), compared to local connectome features. To facilitate the exploration of the dataset we created a new web-based visualization tool and use this tool to visualize the data in the HCP tractometry dataset. Finally, we used the HCP dataset as a test-bed for a new technological innovation: the TRX file-format for representation of dMRI-based streamlines. We released the processing outputs and tract profiles as a publicly available data resource through the AWS Open Data program's Open Neurodata repository. We found heritability as high as 0.9 for DKI-based metrics in some brain pathways. We also found that tractometry extracts as much useful information about individual differences as the local connectome method. We released a new web-based visualization tool for tractometry—“Tractoscope” (https://nrdg.github.io/tractoscope). We found that the TRX files require considerably less disk space-a crucial attribute for large datasets like HCP. In addition, TRX incorporates a specification for grouping streamlines, further simplifying tractometry analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Coarse-to-fine Task-driven Inpainting for Geoscience Images

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. As far as we know, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images, and they never consider the following geoscience task when developing inpainting methods. Here, this paper aims to repair the occluded regions for a better geoscience task performance and advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with the help of designed coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we propose a MaskMix based data augmentation method, which augments inpainting masks instead of augmenting original images, to exploit the limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method. The code is available at: https://github.com/HMS97/Task-driven-Inpainting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

High spatial resolution neutron imaging of lithium-ion batteries: Correlating microstructure and lithium transport

Thick electrodes for lithium-ion batteries can increase the overall energy density, but increasing the electrode thickness introduces charge transport limitations. These limitations may be mitigated through proper electrode structuring. Here, high spatial resolution neutron imaging was used to understand the correlation between microstructure and lithium transport in lithium-ion anodes. Batteries with distinct graphite anode microstructures were produced and studied with high spatial resolution in operando neutron radiography to observe the effects of structure on transport. High spatial resolution neutron computed tomography was performed following in operando neutron radiography. X-ray computed tomography and scanning electron microscopy were used to observe the finer scale anode structure to complement neutron imaging. Solvent-free anodes containing a tightly-packed layered structure confined lithium movement close to the separator. This structure limited capacity, but supported better rate capability. Conversely, a more open pore structure in the wet cast anodes yielded higher capacity with reduced rate capability. Together, these results show that lithium distributions can be controlled by the macroscopic structure of the electrodes, the microstructural pore network, and the microscale active areas that support electrochemical reactions. Furthermore, multimodal imaging applying the complementary strengths of neutron and X-ray methods is shown as a tool for advancing battery design.

25 ENERGY STORAGE↗
DOE OSTI2022

In Situ EXAFS-Based Nanothermometry of Heterodimer Nanocrystals under Induction Heating

The ability to heat nanocrystalline materials through magnetic induction has been used in the fields of catalysis, biomedical sciences, and polymer degradation. However, the working temperature to which the inductively coupled material rises is still poorly understood. Herein, we use extended X-ray absorption fine structure spectroscopy in conjunction with thermal imaging to improve the understanding of heating in inductively coupled systems. After extraction of the Debye–Waller factor from the spectroscopy, we obtain the temperature of inductively heated nanocrystals from the correlated Debye model. We combine carbon-supported iron oxide nanocrystals as induction heating agents with platinum nanocrystals as thermal probes. By testing these nanocrystal species as both unattached nanocrystals and heterodimers, we report that nanostructured systems show a significant temperature difference of up to 73.60 °C when compared to their local support environment. Furthermore, this result has implications for inductively heated catalysis, magnetic hyperthermia for targeted cell death, and polymer synthesis.

09 BIOMASS FUELS↗
DOE OSTI2022

PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study

Understanding a plant's root system architecture (RSA) is crucial for a variety of plant science problem domains including sustainability and climate adaptation. Minirhizotron (MR) technology is a widely-used approach for phenotyping RSA non-destructively by capturing root imagery over time. Precisely segmenting roots from the soil in MR imagery is a critical step in studying RSA features. In this paper, we introduce a large-scale dataset of plant root images captured by MR technology. In total, there are over 72K RGB root images across six different species including cotton, papaya, peanut, sesame, sunflower, and switchgrass in the dataset. The images span a variety of conditions including varied root age, root structures, soil types, and depths under the soil surface. All of the images have been annotated with weak image-level labels indicating whether each image contains roots or not. The image-level labels can be used to support weakly supervised learning in plant root segmentation tasks. In addition, 63K images have been manually annotated to generate pixel-level binary masks indicating whether each pixel corresponds to root or not. These pixel-level binary masks can be used as ground truth for supervised learning in semantic segmentation tasks. By introducing this dataset, we aim to facilitate the automatic segmentation of roots and the research of RSA with deep learning and other image analysis algorithms.

Xu, Weihuang↗
DOE OSTI2021

Identification and correction of temporal and spatial distortions in scanning transmission electron microscopy

Scanning transmission electron microscopy (STEM) has become the technique of choice for quantitative characterization of atomic structure of materials, where the minute displacements of atomic columns from high-symmetry positions can be used to map strain, polarization, octahedra tilts, and other physical and chemical order parameter fields. The latter can be used as inputs into mesoscopic and atomistic models, providing insight into the correlative relationships and generative physics of materials on the atomic level. However, these quantitative applications of STEM necessitate understanding the microscope induced image distortions and developing the pathways to compensate them both as part of a rapid calibration procedure for in situ imaging, and the post-experimental data analysis stage. Here, we explore the spatiotemporal structure of the microscopic distortions in STEM using multivariate analysis of the atomic trajectories in the image stacks. Based on the behavior of principal component analysis (PCA), we develop the Gaussian process (GP)-based regression method for quantification of the distortion function. The limitations of such an approach and possible strategies for implementation as a part of in-line data acquisition in STEM are discussed. Here, the analysis workflow is summarized in a Jupyter notebook that can be used to retrace the analysis and analyze the reader's data.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Real-Time Diagnostics of 2D Crystal Transformations by Pulsed Laser Deposition: Controlled Synthesis of Janus WSSe Monolayers and Alloys

Energetic processing methods such as hyperthermal implantation hold special promise to achieve the precision synthesis of metastable two-dimensional (2D) materials such as Janus monolayers; however, they require precise control. Here, we report a feedback approach to reveal and control the transformation pathways in materials synthesis by pulsed laser deposition (PLD) and apply it to investigate the transformation kinetics of monolayer WS 2 crystals into Janus WSSe and WSe 2 by implantation of Se clusters with different maximum kinetic energies (<42 eV/Se-atom) generated by laser ablation of a Se target. Real-time Raman spectroscopy and photoluminescence are used to assess the structure, composition, and optoelectronic quality of the monolayer crystal as it is implanted with well-controlled fluxes of selenium for different kinetic energies that are regulated with in situ ICCD imaging, ion probe, and spectroscopy diagnostics. First-principles calculations, XPS, and atomic-resolution HAADF STEM imaging are used to understand the intermediate alloy compositions and their vibrational modes to identify transformation pathways. The real-time kinetics measurements reveal highly selective top-layer conversion as WS 2 transforms through WS 2(1–x) Se 2x alloys to WSe 2 and provide the means to adjust processing conditions to achieve fractional and complete Janus WSSe monolayers as metastable transition states. The general approach demonstrates a real-time feedback method to achieve Janus layers or other metastable alloys of the desired composition, and a general means to adjust the structure and quality of materials grown by PLD, addressing priority research directions for precision synthesis with real-time adaptive control.

2D materials↗
DOE OSTI2020

Chapter 6: Luminescence and Thermal Imaging of Thin-Film Photovoltaic Materials, Devices, and Modules

In this chapter, we describe luminescence and thermal imaging in the context of thin-film PV devices. First, we discuss both traditional and developing experimental designs, including dark LIT (DLIT), illuminated LIT, PL using different illumination configurations, traditional EL performed under forward -bias current injection, and contactless EL induced with sub -cell illumination patterns. Next, we provide some brief theoretical background to highlight relationships between fundamental materials properties and the resulting luminescence and thermal images. Finally, we give examples of thin-film PV PL, EL, and LIT images to demonstrate the utility of these imaging methods ranging from understanding the microstructure of active layers to managing the quality and reliability of full PV modules.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

Diagnostic development and needs for laser driven MeV x-ray radiography

Laser-driven MeV x-ray radiography of dynamic, dense objects demands a small, high flux source of energetic x-rays to generate an image with sufficient quality. Understanding the multi-MeV x-ray spectrum underscores the ability to extrapolate from the current laser sources to new future lasers that might deploy this radiography modality. Here, in this study, we present a small study of the existing x-ray diagnostics and techniques. We also present work from National Ignition Facility-Advanced Radiographic Capability, where we deploy three diagnostics to measure the x-ray spectrum up to 30 MeV. Finally, we also discuss the needs and developments of two new diagnostics: a single crystal scintillator spectrometer and a fast decay activation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

LATTE: open-source, high-performance traveltime computation, tomography and source location in acoustic and elastic media

Traveltime-based tomography and source location are fundamental approaches for imaging subsurface structures and understanding the spatiotemporal distribution of seismicity from local to global scales. We present an open-source, high-performance framework integrating eikonal equation solvers and adjoint-state theory for traveltime computation, velocity tomography, source location and joint tomography-location in 2-D/3-D acoustic and elastic media. We introduce novel regularization schemes based on total generalized p-variation, structural similarity and multitask machine learning to enhance the fidelity and interpretability of inverted models and source locations. Key features of our implementation also include the ability to leverage both absolute-difference and double-difference traveltime misfits for high-fidelity velocity tomography and source parameter estimation; support for traveltime computation and inversion in diverse 2-D/3-D scenarios with arbitrary source and receiver distributions; and a perturbation-based optimal step-size estimation method to reduce computational costs. In addition, our implementation employs shared-memory and distributed-memory parallelization to provide an efficient solution for traveltime computation, tomography, and source location. In conclusion, we validate the efficacy and accuracy of our approach through multiple synthetic data examples.

58 GEOSCIENCES↗
DOE OSTI2020

Sampling Subjective Polygons for Patch-Based Deep Learning Land-Use Classification in Satellite Images

Model generalization remains a key challenge in the analysis of large amounts of heterogeneous satellite image data. One major limiting factor in developing generalizable models, in the context of supervised learning, is the lack of high quality training datasets. A model's capacity to perform well on new data is often inhibited by imbalance and bias in the data that was used for training. This is especially a problem when using convolutional neural networks to classify urban land-use in satellite images. Notable dataset imbalance issues in this application include land-use type imbalance and image scene imbalance. To begin understanding these dataset imbalance problems in more detail, we develop and test a number of sampling methods for generating training image datasets from subjective training polygons for urban land-use classification. We investigate sampling at different point densities as a means to reduce content repetition and therefore content imbalance and bias in the training image dataset.

Arndt, Jacob↗