SEARCH · Engineering Papers

Results for “3D image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Multitiered computational methodology for extracting three-dimensional rotational diffusion coefficients from x-ray photon correlation spectroscopy data without structural information

X-ray photon correlation spectroscopy (XPCS) is a powerful technique for analyzing particle systems by investigating their dynamics in suspensions across a broad range of temporal and spatial scales. This is done by illuminating samples with coherent x-ray beams and calculating the correlation function of the obtained x-ray scattering images. XPCS is uniquely suited for studying Brownian dynamics, consisting of translational and rotational diffusion. While traditional XPCS image analysis techniques can extract translational diffusion components, they are unable to estimate rotational diffusion coefficients. Here, we introduce a methodology that combines the angular-temporal cross-correlation analysis and a algorithmic framework called Multi-Tiered Estimation for Correlation Spectroscopy in 3D for estimating three-dimensional rotational diffusion coefficients from XPCS images of three-dimensional particle systems. We demonstrate our methodology for extracting rotational diffusion coefficients from XPCS data by applying it to simulated noisy x-ray images of systems of crossing nanotubes and proteins that evolve under translational and rotational Brownian motion for different diffusion rates. Furthermore, our results show that our approach determines rotational diffusion coefficients within a few percent error.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2001

Observations of Three-Dimensional Radiative Effects that Influence Satellite Retrievals of Cloud Properties

This paper examines three-dimensional (3D) radiative effects, which arise from horizontal radiative interactions between areas that have different cloud properties. Earlier studies have argued that these effects can cause significant uncertainties in current satellite retrievals of cloud properties, because the retrievals rely on one-dimensional (1D) theory and do not consider the effects of horizontal changes in cloud properties. This study addresses two questions: which retrieved cloud properties are influenced by 3D radiative effects, and where 3D effects tend to occur? The influence of 3D effects is detected from the wayside illumination and shadowing make clouds appear asymmetric: Areas appear brighter if the cloud top surface is tilted toward, rather than away from, the Sun. The analysis of 30 images by the Moderate Resolution Imaging Spectroradiometer (MODIS) reveals that retrievals of cloud optical thickness and cloud water content are most influenced by 3D effects, whereas retrievals of cloud particle size are much less affected. The results also indicate that while 3D effects are strongest at cloud edges, cloud top variability in cloud interiors, even in overcast regions, also produces considerable 3D effects. Finally, significant 3D effects are found in a wide variety of situations, ranging from thin clouds to thick ones and from low clouds to high ones.

Varnai, Tamas↗

DOE OSTI2023

PRESSURE-FILM OPEN SOURCE SCANNING AND MAPPING

SF-22-099 Pressure-film Open Source Scanning and Mapping (POSSM) is software that analyses images of pressure-film (scans or photographs). POSSM collects data from that analysis in order to produce a number of visual aides, including pressure maps, histograms, and 3d surface plots. POSSM is designed to be able to analyze an entire folder full of images, exporting numeric data as .csv files and visual graphics as .png files.

Grider, Patrick↗

DOE OSTI2026

Automation of Laser Plasma Focused Ion Beam Microscopy for Next-Gen Energy Materials

Automation can revolutionize the use of ultrafast laser ablation and plasma-focused ion beam (PFIB) techniques for high-throughput, reproducible cross-sectioning and various sample preparation in materials characterization. As these methods become essential for analyzing complex energy materials and next-generation devices, efficient, standardized workflows are needed to minimize variability and enhance precision. This work highlights our advancements in developing automated processes for sample preparation that integrates machine learning, workflow optimization, and large-scale data acquisition to improve efficiency and scalability in applications such as electrolyzers, photovoltaic cells, and microelectronics. To streamline cross-sectioning and lamella fabrication, we have implemented fully automated workflows that standardize laser ablation and PFIB milling sequences. These workflows incorporate pre-programmed protocols for material removal, alignment, and thinning, reducing user intervention and ensuring consistency across different sample types. Machine learning algorithms further enhance automation by predicting optimal milling strategies and adapting parameters based on material properties and sectioning requirements. This approach significantly improves throughput while maintaining the structural integrity of prepared samples for high-resolution imaging and analysis, including transmission electron microscopy. Beyond sample preparation, our automation platform enables the acquisition of large, high-resolution datasets through serial sectioning, image alignment, and 3D reconstruction. These automated routines facilitate multi-scale characterization, capturing structural and compositional details from the nanoscale to the device level. By reducing variability and increasing efficiency, our automated approach enhances defect analysis, failure diagnostics, and process optimization, accelerating advancements in materials research and device engineering.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗

DOE OSTI2023

Real Space and Time Imaging of Collective Headgroup Dipole Motions in Zwitterionic Lipid Bilayers

Lipid bilayers are supramolecular structures responsible for a range of processes, such as transmembrane transport of ions and solutes, and sorting and replication of genetic materials, to name just a few. Some of these processes are transient and currently, cannot be visualized in real space and time. Here, we developed an approach using 1D, 2D, and 3D Van Hove correlation functions to image collective headgroup dipole motions in zwitterionic phospholipid bilayers. We show that both 2D and 3D spatiotemporal images of headgroup dipoles are consistent with commonly understood dynamic features of fluids. However, analysis of the 1D Van Hove function reveals lateral transient and re-emergent collective dynamics of the headgroup dipoles—occurring at picosecond time scales—that transmit and dissipate heat at longer times, due to relaxation processes. At the same time, the headgroup dipoles also generate membrane surface undulations due a collective tilting of the headgroup dipoles. A continuous intensity band of headgroup dipole spatiotemporal correlations—at nanometer length and nanosecond time scales—indicates that dipoles undergo stretching and squeezing elastic deformations. Importantly, the above mentioned intrinsic headgroup dipole motions can be externally stimulated at GHz-frequency scale, enhancing their flexoelectric and piezoelectric capabilities (i.e., increased conversion efficiency of mechanical energy into electric energy). In conclusion, we discuss how lipid membranes can provide molecular-level insights about biological learning and memory, and as platforms for the development of the next generation of neuromorphic computers.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1990

Global analyses of water vapor, cloud and precipitation derived from a diagnostic assimilation of SSM/I geophysical retrievals

An analytical approach is described for diagnostically assimilating moisture data from Special Sensor Microwave Imager (SSM/I) into a global analysis of water vapor, cloud content, and precipitation. In this method, 3D fields of wind and temperature values taken from ECMWF gridded analysis are used to drive moisture conservation equations with parameterized microphysical treatment of vapor, liquid, and ice; the evolving field of water vapor is periodically updated or constrained by SSM/I retrievals of precipitable water. Initial results indicate that this diagnostic model can produce realistic large-scale fields of cloud and precipitation. The resulting water vapor analyses agree well with SSM/I and have an additional advantage of being synoptic.

Robertson, Franklin R.↗

DOE OSTI2022

Real-time 3D analysis during electron tomography using tomviz

The demand for high-throughput electron tomography is rapidly increasing in biological and material sciences. However, this 3D imaging technique is computationally bottlenecked by alignment and reconstruction which runs from hours to days. We demonstrate real-time tomography with dynamic 3D tomographic visualization to enable rapid interpretation of specimen structure immediately as data is collected on an electron microscope. Using geometrically complex chiral nanoparticles, we show volumetric interpretation can begin in less than 10 minutes and a high-quality tomogram is available within 30 minutes. Real-time tomography is integrated into tomviz, an open-source and cross-platform 3D data analysis tool that contains intuitive graphical user interfaces (GUI), to enable any scientist to characterize biological and material structure in 3D.

36 MATERIALS SCIENCE↗

NASA NTRS1999

Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83-0.97) and William's index values (range 0.37-0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.

NASA Discipline Cardiopulmonary↗

DOE OSTI2024

Automated 3D cytoplasm segmentation in soft X-ray tomography

Cells’ structure is key to understanding cellular function, diagnostics, and therapy development. Soft X-ray tomography (SXT) is a unique tool to image cellular structure without fixation or labeling at high spatial resolution and throughput. Fast acquisition times increase demand for accelerated image analysis, like segmentation. Currently, segmenting cellular structures is done manually and is a major bottleneck in the SXT data analysis. This paper introduces ACSeg, an automated 3D cytoplasm segmentation model. ACSeg is generated using semi-automated labels and 3D U-Net and is trained on 43 SXT tomograms of immune T cells, rapidly converging to high-accuracy segmentation, therefore reducing time and labor. Furthermore, adding only 6 SXT tomograms of other cell types diversifies the model, showing potential for optimal experimental design. ACSeg successfully segmented unseen tomograms and is published on Biomedisa, enabling high-throughput analysis of cell volume and structure of cytoplasm in diverse cell types.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

LABQ3: Bayesian method for quantification of mineral compositions and nano-scale elemental mapping of 3D synchrotron XCT data

Quantitative analysis of mineral compositions is essential in understanding geochemical, mineralogical and environmental processes. Fine-resolution 3D imaging is widely done using synchrotron X-ray computed tomography (XCT), but existing analyses are limited to visualization and segmentation. This paper presents a new method, Linear Attenuation Bayesian Quantitative 3D-mapper (LABQ3), based on the linearity of X-ray attenuation with respect to elemental concentrations. To address the random variability in attenuation measurements, LABQ3 employs Bayesian decision theory to minimize classification error, using reference attenuation distributions from scans of pure mineral standards. To demonstrate LABQ3 and test its performance, we studied precipitated carbonate samples. XCT scans were done at multiple energies using the transmission X-ray microscope (TXM) at beamline 32-ID-C of the Advanced Photon Source at Argonne National Laboratory. The reconstructed 3D images have a voxel size of 20 nm. Analyses revealed rich nano-scale compositional heterogeneity within individual particles. A mixture of calcium and cadmium produced an overall stoichiometric composition of (Ca 0.78 ,Cd 0.22 )CO 3 , with some voxels containing nearly pure CdCO 3 . The addition of zinc led to an overall stoichiometric composition of 33% Ca, 28% Cd, 39% Zn, with a nearly pure CaCO 3 core and compositional zonation through the rim. These compositional gradients are related to temporal sequences of carbonate mineral formation where Cd precipitated at the beginning in (Ca,Cd)CO 3 , while Cd and Zn precipitated at the end in (Ca, Cd,Zn)CO 3 . Results differ from bulk analyses using Inductively Coupled Plasma-Mass Spectrometry (ICP-MS), showing that LABQ3 provides particle-specific insights. LABQ3 distinguishes itself by quantifying chemical compositions along a continuum, making it different from XCT analyses based on segmentation. LABQ3 allows simultaneous acquisition of morphology and chemical composition in 3D, facilitating the interpretation of chemical gradients of trace elements, quantification of solid solution compositions, inferences about temporal sequences of mineral precipitation, and addressing other concerns about solid-phase chemistry.

58 GEOSCIENCES↗

DOE OSTI2024

3D Optical Coherence Tomography image processing in BISCAP: characterization of biofilm structure and properties

Abstract Motivation BISCAP is a state-of-the-art tool for automatically characterizing biofilm images obtained from Optical Coherence Tomography. Limited availability of other software tools is reported in the field. BISCAP’s first version processes 2D images only. Processing 3D images is a problem of greater scientific relevance since it deals with the entire structure of biofilms instead of their 2D slices. Results Building on the image-processing principles and algorithms proposed earlier for 2D images, these were adapted to the 3D case, and a more general implementation of BISCAP was developed. The primary goal concerns the extension of the initial methodology to incorporate the depth axis in 3D images; multiple improvements were also made to boost computational performance. The calculation of structural properties and visual outputs was extended to offer new insights into the 3D structure of biofilms. BISCAP was tested using 3D images of biofilms with different morphologies, consistently delivering accurate characterizations of 3D structures in a few minutes using standard laptop machines. Low user dependency is required for image analysis. Availability and implementation BISCAP is available from https://github.com/diogonarciso/BISCAP. All images used in the tutorials and the validation examples are available from https://web.fe.up.pt/∼fgm/biscap3d.

Narciso, Diogo A. C. (ORCID:0000000227767477)↗

DOE OSTI2026

BM3DORNL

BM3DORNL is a high-performance, open-source library for removing streak and ring artifacts from computed-tomography (CT) data, developed for neutron imaging at Oak Ridge National Laboratory's Spallation Neutron Source (VENUS beamline) and applicable to X-ray CT as well. Ring artifacts — concentric rings in reconstructed slices caused by detector pixel-to-pixel response non-uniformities — appear as vertical streaks in the sinogram and degrade both image quality and quantitative analysis. BM3DORNL operates in the sinogram domain using an adaptation of the BM3D (block-matching and 3D collaborative filtering) algorithm (Dabov et al., 2007). It provides a dedicated streak-removal mode, a true multi-scale BM3D variant (after Mäkinen et al., 2021) that suppresses wide streaks single-scale methods miss, and an alternative Fourier–SVD method (~2.6× faster) combining FFT-based energy detection with rank-1 SVD. The computationally intensive core is implemented in Rust with parallel (Rayon) block matching, integral-image pre-screening, and optimized transforms, and is exposed through a simple Python API (with an optional GUI) so it integrates directly into existing tomography reconstruction pipelines. It processes both 2D sinograms and 3D sinogram stacks, is pip-installable for Linux and macOS, and is documented at https://bm3dornl.readthedocs.io.

Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗

DOE OSTI2025

SwinCell: a 3D transformer and flow-based framework for improved cell segmentation

Segmentation of three-dimensional (3D) cellular images is fundamental for studying and understanding cell structure and function. However, 3D cellular segmentation is challenging, particularly for dense cells and tissues. This challenge arises mainly from the complex contextual information within 3D images, anisotropic properties, and the sensitivity to internal cellular structures, which often lead to incorrect segmentation. In this work, we introduce SwinCell, a 3D transformer-based framework that leverages Swin-transformer to predict flow and differentiate individual cell instances. We demonstrate SwinCell’s utility in the segmentation of nuclei, colon tissue cells, and densely cultured cells. SwinCell strikes a balance between maintaining detailed local feature recognition and understanding broader contextual information. Through extensive testing with both public and in-house 3D cell imaging datasets, SwinCell shows utility in segmenting dense cells, making it a valuable tool for 3D segmentation in cellular analysis that could expedite research in cell biology and tissue engineering.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRSDate not supplied

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was implemented to offer an efficient framework for determining material characteristics from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enable parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM). SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography or other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

DOE OSTI2025

A Robust Data-Driven Approach for Mechanical Serial Sectioning

Mechanical serial sectioning (MSS) provides detailed microstructural information across large length scales. By repeatedly removing thin layers of material and imaging the exposed surface, a 3D representation of a specimen’s internal structure can be constructed, enabling failure analysis and feature identification that are otherwise inaccessible via conventional 2D or nondestructive evaluation techniques. Achieving consistent and accurate material removal can be challenging due to system variability, requiring an experienced operator to manually adjust parameters, prolonging data collection times and necessitating post-processing routines to standardize the data. Here, to address these challenges, this paper presents the employment of a one-step model predictive control (MPC) framework tailored to a run-to-run (R2R) controller. The R2R-MPC controller automates the parameter selection process, improving the consistency of material removal through iterative feedback for disturbance rejection and accurate tracking of the target removal rate. Using a data-driven approach, the controller robustly adapts to changing material characteristics. The effectiveness of the R2R-MPC controller is demonstrated through simulation and experimental results and compared to previous data collection procedures.

3D Materials Science↗

NASA NTRS2005

Three Dimensional Rover/Lander/Orbiter Mission-Planning (3D-ROMPS) System: A Modern Approach to Mission Planning

NASA's current mission planning system is based on point design, two-dimensional display, spread sheets, and report technology. This technology does not enable engineers to analyze the results of parametric studies of missions plans. This technology will not support the increased observational complexity and data volume of missions like Cassini, Mars Reconnaissance Orbiter (MRO), Mars Science Laboratory (MSL), and Mars Sample Return (MSR). The goal of the 3D-ROMPS task has been to establish a set of operational mission planning and analysis tools in the Image Processing Laboratory (IPL) Mission Support Area (MSA) that will respond to engineering requirements for planning future Solar System Exploration (SSE) missions using a three-dimensional display.

Scharfe, Nathan D.↗

NASA NTRSDate not supplied

3D Localization of Defects in Facility Inspection

Wind tunnels are crucial facilities that support the aerospace industry. However, these facilities are large, complex, and pose unique maintenance and inspection requirements. Manual inspections to identify defects such as cracks, missing fasteners, leaks, and foreign objects are important but labor and schedule intensive. Our goal is to utilize small Unmanned Aircraft Systems (sUAS) and computer vision-based analysis to automate the inspection of the interior and exterior of NASA’s critical wind tunnel facilities. We detect missing fasteners as our defect class, and detect existing fasteners to provide potential future missing fastener sites for preventative maintenance. These detections are done on both 2D raw images and in 3D space to provide a visual reference and real world location to facilitate repairs. A dataset was created consisting of images taken along a grid-like pattern of an interior tunnel section in the AEDC National Full-Scale Aerodynamics Complex (NFAC) at NASA Ames Research Center. Our method uses object detection to create image level bounding boxes of the fasteners and missing fasteners, then uses photogrammetry to create a mapping from 2D image locations to 3D real world locations. The image level bounding boxes and the 2D to 3D mapping are then combined to determine the 3D location of the defects. We describe the data collection, photogrammetry, and computer vision techniques used for object detection as well as a quantitative analysis of the method.

Small Unmanned Aircraft Systems (sUAS)↗