Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2007

Using Visual Odometry to Estimate Position and Attitude

A computer program in the guidance system of a mobile robot generates estimates of the position and attitude of the robot, using features of the terrain on which the robot is moving, by processing digitized images acquired by a stereoscopic pair of electronic cameras mounted rigidly on the robot. Developed for use in localizing the Mars Exploration Rover (MER) vehicles on Martian terrain, the program can also be used for similar purposes on terrestrial robots moving in sufficiently visually textured environments: examples include low-flying robotic aircraft and wheeled robots moving on rocky terrain or inside buildings. In simplified terms, the program automatically detects visual features and tracks them across stereoscopic pairs of images acquired by the cameras. The 3D locations of the tracked features are then robustly processed into an estimate of overall vehicle motion. Testing has shown that by use of this software, the error in the estimate of the position of the robot can be limited to no more than 2 percent of the distance traveled, provided that the terrain is sufficiently rich in features. This software has proven extremely useful on the MER vehicles during driving on sandy and highly sloped terrains on Mars.

Maimone, Mark↗
NASA NTRS1997

Rendering Three-Dimensional Solar Coronal Structures

An X-ray or EUV image of the corona or chromosphere is a 2D representation of an extended 3D complex for which a general inversion process is impossible. A specific model must be incorporated in order to understand the full 3D structure. We approach this problem by modeling a set of optically-thin 3D plasma flux tubes which we render these as synthetic images. The resulting images allow the interpretation of the X-ray/EUV observations to obtain information on (1) the 3D structure of X-ray images, i.e., the geometric structure of the flux tubes, and on (2) the internal structure using specific plasma characteristics, i.e., the physical structure of the flux tubes. The data-analysis technique uses magnetograms to characterize photospheric magnetic fields and extrapolation techniques to form the field lines. Using a new set of software tools, we have generated 3D flux tube structures around these field lines and integrated the plasma emission along the line of sight to obtain a rendered image. A set of individual flux-tube images is selected by a non-negative least-squares technique to Provide a match with an observed X-ray image. The scheme minimizes the squares of the differences between the synthesized image and the observed image with a non-negative constraint on the coefficients of the brightness of the individual flux-tube loops. The derived images are used to determine the specific photospheric foot points and physical data, i.e., scaling laws for densities and loop lengths. The development has led to Computer efficient integration and display software that is compatible for comparison with observations (e.g., Yohkoh SXT data, NIXT, or EIT). This analysis is important in determining directly the magnetic field configuration, which provides the structure of coronal loops, and indirectly the electric currents or waves, which provide the energy for the heating of the plasma. We have used very simple assumptions (i.e., potential magnetic fields and isothermal corona) to provide an initial test of the techniques before complex models are introduced. We have separated the physical and geometric contributions of the emission for a set of flux tubes and concentrated, in this initial study, on the geometric contributions by making approximations to the physical contributions. The initial results are consistent with the scaling laws derived from Yohkoh SXT data.

Gary, G. Allen↗
DOE OSTI2023

Rapid sensing of hidden objects and defects using a single-pixel diffractive terahertz sensor

Abstract Terahertz waves offer advantages for nondestructive detection of hidden objects/defects in materials, as they can penetrate most optically-opaque materials. However, existing terahertz inspection systems face throughput and accuracy restrictions due to their limited imaging speed and resolution. Furthermore, machine-vision-based systems using large-pixel-count imaging encounter bottlenecks due to their data storage, transmission and processing requirements. Here, we report a diffractive sensor that rapidly detects hidden defects/objects within a 3D sample using a single-pixel terahertz detector, eliminating sample scanning or image formation/processing. Leveraging deep-learning-optimized diffractive layers, this diffractive sensor can all-optically probe the 3D structural information of samples by outputting a spectrum, directly indicating the presence/absence of hidden structures or defects. We experimentally validated this framework using a single-pixel terahertz time-domain spectroscopy set-up and 3D-printed diffractive layers, successfully detecting unknown hidden defects inside silicon samples. This technique is valuable for applications including security screening, biomedical sensing and industrial quality control.

Li, Jingxi (ORCID:0000000165958680)↗
DOE OSTI2020

Nanoscale x-ray and electron tomography

We present that three-dimensional (3D) tomographic imaging of the structural, chemical, and physical properties of a material provides key knowledge that links the structure of a material to both its processing and structure that is central to studies across a broad spectrum of materials. For many decades, tomography using x-rays or electrons has proven to be an essential 3D characterization tool. In recent years, advances in technology have significantly pushed the envelope of these techniques in many respects, enabling new imaging capabilities at the nanometer and atomic scale. This article highlights several such developments in nanoscale x-ray and electron tomography. The five articles that appear in this issue of MRS Bulletin discuss research frontiers that include multimodal x-ray tomography at the nanoscale, x-ray spectroscopic tomography, dark-field x-ray microscopy, electron nanotomography for functional nanomaterials, and atomistic imaging by electron tomography. Lastly, these articles give a holistic view of the status of these techniques and promising future directions, as well highlighting their applications for scientific problems.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Quantifying the unknown impact of segmentation uncertainty on image-based simulations

Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.

42 ENGINEERING↗
DOE OSTI2023

Multiscale dynamics of charging and plating in graphite electrodes coupling operando microscopy and phase-field modelling

The phase separation dynamics in graphitic anodes significantly affects lithium plating propensity, which is the major degradation mechanism that impairs the safety and fast charge capabilities of automotive lithium-ion batteries. In this study, we present comprehensive investigation employing operando high-resolution optical microscopy combined with non-equilibrium thermodynamics implemented in a multi-dimensional (1D+1D to 3D) phase-field modeling framework to reveal the rate-dependent spatial dynamics of phase separation and plating in graphite electrodes. Here we visualize and provide mechanistic understanding of the multistage phase separation, plating, inter/intra-particle lithium exchange and plated lithium back-intercalation phenomena. A strong dependence of intra-particle lithiation heterogeneity on the particle size, shape, orientation, surface condition and C-rate at the particle level is observed, which leads to early onset of plating spatially resolved by a 3D image-based phase-field model. Moreover, we highlight the distinct relaxation processes at different state-of-charges (SOCs), wherein thermodynamically unstable graphite particles undergo a drastic intra-particle lithium redistribution and inter-particle lithium exchange at intermediate SOCs, whereas the electrode equilibrates much slower at low and high SOCs. These physics-based insights into the distinct SOC-dependent relaxation efficiency provide new perspective towards developing advanced fast charge protocols to suppress plating and shorten the constant voltage regime.

25 ENERGY STORAGE↗
NASA NTRS2020

Optical Navigation for Autonomous Approach of Small Unknown Bodies

State of the practice in navigation around small celestial bodies heavily relies on ground sup- port and human skill, in particular, for perception-based operations such as optical navigation and mapping. This leads to longer duration and more complex mission operations and sub- sequently higher cost. Furthermore, it imposes limitations for certain missions such as fast fly-bys or multi-agent operations. In this work, we present an autonomous navigation strat- egy suitable for approaching small unexplored bodies. During the approach, we estimate the body’s physical properties as well as the spacecraft’s relative trajectory and associated un- certainties. The autonomous navigation strategy, which is solely based on optical measure- ments, begins as soon as the body becomes resolved in the navigation camera and terminates at the start of proximity operations, when the spacecraft makes its first trajectory correction to stay in the vicinity of the body. Our strategy uses multiple image-processing algorithms: light-curve analysis for estimating the target body’s rotation rate, Shape-from-Silhouette for reconstructing the 3D shape and estimating its rotation pole, and feature tracking tailored to Small-Body images for estimating relative navigation parameters. We used the Mission Analysis, Operations, and Navigation Toolkit Environment (MONTE) developed by the Jet Propulsion Laboratory to evaluate the feasibility of this multi-phase navigation strategy using simulated images of an approach trajectory. We used the Rosetta mission data to generate photorealistic images to characterise the performance of this approach. This work is based on the assumptions that the spacecraft attitude is known, the body is a principal-axis rotator, a-priori estimates of ephemerides and scale are available, and the body is observed from a zero sun phase only during initial approach. Preliminary results show orbit determination performance that is on par with the human navigation from the Rosetta mission; albeit with a 1% bias in spacecraft-target radial distance estimate. The bias error is likely due to the robustness and accuracy of the visual tracking under dynamic lighting conditions and per- spective changes, which decrease accuracy.

Villa, Jacopo↗
DOE OSTI2023

Real Space and Time Imaging of Collective Headgroup Dipole Motions in Zwitterionic Lipid Bilayers

Lipid bilayers are supramolecular structures responsible for a range of processes, such as transmembrane transport of ions and solutes, and sorting and replication of genetic materials, to name just a few. Some of these processes are transient and currently, cannot be visualized in real space and time. Here, we developed an approach using 1D, 2D, and 3D Van Hove correlation functions to image collective headgroup dipole motions in zwitterionic phospholipid bilayers. We show that both 2D and 3D spatiotemporal images of headgroup dipoles are consistent with commonly understood dynamic features of fluids. However, analysis of the 1D Van Hove function reveals lateral transient and re-emergent collective dynamics of the headgroup dipoles—occurring at picosecond time scales—that transmit and dissipate heat at longer times, due to relaxation processes. At the same time, the headgroup dipoles also generate membrane surface undulations due a collective tilting of the headgroup dipoles. A continuous intensity band of headgroup dipole spatiotemporal correlations—at nanometer length and nanosecond time scales—indicates that dipoles undergo stretching and squeezing elastic deformations. Importantly, the above mentioned intrinsic headgroup dipole motions can be externally stimulated at GHz-frequency scale, enhancing their flexoelectric and piezoelectric capabilities (i.e., increased conversion efficiency of mechanical energy into electric energy). In conclusion, we discuss how lipid membranes can provide molecular-level insights about biological learning and memory, and as platforms for the development of the next generation of neuromorphic computers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

An intensity-based post-processing tool for 3D instance segmentation of organelles in soft X-ray tomograms

Investigating the 3D structures and rearrangements of organelles within a single cell is critical for better characterizing cellular function. Imaging approaches such as soft X-ray tomography have been widely applied to reveal a complex subcellular organization involving multiple inter-organelle interactions. However, 3D segmentation of organelle instances has been challenging despite its importance in organelle characterization. Here we propose an intensity-based post-processing tool to identify and separate organelle instances. Our tool separates sphere-like (insulin vesicle) and columnar-shaped organelle instances (mitochondrion) based on the intensity of raw tomograms, semantic segmentation masks, and organelle morphology. We validate our tool using synthetic tomograms of organelles and experimental tomograms of pancreatic β -cells to separate insulin vesicle and mitochondria instances. As compared to the commonly used connected regions labeling, watershed, and watershed + Gaussian filter methods, our tool results in improved accuracy in identifying organelles in the synthetic tomograms and an improved description of organelle structures in β -cell tomograms. In addition, under different experimental treatment conditions, significant changes in volumes and intensities of both insulin vesicle and mitochondrion are observed in our instance results, revealing their potential roles in maintaining normal β -cell function. Our tool is expected to be applicable for improving the instance segmentation of other images obtained from different cell types using multiple imaging modalities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Thermal tomography 3D imaging of additively manufactured metallic structures

Thermal tomography is a computational method for heat diffusion-based imaging of solids, which provides 3D visualization of data from flash thermography measurements. We investigate thermal tomography imaging and nondestructive evaluation of stainless steel and nickel super alloy metallic structures produced with the laser powder bed fusion (LPBF) additive manufacturing (AM) process. Metallic structures produced with LPBF contain defects, and there are limited capabilities to evaluate these structures non-destructively. Thermal tomography reconstruction of 3D apparent spatial effusivity provides information about AM structure geometry and internal material flaws. We study performance of thermal tomography in imaging of metallic structures through COMSOL computer simulations of transient heat transfer and through reconstruction of data obtained from experimental measurements. Thermal tomography reconstructions of structure shape and dimensions are shown for the Inconel 718 AM structure which has variations in the horizontal plane but is uniform along the depth dimension. Reconstruction of internal defects is investigated using a stainless steel 316L specimen with flat bottom hole (FBH) indentations, and the Inconel 718 plate is produced with the LPBF method, which contains imprinted hemispherical shape low density regions containing non-sintered metallic powder. The FBHs have the same sizes as the imprinted defects in the LPBF specimens but offer better imaging contrast. Thermal tomography reconstructions provide visualizations of internal defects and allow for estimation of their sizes and locations. Results of this study demonstrate that thermal tomography can be used for visualization and quality control in AM.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Using multimodal X-ray computed tomography to advance 3D petrography: A non-destructive investigation of olivine inside a carbonaceous chondrite

Rocks form in three dimensions through time and studying them provides information from inside dynamic systems we cannot otherwise observe. Yet how we typically access the interior of the rocks themselves to gain that information may limit our understanding and influence how we reconstruct the processes that formed them. Here, we demonstrate combined non-destructive 3D X-ray imaging techniques that produce quantitative densitometric and crystallographic maps of entire individual grains inside a rock. Olivine grains throughout a sample of the carbonaceous chondrite Northwest Africa (NWA) 11346 were each characterized by size, shape, composition, zoning intensity, and crystallographic orientation. The addition of 3D crystallographic mapping to calibrated 3D densitometric analysis—used to calculate chemical composition—demonstrates a fully non-destructive petrographic method and provides unique insight. For instance, in our case, using crystallographic data to delineate individual grains and then measuring the 3D size, shape, and composition of each distinguishes variably reset relict grains from those later crystallized after a melting event. Intersection in a 2D slice could not have led to this interpretation because the integration of three-dimensional size, rounding, composition, location, and crystallographic orientation measured from each grain forms the key patterns. Multimodal laboratory X-ray imaging has strong potential to advance 3D petrography.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Review of Selected Advances in Electrical Capacitance Volume Tomography for Multiphase Flow Monitoring

Electrical Capacitance Volume Tomography (ECVT) has emerged as an attractive technology for addressing instrumentation requirements in various energy-related multiphase flow systems. ECVT can monitor multiple flow conditions and reconstruct real-time 3D images from capacitance measurements using a large set of electrode plates placed around the processes column enclosing the sensed flow system. ECVT is non-intrusive and allows the measurement of changes in mutual capacitance between all possible plate pair combinations. The objective of this paper is to provide a comprehensive review of recent advances in ECVT, enabling robust monitoring of multiphase flows, especially water-containing multiphase flows.

02 PETROLEUM↗
NASA NTRS1991

The exploration metaphor

NASA's experience in planetary exploration has demonstrated that the desktop workstation is inadequate for many visualization situations. The primary mission displays for the unmanned Surveyor missions to the moon during the mid-1960's, for example, were environmental images assembled on the inside surfaces of spherical shells. Future exploration missions will greatly benefit from advances in digital computer and display technology, but there remain unmet user interface needs. Alternative user interfaces and metaphors are needed for planetary exploration and other interactions with complex spatial environments. These interfaces and metaphors would enable the user to directly explore environments and naturally manipulate objects in those environments. Personal simulators, virtual workstations, and telepresence user interfaces are systems capable of providing this integration of user space and task space. The Exploration Metaphor is a useful concept for guiding the design of user interfaces for virtual environments and telepresence. To apply the Exploration Metaphor is to assert that computing is like exploration, and to support objects, operations, and contexts comparable to those encountered in the exploration of natural environments. The Exploration Metaphor, under development for user interfaces in support of NASA's planetary exploration missions and goals, will also benefit other applications where complex spatial information must be visualized. Visualization methods and systems for planetary exploration are becoming increasingly integrated and interactive as computing technology improves. These advances will benefit from virtual environment and telepresence interface technology. A key development has been the processing of multiple images and other sensor data to create detailed digital models of the planets and moons. Data from images of the Earth, Mars, and Miranda, for example, have been converted into 3D models, and dynamic virtual fly-overs have been computed as demonstrations. Similar processing of lower altitude photography and the use of computer aided design tools promise to produce very detailed models in the future.

Mcgreevy, Michael W.↗
DOE OSTI2020

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging. Part I

This two-part article series provides a generalized description of the scattering geometry of Bragg coherent diffraction imaging (BCDI) experiments, the shear distortion effects inherent in the 3D image obtained from presently used methods and strategies to mitigate this distortion. Part I starts from fundamental considerations to present the general real-space coordinate transformation required to correct this shear, in a compact operator formulation that easily lends itself to implementation with available software packages. Such a transformation, applied as a final post-processing step following phase retrieval, is crucial for arriving at an undistorted, correctly oriented and physically meaningful image of the 3D crystalline scatterer. As the relevance of BCDI grows in the field of materials characterization, the available sparse literature that addresses the geometric theory of BCDI and the subsequent analysis methods are generalized here. This geometrical aspect, specific to coherent Bragg diffraction and absent in 2D transmission CDI experiments, gains particular importance when it comes to spatially resolved characterization of 3D crystalline materials in a reliable nondestructive manner. This series of articles describes this theory, from the diffraction in Bragg geometry to the corrections needed to obtain a properly rendered digital image of the 3D scatterer. Part I of this series provides the experimental BCDI community with the general form of the 3D real-space distortions in the phase-retrieved object, along with the necessary post-retrieval correction method. Part II builds upon the geometric theory developed in Part I with the formalism to correct the shear distortions directly on an orthogonal grid within the phase-retrieval algorithm itself, allowing more physically realistic constraints to be applied. Taken together, Parts I and II provide the X-ray science community with a set of generalized BCDI shear-correction techniques crucial to the final rendering of a 3D crystalline scatterer and for the development of new BCDI methods and experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Dynamic in situ imaging of methane hydrate formation in coal media

Fast 3D X-ray imaging has proved to provide crucial insights into multi-phase dynamic processes in various geomaterials. In particular, many in situ imaging experiments have been made to study gas-hydrate formation in porous sandy samples. Such imaging is challenging for the methane gas-hydrate formation in coal samples because of the coal micro-porosity structure and lower X-ray contrast. Here we present results of the first dynamic in situ micro-computed tomography experiment of methane-hydrate formation in coal samples. Synchrotron phase-contrast tomography techniques allowed to achieve necessary contrast levels to separate all the materials of interest (gas, water, coal, and gas hydrate) in reconstructed images with high spatial and temporal resolution. The imaging results are compared to the ones from a similar tomographic experiment with sand samples. Methane-hydrate formation is accompanied by the water movements caused by cryogenic water suction that happens in sequences of short fast movements with longer equilibrium states in between. Only one type of the hydrate formation was observed in coal (growth as shells on grain boundaries) as opposed to three types in sand (shells, growth into gas pockets, and inside water volumes). In particular, this leads to a slower hydrateformation speed in coal. For the coal sample, we also observed water extraction from grains, and interpreted it as competitive sorption of methane. Lastly, we visualized the dynamic behavior of this water extraction via microchannels inside the coal grains, and performed nano-tomography imaging of these channels for a better understanding of this phenomenon.

58 GEOSCIENCES↗
DOE OSTI2020

Microanalytical Approaches to Characterizing REE in Appalachian Basin Underclays

The search for a reliable U.S. domestic source of rare earth elements (REE) is necessary to support the demand of advanced energy applications (e.g., catalysts, electronics, magnets). Sedimentary deposits may be sources for selectively recovering REE and critical metals—specifically the interbedded seat rock, or underclay, that underlies or forms the floor of a coal seam. This material is often a major component of coal waste fines and refuse and thus readily available. This study examines several Appalachian Basin underclays associated with actively mined coal seams as potential feedstocks for the REE. Multimodal microanalytical electron microscopy (SEM, FIB-SEM, EMPA) synchrotron-based µXRF, and image processing techniques are coupled with detailed elemental and mineral data to classify the 2D and 3D petrophysical properties of the materials. The REE contents of Appalachian Basin underclays were measured from 235–399 ppm and predominantly observed as discrete REE-bearing minerals such as monazite and xenotime on the order of 10–100 µm in size. These REE-bearing minerals typically accounted for less than 1% of the scanned areas and volumes under SEM and FIB-SEM analysis, with the exception of regions enriched in crandallite. Synchrotron-based µXRF elemental maps further identified several REE deposition environments in different underclays, including micro-scale (10–100 µm) light REEs co-localizing with Ca and P, micro-scale heavy REEs with Fe, and large-scale light REEs (>200 µm) co-localizing with Sr, Ba, Ca and P.

36 MATERIALS SCIENCE↗
NASA NTRS2015

Characterization of Apollo Regolith by X-Ray and Electron Microbeam Techniques: An Analog for Future Sample Return Missions

The Apollo missions collected 382 kg of rock and regolith from the Moon; approximately 1/3 of the sample mass collected was regolith. Lunar regolith consists of well mixed rocks, minerals, and glasses less than 1-centimeter n size. The majority of most surface regolith samples were sieved into less than 1, 1-2, 2-4, and 4-10- millimiter size fractions; a portion of most samples was re-served unsieved. The initial characterization and classification of most Apollo regolith particles was done primarily by binocular microscopy. Optical classification of regolith is difficult because (1) the finest fraction of the regolith coats and obscures the textures of the larger particles, and (b) not all lithologies or minerals are uniquely identifiable optically. In recent years, we have begun to use more modern x-ray beam techniques [1-3], coupled with high resolution 3D optical imaging techniques [4] to characterize Apollo and meteorite samples as part of the curation process. These techniques, particularly in concert with SEM imaging of less than 1-millimeter regolith grain mounts, allow for the rapid characterization of the components within a regolith.

Zeigler, Ryan A.↗
NASA NTRS2012

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗