Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Vision System Measures Motions of Robot and External Objects

A prototype of an advanced robotic vision system both (1) measures its own motion with respect to a stationary background and (2) detects other moving objects and estimates their motions, all by use of visual cues. Like some prior robotic and other optoelectronic vision systems, this system is based partly on concepts of optical flow and visual odometry. Whereas prior optoelectronic visual-odometry systems have been limited to frame rates of no more than 1 Hz, a visual-odometry subsystem that is part of this system operates at a frame rate of 60 to 200 Hz, given optical-flow estimates. The overall system operates at an effective frame rate of 12 Hz. Moreover, unlike prior machine-vision systems for detecting motions of external objects, this system need not remain stationary: it can detect such motions while it is moving (even vibrating). The system includes a stereoscopic pair of cameras mounted on a moving robot. The outputs of the cameras are digitized, then processed to extract positions and velocities. The initial image-data-processing functions of this system are the same as those of some prior systems: Stereoscopy is used to compute three-dimensional (3D) positions for all pixels in the camera images. For each pixel of each image, optical flow between successive image frames is used to compute the two-dimensional (2D) apparent relative translational motion of the point transverse to the line of sight of the camera. The challenge in designing this system was to provide for utilization of the 3D information from stereoscopy in conjunction with the 2D information from optical flow to distinguish between motion of the camera pair and motions of external objects, compute the motion of the camera pair in all six degrees of translational and rotational freedom, and robustly estimate the motions of external objects, all in real time. To meet this challenge, the system is designed to perform the following image-data-processing functions: The visual-odometry subsystem (the subsystem that estimates the motion of the camera pair relative to the stationary background) utilizes the 3D information from stereoscopy and the 2D information from optical flow. It computes the relationship between the 3D and 2D motions and uses a least-mean-squares technique to estimate motion parameters. The least-mean-squares technique is suitable for real-time implementation when the number of external-moving-object pixels is smaller than the number of stationary-background pixels.

Talukder, Ashit↗
DOE OSTI2020

Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling

We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled in the spatial domains, with ~30% of original data set sufficient for high-quality reconstruction, potentially enabling faster BE imaging. At the same time, reliable reconstruction along the frequency domain requires the resonance peak to be within the measured band. This behavior suggests the optimal strategy for the BE imaging on unknown samples. Finally, we discuss how GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans.

47 OTHER INSTRUMENTATION↗
NASA NTRS1998

Earth Science Multimedia Theater

The presentation will begin with the latest 1998 NASA Earth Science Vision for the next 25 years. A compilation of the 10 days of animations of Hurricane Georges which were supplied daily on NASA to Network television will be shown. NASA's visualizations of Hurricane Bonnie which appeared in the Sept 7 1998 issue of TIME magazine. Highlights will be shown from the NASA hurricane visualization resource video tape that has been used repeatedly this season on network TV. Results will be presented from a new paper on automatic wind measurements in Hurricane Luis from 1 -min GOES images that will appear in the October BAMS. The visualizations are produced by the Goddard Visualization & Analysis Laboratory, and Scientific Visualization Studio, as well as other Goddard and NASA groups using NASA, NOAA, ESA, and NASDA Earth science datasets. Visualizations will be shown from the "Digital-HyperRes-Panorama" Earth Science ETheater'98 recently presented in Tokyo, Paris and Phoenix. The presentation in Paris used a SGI/CRAY Onyx Infinite Reality Super Graphics Workstation at 2560 X 1024 resolution with dual synchronized video Epson 71 00 projectors on a 20ft wide screen. Earth Science Electronic Theater '999 is being prepared for a December 1 st showing at NASA HQ in Washington and January presentation at the AMS meetings in Dallas. The 1999 version of the Etheater will be triple wide with at resolution of 3840 X 1024 on a 60 ft wide screen. Visualizations will also be featured from the new Earth Today Exhibit which was opened by Vice President Gore on July 2, 1998 at the Smithsonian Air & Space Museum in Washington, as well as those presented for possible use at the American Museum of Natural History (NYC), Disney EPCOT, and other venues. New methods are demonstrated for visualizing, interpreting, comparing, organizing and analyzing immense Hyperimage remote sensing datasets and three dimensional numerical model results. We call the data from many new Earth sensing satellites, Hyperimage datasets, because they have such high resolution in the spectral, temporal, spatial, and dynamic range domains. The traditional numerical spreadsheet paradigm has been extended to develop a scientific visualization approach for processing Hyperimage datasets and 3D model results interactively. The advantages of extending the powerful spreadsheet style of computation to multiple sets of images and organizing image processing were demonstrated using the Distributed Image SpreadSheet (DISS).

Hasler, A. F.↗
NASA NTRS1988

A knowledge-based object recognition system for applications in the space station

A knowledge-based three-dimensional (3D) object recognition system is being developed. The system uses primitive-based hierarchical relational and structural matching for the recognition of 3D objects in the two-dimensional (2D) image for interpretation of the 3D scene. At present, the pre-processing, low-level preliminary segmentation, rule-based segmentation, and the feature extraction are completed. The data structure of the primitive viewing knowledge-base (PVKB) is also completed. Algorithms and programs based on attribute-trees matching for decomposing the segmented data into valid primitives were developed. The frame-based structural and relational descriptions of some objects were created and stored in a knowledge-base. This knowledge-base of the frame-based descriptions were developed on the MICROVAX-AI microcomputer in LISP environment. The simulated 3D scene of simple non-overlapping objects as well as real camera data of images of 3D objects of low-complexity have been successfully interpreted.

Dhawan, Atam P.↗
DOE OSTI2019

Application of Plasma FIB to Analyze a Single Oxide Inclusion in Steel

We demonstrate that Plasma Dual Beam focused ion beam (PFIB) milling can be used for high-resolution three-dimensional chemical study of a single non-metallic inclusion in steel. A CaO-Al{sub 2}O{sub 3}-MgO inclusion (~ 10 μm) on a polished cross-section of steel sample was located and milled using a Xe{sup +} ion beam. A secondary electron image and EDS map of every section were recorded and subsequently processed to show the 3D chemistry and morphology of the inclusion.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Optical super-resolution microscopy in polymer science

The advent of optical super-resolution microscopy (OSRM) over two decades ago has transformed light-mediated interrogation of systems down to the nanoscale. This innovative set of approaches to optics breaks the so-called diffraction limit of light (~200 nm), allowing for the first time to use optics in the far field to visualize behavior on nanoscopic length scales. While these visualization tools have rapidly found widespread use in biology and related fields, their implementation in materials and, more specifically, in polymer science has been far slower. To overcome possible barriers and highlight possible future directions, we present in this paper an introduction to OSRM for polymer scientists, beginning with an overview of relevant techniques and existing optical probes. We then show and examine the first examples of OSRM adaptation across major areas of polymer science, including: polymerization and structural characterization, self-assembly and solution behavior, bulk structure and behavior, crystallization, gel structure and behavior, phase transitions, and biofunctionality. We hope and anticipate that the discussions provided in this review will draw the attention of the polymer community to the capacities of these hitherto underexplored optical visualization techniques to further transform polymer science.

36 MATERIALS SCIENCE↗
DOE OSTI2020

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging. Part II

X-ray Bragg coherent diffraction imaging (BCDI) has been demonstrated as a powerful 3D microscopy approach for the investigation of sub-micrometre-scale crystalline particles. The approach is based on the measurement of a series of coherent Bragg diffraction intensity patterns that are numerically inverted to retrieve an image of the spatial distribution of the relative phase and amplitude of the Bragg structure factor of the diffracting sample. This 3D information, which is collected through an angular rotation of the sample, is necessarily obtained in a non-orthogonal frame in Fourier space that must be eventually reconciled. To deal with this, the approach currently favored by practitioners (detailed in Part I) is to perform the entire inversion in conjugate non-orthogonal real- and Fourier-space frames, and to transform the 3D sample image into an orthogonal frame as a post-processing step for result analysis. In this article, which is a direct follow-up of Part I, two different transformation strategies are demonstrated, which enable the entire inversion procedure of the measured data set to be performed in an orthogonal frame. The new approaches described here build mathematical and numerical frameworks that apply to the cases of evenly and non-evenly sampled data along the direction of sample rotation ( i.e. the rocking curve). The value of these methods is that they rely on the experimental geometry, and they incorporate significantly more information about that geometry into the design of the phase-retrieval Fourier transformation than the strategy presented in Part I. Finally, two important outcomes are (1) that the resulting sample image is correctly interpreted in a shear-free frame and (2) physically realistic constraints of BCDI phase retrieval that are difficult to implement with current methods are easily incorporated. Computing scripts are also given to aid readers in the implementation of the proposed formalisms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Real-time X-ray phase-contrast imaging using SPINNet—a speckle-based phase-contrast imaging neural network

X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, the computational cost associated with data inversion has hindered their wider adoption. By exploiting the power of deep learning, we developed a speckle-based phase-contrast imaging neural network (SPINNet) that significantly improves the imaging quality and boosts the phase retrieval speed by at least 2 orders of magnitude compared to existing methods. To achieve this performance, we combined SPINNet with a coded-mask-based technique, an enhanced version of the speckle-based method. Using this scheme, we demonstrate the simultaneous reconstruction of absorption and phase images on the order of 100 ms, where a traditional correlation-based analysis would take several minutes even with a cluster. In addition to significant improvement in speed, our experimental results show that the imaging and phase retrieval quality of SPINNet outperform existing single-shot speckle-based methods. Furthermore, we successfully demonstrate SPINNet application in x-ray optics metrology and 3D x-ray phase-contrast tomography. Our result shows that SPINNet could enable many applications requiring high-resolution and fast data acquisition and processing, such as in situ and in operando 2D and 3D phase-contrast imaging and real-time at-wavelength metrology and wavefront sensing.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An Evaluation of Three Dimensional Scene Reconstruction Tools for Safeguards Applications

Over the past 5 years, advances in digital imaging and image processing have enabled everyday computing hardware, such as that found on laptops and even phones, to easily create 3D models of scenes from a series of still images. This field is broadly known as photogrammetry. For safeguards applications, a safeguards inspector could evaluate a 3D model of a facility (such as an enrichment plant or the top of a reactor) constructed from multiple photos instead of reviewing each photo individually. This report compares the detailed capabilities of a particular commercial offering (Quidient) that Oak Ridge National Laboratory (ORNL) has investigated in depth with the general capabilities provided in the industry and recommends areas where the general technology could be pursued for potential safeguards applications.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2020

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials (Second Annual Progress Report)

Additive manufacturing (AM) is an emerging method for cost-efficient fabrication of nuclear reactor parts. AM of metallic structures for nuclear energy applications is currently based on laser powder bed fusion (LPBF) process, which can introduce internal material flaws, such as pores and anisotropy. Integrity of AM structures needs to be evaluated nondestructively because material flaws could lead to premature failures due to exposure to high temperature, radiation and corrosive environment in a nuclear reactor. Thermal tomography (TT) provides a capability for non-destructive evaluation of sub-surface defects in arbitrary size structures. Thermal tomography is a computational method for heat diffusion-based imaging of solids, which provides 3D visualization of data from flash thermography measurements. We investigate thermal tomography imaging and nondestructive evaluation of stainless steel and nickel super alloy metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing (AM) process. Metallic structures produced with LPBF contain defects, and there are limited capabilities to evaluate these structures non-destructively. Thermal tomography reconstruction of 3D apparent spatial effusivity provides information about AM structure geometry and internal material flaws. We study performance of thermal tomography in imaging of metallic structures through COMSOL computer simulations of transient heat transfer, and through reconstruction of data obtained from experimental measurements. Reconstruction of internal defects is investigated using a stainless steel 316L specimen with flat bottom hole (FBH) indentations, and Inconel 718 plate produced with laser powder bed fusion (LPBF) method, which contains imprinted hemispherical shape low density regions containing non-sintered metallic powder. The FBH’s have the same sizes as the imprinted defects in the LPBF specimens, but offer better imaging contrast. Thermal tomography reconstructions provide visualizations of internal defects, and allow for estimation of their sizes and locations. Detection sensitivity of TT is limited by noises. We investigate separation of signal from noise in thermography images using several machine learning (ML) methods, including new spatio-temporal blind source separation (STBSS) and spatio-temporal sparse dictionary learning (STSDL) methods. Performance of the ML methods is benchmarked using thermography data obtained from imaging stainless steel 316L and Inconel 718 specimens produced LPBF method with imprinted calibrated porosity defects. The ML methods are ranked by F-score and execution runtime. Finally, we investigate TT of AM stainless steel 316L specimen with imprinted internal porosity defects using relatively low-cost, small form factor infrared (IR) camera based on uncooled micro bolometer detector. Sparse coding related K-means singular value decomposition (SVD) machine learning, image processing algorithms are developed to improve quality of TT images through removal of Additive white Gaussian noise without blurring the images. Following initial qualification of an AM component for deployment in a nuclear reactor, a compact TT can also be used for in-service nondestructive evaluation (NDE). With capability to perform in-service NDE of the AM component lifecycle, TT data can be used for development of a component digital twin.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

CSAPR2 Optimized Convective Cell Tracking Data during TRACER

One of the challenges in analyzing convective cell properties is to observe the quick evolution of individual convective cells. While the operational radar data provide a volumetric data set to analyze radar observables of convective precipitation clouds, previous studies also suggested the quick evolution of cell life cycle that might not be captured by conventional radar volume scan strategies that take ~5-7 minutes. Aiming at enhancing our understanding of the links between convective cloud kinematic and microphysical processes as well as life cycles, the Tracking Aerosol Convection Interactions ExpeRiment (TRACER; Jensen et al. 2019) was conducted at Houston, Texas, in 2022. The TRACER campaign deployed the 2nd generation C-band Scanning ARM Precipitation Radar (CSAPR2), which performed frequent updates of range height indicator (RHI) and sector plan position indicator (PPI) scans to track individual convective cells every < 2 minutes, guided by a new cell tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. We provide the processed CSAPR2 cell tracking data in CfRadial format collected during the TRACER field campaign from June to September 2022. The data files include processed radar variables: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification. Figure 1 provides an example of a 3D image of CSAPR2 reflectivity from the lowest PPI scan and an RHI scan after data processing.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Anatomy of an agricultural antagonist: Feeding complex structure and function of three xylem sap‐feeding insects illuminated with synchrotron‐based 3D imaging

Abstract Many insects feed on xylem or phloem sap of vascular plants. Although physical damage to the plant is minimal, the process of insect feeding can transmit lethal viruses and bacterial pathogens. Disparities between insect‐mediated pathogen transmission efficiency have been identified among xylem sap‐feeding insects; however, the mechanistic drivers of these trends are unclear. Identifying and understanding the structural factors and associated integrated functional components that may ultimately determine these disparities are critical for managing plant diseases. Here, we applied synchrotron‐based X‐ray microcomputed tomography to digitally reconstruct the morphology of three xylem sap‐feeding insect vectors of plant pathogens: Graphocephala atropunctata (blue‐green sharpshooter; Hemiptera, Cicadellidae) and Homalodisca vitripennis (glassy‐winged sharpshooter; Hemiptera, Cicadellidae), and the spittlebug Philaenus spumarius (meadow spittlebug; Hemiptera, Aphrophoridae). The application of this technique revealed previously undescribed anatomical features of these organisms, such as key components of the salivary complex. The visualization of the 3D structure of the precibarial valve led to new insights into the mechanism of how this structure functions. Morphological disparities with functional implications between taxa were highlighted as well, including the morphology and volume of the cibarial dilator musculature responsible for extracting xylem sap, which has implications for force application capabilities. These morphological insights will be used to target analyses illuminating functional differences in feeding behavior.

3D imaging↗
DOE OSTI2021

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
NASA NTRS2003

Automated Serial Sectioning for 3D Reconstruction

Some aspects of an apparatus and method for automated serial sectioning of a specimen of a solder, aluminum, or other relatively soft opaque material are discussed. The apparatus includes a small milling machine (micromiller) that takes precise, shallow cuts (increments of depth as small as 1 micron) to expose successive sections. A microscope equipped with an electronic camera, mounted in a fixed position on the micromiller, takes pictures of the newly exposed specimen surface at each increment of depth. The images are digitized, and the resulting data are subsequently processed to reconstruct three-dimensional (3D) features of the specimen.

Alkemper, Jen↗
DOE OSTI2020

High Speed In-situ X-ray Imaging of 3D Freeze Printing of Aerogels

3D freeze printing (3DFP) combines drop-on-demand (DOD) inkjet printing with freeze casting to fabricate lightweight and multifunctional aerogels with customized geometries. Freeze casting is an efficient and easily implemented method capable of fabricating porous, sponge-like structures for many different applications. This process enables tailoring the microstructure of the final product (i.e., pore morphology, alignment, average size distribution, etc.) by controlling the fabrication conditions and freezing kinetics. Furthermore, its combination with DOD printing provides the capability of engineering the macrostructure without relying on a mold as reported for 3D freeze-printed aerogels made from graphene, silver nanowires, and other nanocomposites. In this paper, we performed in-situ X-ray imaging to understand the inside process dynamics in 3DFP using a commercially available colloidal silica ink. We investigated the 3DFP process with the following hierarchy: first, single droplets; then, uniform lines obtained from coalescence of droplets; and finally, three consecutive lines deposited layer by layer. With the help of X-ray imaging, the importance of the balance between material deposition and freezing rates was shown in-situ by the observation inside of the freeze front following the tip of the printed line. The effects of the substrate temperature on the elimination of undesired interfacial boundaries were also shown by the observed ice crystals penetrating from lower to upper layer.

36 MATERIALS SCIENCE↗
DOE OSTI2021

End-to-end orientation estimation from 2D cryo-EM1images

Cryo-electron microscopy (cryo-EM) is a Nobel Prize-winning technique for deter-mining high-resolution 3D structures of biological macromolecules. A 3D structure is reconstructed from hundreds of thousands of noisy 2D projection images. However, existing 3D reconstruction methods are still time-consuming, and one of the major computational bottlenecks is to recover the unknown orientation of the particle in16each 2D image. The dominant methods typically exploit expensive global search on each image to estimate the missing orientations. Here, a novel end-to-end supervised learning method is introduced to directly recover the missing orientations from 2D cryo-EM images. A neural network is used to approximate the mapping from images to orientations. Furthermore, a robust loss function is proposed for optimizing the parameters of the network, which can handle both asymmetric and symmetric 3D structures. Experiments on synthetic datasets with various symmetry types confirm that the neural network is capable of recovering orientations from 2D cryo-EM images, and the results on one real cryo-EM dataset further demonstrate its potential in more challenging imaging conditions.

3D reconstruction↗
NASA NTRS2013

Applications of Automation Methods for Nonlinear Fracture Test Analysis

Using automated and standardized computer tools to calculate the pertinent test result values has several advantages such as: 1. allowing high-fidelity solutions to complex nonlinear phenomena that would be impractical to express in written equation form, 2. eliminating errors associated with the interpretation and programing of analysis procedures from the text of test standards, 3. lessening the need for expertise in the areas of solid mechanics, fracture mechanics, numerical methods, and/or finite element modeling, to achieve sound results, 4. and providing one computer tool and/or one set of solutions for all users for a more "standardized" answer. In summary, this approach allows a non-expert with rudimentary training to get the best practical solution based on the latest understanding with minimum difficulty.Other existing ASTM standards that cover complicated phenomena use standard computer programs: 1. ASTM C1340/C1340M-10- Standard Practice for Estimation of Heat Gain or Loss Through Ceilings Under Attics Containing Radiant Barriers by Use of a Computer Program 2. ASTM F 2815 - Standard Practice for Chemical Permeation through Protective Clothing Materials: Testing Data Analysis by Use of a Computer Program 3. ASTM E2807 - Standard Specification for 3D Imaging Data Exchange, Version 1.0 The verification, validation, and round-robin processes required of a computer tool closely parallel the methods that are used to ensure the solution validity for equations included in test standard. The use of automated analysis tools allows the creation and practical implementation of advanced fracture mechanics test standards that capture the physics of a nonlinear fracture mechanics problem without adding undue burden or expense to the user. The presented approach forms a bridge between the equation-based fracture testing standards of today and the next generation of standards solving complex problems through analysis automation.

Allen, Phillip A.↗