Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

Oak Ridge National Laboratory’s (ORNL) Manufacturing Demonstration Facility (MDF) worked with EOS Group to evaluate the current in-situ sensor capabilities of an EOS M290 Laser Powder Bed Fusion machine. The M290 was fitted with a 1 Mega-Pixel (MP) grayscale visible-light camera and a 5 MP temporally integrated (TI) near-infrared (NIR) camera. One print from stainless steel (SS) 316 and two from Inconel 625 (IN625) were performed where data including in-situ imaging and a machine log file were captured. These data were subsequently analyzed using a Dynamic Multi-Scale Segmentation Convolutional Neural Network (DMSCNN) trained on user defined classes and correlated to as-printed flaws, in the form of porosity, discovered in X-Ray Computed Tomography (XCT). In Phase I, two indications were detected in-situ and spatially correlated to stochastic lack-of-fusion flaws discovered using XCT. In Phase II, using these links from in-situ signatures to XCT flaw populations, a second neural network (NN) was trained to create a Voxelized Property Prediction Model (VPPM) to predict porosity percentages within the part using only features garnered from the in-situ data from two IN625 complex geometries. The VPPM was able to accurately predict porosity values for IN625 parts with an R 2 value of 0.764.

36 MATERIALS SCIENCE↗

3D reconstruction identifies loci linked to variation in angle of individual sorghum leaves

Selection for yield at high planting density has reshaped the leaf canopy of maize, improving photosynthetic productivity in high density settings. Further optimization of canopy architecture may be possible. However, measuring leaf angles, the widely studied component trait of leaf canopy architecture, by hand is a labor and time intensive process. Here, we use multiple, calibrated, 2D images to reconstruct the 3D geometry of individual sorghum plants using a voxel carving based algorithm. Automatic skeletonization and segmentation of these 3D geometries enable quantification of the angle of each leaf for each plant. The resulting measurements are both heritable and correlated with manually collected leaf angles. This automated and scaleable reconstruction approach was employed to measure leaf-by-leaf angles for a population of 366 sorghum plants at multiple time points, resulting in 971 successful reconstructions and 3,376 leaf angle measurements from individual leaves. A genome wide association study conducted using aggregated leaf angle data identified a known large effect leaf angle gene, several previously identified leaf angle QTL from a sorghum NAM population, and novel signals. Genome wide association studies conducted separately for three individual sorghum leaves identified a number of the same signals, a previously unreported signal shared across multiple leaves, and signals near the sorghum orthologs of two maize genes known to influence leaf angle. Automated measurement of individual leaves and mapping variants associated with leaf angle reduce the barriers to engineering ideal canopy architectures in sorghum and other grain crops.

3D reconstruction↗

Nighttime observations of thunderstorm electrical activity from a high altitude airplane

Photographs from a NASA U-2 airplane flying over nocturnal thunderstorms show frequent lightning activity in the upper part of the cloud. In some cases, unobscured segments of lightning channels 1 km or longer are visible in clear air around and above the cloud. Multiple images of lightning channels indicate multiple discharges in the same channel. Photographs taken through a diffraction grating show that the lightning has a spectrum similar to that observed in the lower troposphere. Lightning spectra obtained with a slitless line-scan spectrometer show strong singly ionized nitrogen emissions at 463.0 and 500.5 nm. Field changes measured with an electric field-change meter correlate with pulses measured with a photocell optical system. Optical signals corresponding to dart leader, return stroke, and continuing current events are readily distinguished in the scattered light emerging from the cloud surface. The variation of light intensity with time in lightning events is consistent with predicted modification of optical lightning signals by clouds. It appears that satellite based optical sensor measurements cannot provide reliable information on current rise times in return strokes. On the other hand, discrimination between cloud-to-ground and intracloud flashes and the counting of ground strokes is possible using the optical pulse pairs which have been identified with leader, return-stroke events in the cloud-to-ground flashes studied.

Brook, M.↗

Advanced technology optical telescopes IV; Proceedings of the Meeting, Tucson, AZ, Feb. 12-16, 1990. Parts 1 & 2

The present conference on the current status of large, advanced-technology optical telescope development and construction projects discusses topics on such factors as their novel optical system designs, the use of phased arrays, seeing and site performance factors, mirror fabrication and testing, pointing and tracking techniques, mirror thermal control, structural design strategies, mirror supports and coatings, and the control of segmented mirrors. Attention is given to the proposed implementation of the VLT Interferometer, the first diffraction-limited astronomical images with adaptive optics, a fiber-optic telescope using a large cross-section image-transmitting bundle, the design of wide-field arrays, Hartmann test data reductions, liquid mirrors, inertial drives for telescope pointing, temperature control of large honeycomb mirrors, evaporative coatings for very large telescope mirrors, and the W. M. Keck telescope's primary mirror active control system software.

Barr, Lawrence D.↗

High-resolution CCD imagers using area-array CCD's for sensing spectral components of an optical line image

CCD imagers with a novel replicated-line-imager architecture are abutted to form an extended line sensor. The sensor is preceded by optics having a slit aperture and having an optical beam splitter or astigmatic lens for projecting multiple line images through an optical color-discriminating stripe filter to the CCD imagers. A very high resolution camera suitable for use in a satellite, for example, is thus provided. The replicated-line architecture of the imager comprises an area-array CCD, successive rows of which are illuminated by replications of the same line segment, as transmitted by respective color filter stripes. The charge packets formed by accumulation of photoresponsive charge in the area-array CCD are read out row by row. Each successive row of charge packets is then converted from parallel to serial format in a CCD line register and its amplitude sensed to generate a line of output signal.

Elabd, Hammam↗

Concept of Operations for OSIRIS-REx Optical Navigation Image Planning

Optical navigation (OpNav) is a critical subsystem of the OSIRIS-REx asteroid sample return mission, which operated in the vicinity of near-Earth asteroid (101955) Bennu from August 2018 through April 2021. A substantial amount of mission resources across multiple subsystems and institutions is required to ensure that the OpNav data are successfully acquired. The KinetX OpNav team, part of the Flight Dynamics System (FDS), is responsible for performing required analysis to develop the OpNav operations plans; requesting, reviewing and verifying the plans; and ultimately using the image data for critical navigation operations. The FDS team, responsible for the mission navigation, is operated by KinetX Aerospace with management and operations support from NASA’s Goddard Space Flight Center. The Science Processing and Operations Center (SPOC), located at the University of Arizona’s Lunar and Planetary Laboratory, is responsible for generating the planning products for all science and most OpNav data. These plans are integrated into the spacecraft sequences, tested, and commanded by the Mission Support Area (MSA) at Lockheed Martin Space. To ensure mission-critical navigation image data are successfully acquired, the plan is developed through a waterfall of planning cycles over the course of 3 months prior to onboard plan execution. During the initial strategic planning for a mission phase, detailed analysis is performed by the OpNav team to conceptualize the concept of operations (ConOps) for image data collection. This phase OpNav Narrative is included along with other strategic planning documents for the key ground segment stakeholders to review and provide feedback. The detailed OpNav plans get defined in the tactical planning cycle, which spans 8 to 3 weeks before the week-long integrated sequence is executed on-board the spacecraft. During the tactical cycle, the initial OpNav Request is submitted along with the science requests, kicking off development of the science and OpNav plans. Once the initial plan is drafted, interfaces are exercised so that the plan can be reviewed and iterated, if necessary. A rigorous schedule is followed by the planning teams during the implementation cycle, spanning the last 18 days before uplink, to ensure all the necessary integration, testing, and reviewing can occur on time. The development of the OpNav planning ConOps, including responsibilities, interfaces, timelines, and procedures, took extensive collaboration across mission elements and institutions. The process was robust throughout the 137 weeks of continuous Optical Navigation Operations at Bennu, which concluded on April 9th, 2021.

Coralie D. Adam↗

Introduction to Image-Based Wavefront Sensing

The James Webb Space Telescope (JWST) is easily one of the most advanced devices ever created by humans, bridging a gap between the macroscopic and quantum worlds in terms of how accurately we can align mirrors. It is the product of exhaustive testing, countless innovations, and the international collaboration between 1000’s of people working tirelessly for more than 20 years. In this talk we discuss the physics of image-based wavefront sensing: one of the core technologies that was utilized to complete the final alignment of the segmented mirror.

Wavefront Sensing↗

Three-dimensional reconstruction and morphologic characteristics of porous metal fiber sintered sheet

This paper presents an approach to achieve morphological characterizing for complex porous materials based on micro X-ray tomography images, with an example of a novel porous metal fiber sheet produced through solid-state sintering method. The geometrical reconstruction was performed after selection of volume of interest and image processing of anisotropic diffusion smooth. The reconstructed gray level images were then transferred into binary images by adjusting binarization threshold according to the actual porosity. Taking into account the tubular structural feature of the fibers, skeleton extraction algorithm based on the distance transform function was applied and further improved by the scale axis transform method. The skeleton was later pruned and segmented according to the contact points to perform morphological characterizing. Compared with actual manufacturing parameters, the style, length, radius, orientation and tortuosity of fiber segments were discussed. The results show that our proposed method can well describe the actual geometrical and morphological characteristics, which will provide a promising method for the structural description of fibrous networks. - Highlights: • Micro-CT technology was used to achieve the 3D geometrical reconstruction. • Skeleton extraction algorithm was modified to get the medial skeleton. • Skeleton filter operation was adopted to deal with the segmented skeleton. • Useful morphological statistics was obtained through skeleton segments. • Relationship between structure and manufacturing processes was discussed.

36 MATERIALS SCIENCE↗

A novel computer-aided lung nodule detection system for CT images

Purpose: The paper presents a complete computer-aided detection (CAD) system for the detection of lung nodules in computed tomography images. A new mixed feature selection and classification methodology is applied for the first time on a difficult medical image analysis problem. Methods: The CAD system was trained and tested on images from the publicly available Lung Image Database Consortium (LIDC) on the National Cancer Institute website. The detection stage of the system consists of a nodule segmentation method based on nodule and vessel enhancement filters and a computed divergence feature to locate the centers of the nodule clusters. In the subsequent classification stage, invariant features, defined on a gauge coordinates system, are used to differentiate between real nodules and some forms of blood vessels that are easily generating false positive detections. The performance of the novel feature-selective classifier based on genetic algorithms and artificial neural networks (ANNs) is compared with that of two other established classifiers, namely, support vector machines (SVMs) and fixed-topology neural networks. A set of 235 randomly selected cases from the LIDC database was used to train the CAD system. The system has been tested on 125 independent cases from the LIDC database. Results: The overall performance of the fixed-topology ANN classifier slightly exceeds that of the other classifiers, provided the number of internal ANN nodes is chosen well. Making educated guesses about the number of internal ANN nodes is not needed in the new feature-selective classifier, and therefore this classifier remains interesting due to its flexibility and adaptability to the complexity of the classification problem to be solved. Our fixed-topology ANN classifier with 11 hidden nodes reaches a detection sensitivity of 87.5% with an average of four false positives per scan, for nodules with diameter greater than or equal to 3 mm. Analysis of the false positive items reveals that a considerable proportion (18%) of them are smaller nodules, less than 3 mm in diameter. Conclusions: A complete CAD system incorporating novel features is presented, and its performance with three separate classifiers is compared and analyzed. The overall performance of our CAD system equipped with any of the three classifiers is well with respect to other methods described in literature.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Wavefront Controls for a Large Submillimeter-Wave Observatory

The 25-m aperture Cornell Caltech Atacama Telescope (CCAT) will have a primary mirror that is divided into 162 individual segments, each of which is equipped with 3 positioning actuators. This paper presents a mathematical description of the telescope, its actuators and sensors, and uses it to derive control laws for figure maintenance. A Kalman Filter-based Optical State Estimator is used to continuously estimate the aberrations of the telescope; these are used in a state-feedback controller to maintain image quality. This approach provides the means to correct for the optical effects of errors that occur in unactuated degrees of freedom, such as lateral translations of the segments. The control laws are exercised in Monte Carlo and covariance analysis, to bound the closed-loop performance of the telescope and to conduct control design trades.

edge sensors↗

Normalized Noise Power Spectrum of Full Field Digital Mammography System

A method to measure noise power spectrum of a full field digital mammography system is presented. The effect of X-ray radiation dose, size and configuration of region of interest on normalized noise power spectrum (NNPS) was investigated. Flat field images were acquired using RQA-M2 beam quality technique (Mo/Mo anode-filter, 28 kV, 2 mm Al) with different clinical radiation doses. The images were cropped at about 4 cm from the edge of the breast wall and then divided into different size of non-overlapping or overlapping segments. NNPS was determined through detrending, 2-D fast Fourier transformation and normalization. Our measurement shows that high radiation dose gave lower NNPS at a specific beam quality.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Panel-Segmentation: A Python Package for Automated Solar Array Metadata Extraction Using Satellite Imagery

The NREL Python Panel-Segmentation package is a toolkit that automates the process of extracting accurate and valuable metadata related to solar array installations, using publicly available Google Maps satellite imagery. Previously published work includes automated azimuth estimation for individual solar installations in satellite images. Our continued research focuses on automated detection and classification of solar installation mounting configuration (tracking or fixed-tilt; rooftop, ground, or carport). Specifically, a Faster-RCNN Resnet-50 feature pyramid network (FPN) model was trained and validated on 862 manually labeled satellite images. This model was used to perform object detection on satellite imagery, locating and classifying individual solar installations' mounting configuration and type. Model results showed a mean average precision score (mAP) of 77.79%, with the model strongest at detecting fixed-tilt ground mount and fixed-tilt carport installations. The object detection model and its outputs have been incorporated into the Panel-Segmentation package's automated metadata extraction pipeline, which returns the mounting configuration and azimuth for individual solar arrays in satellite imagery. The complete image data set with labels has been released on the U.S. Department of Energy (DOE) DuraMAT DataHub, to encourage further research in this area.

deep learning↗

Characterization of tissue magnetic susceptibility-induced distortions for MRIgRT

Purpose: MR image geometric integrity is one of the building blocks of MRI-guided radiotherapy. In particular, tissue magnetic susceptibility-induced effects are patient-dependent and their behavior is difficult to assess and predict. In this study, the authors investigated in detail the characteristics of susceptibility ({chi}) distortions in the context of MRIgRT, including the case of two common MR-linac system configurations. Methods: The magnetic field distortions were numerically simulated for several imaging parameters and anatomical sites, i.e., brain, lung, pelvis (with air pockets), and prostate. The simulation process consisted of (a) segmentation of patient CT data into susceptibility relevant anatomical volumes (i.e., soft-tissue, bone and air/lung), (b) conversion of CT data into susceptibility masks by assigning bulk {chi} values to the structures defined at (a), (c) numerical computations of the local magnetic fields by using a finite difference algorithm, and (d) generation of the geometric distortion maps from the magnetic field distributions. For each patient anatomy, the distortions were quantified at the interfaces of anatomical structures with significantly different {chi} values. The analysis was performed for two specific orientations of the external main magnetic field (B{sub 0}) characteristic to the MR-linac systems, specifically along the z-axis for a bore MR scanner and in the (x,y)-plane for a biplanner magnet. The magnetic field local perturbations were reported in ppm. The metrics used to quantify the geometric distortions were the maximum, mean, and range of distortions. The numerical simulation algorithm was validated using phantom data measurements. Results: Susceptibility-induced distortions were determined for both quadratic and patient specific geometries. The numerical simulations showed a good agreement with the experimental data. The measurements were acquired at 1.5 and 3 T and with an encoding gradient varying between 3 and 20 mT/m by using an annular phantom mimicking the water-air and water-oil {chi} interfaces. For quadratic geometries, the magnitude of field distortion increased rapidly with the size of the inhomogeneity up to about 10 mm and then tended to plateau. This trend became more evident for materials with a larger {Delta}{chi} relative to water. The simulations showed only a slight increase in the maximum distortion values when the B{sub 0} orientation was varied with regard to the shape of the {chi} inhomogeneity. In the case of patient anatomy, the largest distortion values arose at the air-soft-tissue interface. Considering the two MR-linac system configurations and comparing the field distortion values corresponding to all organ structures, the distortions tended to be larger for the biplanar magnet. The authors provide a reference table with ppm values which can be used to easily evaluate the geometric distortions for patient data as a function of B{sub 0} and the strength of the encoding gradient. Conclusions: The susceptibility distortions were quantified as a function of multiple parameters such as the {chi} inhomogeneity size and shape, the magnitude of B{sub 0} and the readout gradient, and the orientation of B{sub 0} with respect to the sample geometry. The analysis was performed for several anatomical sites and corresponding to two B{sub 0} orientations as featured by MR-linac systems.

60 APPLIED LIFE SCIENCES↗

An efficient instance segmentation approach for studying fission gas bubbles in irradiated metallic nuclear fuel

Abstract Gaseous fission products from nuclear fission reactions tend to form fission gas bubbles of various shapes and sizes inside nuclear fuel. The behavior of fission gas bubbles dictates nuclear fuel performances, such as fission gas release, grain growth, swelling, and fuel cladding mechanical interaction. Although mechanical understanding of the overall evolution behavior of fission gas bubbles is well known, lacking the quantitative data and high-level correlation between burnup/temperature and microstructure evolution blocks the development of predictive models and reduces the possibility of accelerating the qualification for new fuel forms. Historical characterization of fission gas bubbles in irradiated nuclear fuel relied on a simple threshold method working on low-resolution optical microscopy images. Advanced characterization of fission gas bubbles using scanning electron microscopic images reveals unprecedented details and extensive morphological data, which strains the effectiveness of conventional methods. This paper proposes a hybrid framework, based on digital image processing and deep learning models, to efficiently detect and classify fission gas bubbles from scanning electron microscopic images. The developed bubble annotation tool used a multitask deep learning network that integrates U-Net and ResNet to accomplish instance-level bubble segmentation. With limited annotated data, the model achieves a recall ratio of more than 90%, a leap forward compared to the threshold method. The model has the capability to identify fission gas bubbles with and without lanthanides to better understand the movement of lanthanide fission products and fuel cladding chemical interaction. Lastly, the deep learning model is versatile and applicable to the micro-structure segmentation of similar materials.

36 MATERIALS SCIENCE↗

WE-AB-204-03: A Novel 3D Printed Phantom for 4D PET/CT Imaging and SIB Radiotherapy Verification

Purpose: To construct and test a 3D printed phantom designed to mimic variable PET tracer uptake seen in lung tumor volumes. To assess segmentation accuracy of sub-volumes of the phantom following 4D PET/CT scanning with ideal and patient-specific respiratory motion. To plan, deliver and verify delivery of PET-driven, gated, simultaneous integrated boost (SIB) radiotherapy plans. Methods: A set of phantoms and inserts were designed and manufactured for a realistic representation of lung cancer gated radiotherapy steps from 4D PET/CT scanning to dose delivery. A cylindrical phantom (40x 120 mm) holds inserts for PET/CT scanning. The novel 3D printed insert dedicated to 4D PET/CT mimics high PET tracer uptake in the core and lower uptake in the periphery. This insert is a variable density porous cylinder (22.12×70 mm), ABS-P430 thermoplastic, 3D printed by uPrint SE Plus with inner void volume (5.5×42 mm). The square pores (1.8×1.8 mm2 each) fill 50% of outer volume, resulting in a 2:1 SUV ratio of PET-tracer in the void volume with respect to porous volume. A matching in size cylindrical phantom is dedicated to validate gated radiotherapy. It contains eight peripheral holes matching the location of the porous part of the 3D printed insert, and one central hole. These holes accommodate adaptors for Farmer-type ion chamber and cells vials. Results: End-to-end test were performed from 4D PET/CT scanning to transferring data to the planning system and target volume delineation. 4D PET/CT scans were acquired of the phantom with different respiratory motion patterns and gating windows. A measured 2:1 18F-FDG SUV ratio between inner void and outer volume matched the 3D printed design. Conclusion: The novel 3D printed phantom mimics variable PET tracer uptake typical of tumors. Obtained 4D PET/CT scans are suitable for segmentation, treatment planning and delivery in SIB gated treatments of NSCLC.

60 APPLIED LIFE SCIENCES↗

Exudate-based diabetic macular edema detection in fundus images using publicly available datasets

Diabetic macular edema (DME) is a common vision threatening complication of diabetic retinopathy. In a large scale screening environment DME can be assessed by detecting exudates (a type of bright lesions) in fundus images. In this work, we introduce a new methodology for diagnosis of DME using a novel set of features based on colour, wavelet decomposition and automatic lesion segmentation. These features are employed to train a classifier able to automatically diagnose DME through the presence of exudation. We present a new publicly available dataset with ground-truth data containing 169 patients from various ethnic groups and levels of DME. This and other two publicly available datasets are employed to evaluate our algorithm. We are able to achieve diagnosis performance comparable to retina experts on the MESSIDOR (an independently labelled dataset with 1200 images) with cross-dataset testing (e.g., the classifier was trained on an independent dataset and tested on MESSIDOR). Our algorithm obtained an AUC between 0.88 and 0.94 depending on the dataset/features used. Additionally, it does not need ground truth at lesion level to reject false positives and is computationally efficient, as it generates a diagnosis on an average of 4.4 s (9.3 s, considering the optic nerve localization) per image on an 2.6 GHz platform with an unoptimized Matlab implementation.

59 BASIC BIOLOGICAL SCIENCES↗

BioSig3D: High Content Screening of Three-Dimensional Cell Culture Models

BioSig3D is a computational platform for high-content screening of three-dimensional (3D) cell culture models that are imaged in full 3D volume. It provides an end-to-end solution for designing high content screening assays, based on colony organization that is derived from segmentation of nuclei in each colony. BioSig3D also enables visualization of raw and processed 3D volumetric data for quality control, and integrates advanced bioinformatics analysis. The system consists of multiple computational and annotation modules that are coupled together with a strong use of controlled vocabularies to reduce ambiguities between different users. It is a web-based system that allows users to: design an experiment by defining experimental variables, upload a large set of volumetric images into the system, analyze and visualize the dataset, and either display computed indices as a heatmap, or phenotypic subtypes for heterogeneity analysis, or download computed indices for statistical analysis or integrative biology. BioSig3D has been used to profile baseline colony formations with two experiments: (i) morphogenesis of a panel of human mammary epithelial cell lines (HMEC), and (ii) heterogeneity in colony formation using an immortalized non-transformed cell line. These experiments reveal intrinsic growth properties of well-characterized cell lines that are routinely used for biological studies. BioSig3D is being released with seed datasets and video-based documentation.

Science & Technology - Other Topics↗