Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗
DOE OSTI2012

Kilovoltage Intrafraction Monitoring for Prostate Intensity Modulated Arc Therapy: First Clinical Results

Purpose: Most linear accelerators purchased today are equipped with a gantry-mounted kilovoltage X-ray imager which is typically used for patient imaging prior to therapy. A novel application of the X-ray system is kilovoltage intrafraction monitoring (KIM), in which the 3-dimensional (3D) tumor position is determined during treatment. In this paper, we report on the first use of KIM in a prospective clinical study of prostate cancer patients undergoing intensity modulated arc therapy (IMAT). Methods and Materials: Ten prostate cancer patients with implanted fiducial markers undergoing conventionally fractionated IMAT (RapidArc) were enrolled in an ethics-approved study of KIM. KIM involves acquiring kV images as the gantry rotates around the patient during treatment. Post-treatment, markers in these images were segmented to obtain 2D positions. From the 2D positions, a maximum likelihood estimation of a probability density function was used to obtain 3D prostate trajectories. The trajectories were analyzed to determine the motion type and the percentage of time the prostate was displaced {>=}3, 5, 7, and 10 mm. Independent verification of KIM positional accuracy was performed using kV/MV triangulation. Results: KIM was performed for 268 fractions. Various prostate trajectories were observed (ie, continuous target drift, transient excursion, stable target position, persistent excursion, high-frequency excursions, and erratic behavior). For all patients, 3D displacements of {>=}3, 5, 7, and 10 mm were observed 5.6%, 2.2%, 0.7% and 0.4% of the time, respectively. The average systematic accuracy of KIM was measured at 0.46 mm. Conclusions: KIM for prostate IMAT was successfully implemented clinically for the first time. Key advantages of this method are (1) submillimeter accuracy, (2) widespread applicability, and (3) a low barrier to clinical implementation. A disadvantage is that KIM delivers additional imaging dose to the patient.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2024

Machine learning enhanced characterization and optimization of photonic cured MAPbI 3 for efficient perovskite solar cells

Photonic curing (PC) can facilitate high-speed perovskite solar cell (PSC) manufacturing because it uses high-intensity light pulses to crystallize perovskite films in milliseconds. However, optimizing PC conditions is challenging due to its many variables, and using power conversion efficiency (PCE) as the optimization metric is both time-consuming and labor-intensive. This work presents a machine learning (ML) approach to optimize PC conditions for fabricating methylammonium lead iodide (MAPbI 3 ) films by quantitatively comparing their ultraviolet-visible (UV-vis) absorbance spectra to thermal annealed (TA) films using four similarity metrics. We perform Bayesian optimization coupled with Gaussian process regression (BO-GP) to minimize the similarity metrics. Refining PC conditions using active learning based on BO-GP models, we achieve a PC MAPbI3 film with an absorbance spectrum closely matching a TA reference film, which is further verified by its crystalline and morphological properties. Thus, we demonstrate that the UV-vis absorption spectrum can accurately proxy film quality. Additionally, we use an AI-based segmentation model for a more efficient grain size analysis. However, when we use the optimized PC condition to fabricate PSCs, we find that interaction between MAPbI 3 and the hole transport layer (HTL) during PC critically degrades the PSC performance. By adding a buffer layer between the HTL and MAPbI 3 , the optimized PC PSCs produce a champion PCE of 11.8%, comparable to the TA reference of 11.7%. Using UV-vis similarity metrics instead of device PCE as the objective in our BO-GP method accelerates the optimization of PC processing conditions for MAPbI 3 films.

14 SOLAR ENERGY↗
NASA NTRS2011

Superpixel-Augmented Endmember Detection for Hyperspectral Images

Superpixels are homogeneous image regions comprised of several contiguous pixels. They are produced by shattering the image into contiguous, homogeneous regions that each cover between 20 and 100 image pixels. The segmentation aims for a many-to-one mapping from superpixels to image features; each image feature could contain several superpixels, but each superpixel occupies no more than one image feature. This conservative segmentation is relatively easy to automate in a robust fashion. Superpixel processing is related to the more general idea of improving hyperspectral analysis through spatial constraints, which can recognize subtle features at or below the level of noise by exploiting the fact that their spectral signatures are found in neighboring pixels. Recent work has explored spatial constraints for endmember extraction, showing significant advantages over techniques that ignore pixels relative positions. Methods such as AMEE (automated morphological endmember extraction) express spatial influence using fixed isometric relationships a local square window or Euclidean distance in pixel coordinates. In other words, two pixels covariances are based on their spatial proximity, but are independent of their absolute location in the scene. These isometric spatial constraints are most appropriate when spectral variation is smooth and constant over the image. Superpixels are simple to implement, efficient to compute, and are empirically effective. They can be used as a preprocessing step with any desired endmember extraction technique. Superpixels also have a solid theoretical basis in the hyperspectral linear mixing model, making them a principled approach for improving endmember extraction. Unlike existing approaches, superpixels can accommodate non-isometric covariance between image pixels (characteristic of discrete image features separated by step discontinuities). These kinds of image features are common in natural scenes. Analysts can substitute superpixels for image pixels during endmember analysis that leverages the spatial contiguity of scene features to enhance subtle spectral features. Superpixels define populations of image pixels that are independent samples from each image feature, permitting robust estimation of spectral properties, and reducing measurement noise in proportion to the area of the superpixel. This permits improved endmember extraction, and enables automated search for novel and constituent minerals in very noisy, hyperspatial images. This innovation begins with a graph-based segmentation based on the work of Felzenszwalb et al., but then expands their approach to the hyperspectral image domain with a Euclidean distance metric. Then, the mean spectrum of each segment is computed, and the resulting data cloud is used as input into sequential maximum angle convex cone (SMACC) endmember extraction.

Thompson, David R.↗
DOE OSTI2025

Bimodal Visualization of Industrial X-Ray and Neutron Computed Tomography Data

Advanced manufacturing creates increasingly complex objects with material compositions that are often difficult to characterize by a single modality. Our collaborating domain scientists are going beyond traditional methods by employing both X-ray and neutron computed tomography to obtain complementary representations expected to better resolve material boundaries. However, the use of two modalities creates its own challenges for visualization, requiring either complex adjustments of bimodal transfer functions or the need for multiple views. Together with experts in nondestructive evaluation, we designed a novel interactive bimodal visualization approach to create a combined view of the co-registered X-ray and neutron acquisitions of industrial objects. Using an automatic topological segmentation of the bivariate histogram of X-ray and neutron values as a starting point, the system provides a simple yet effective interface to easily create, explore, and adjust a bimodal visualization. Here, we propose a widget with simple brushing interactions that enables the user to quickly correct the segmented histogram results. Our semiautomated system enables domain experts to intuitively explore large bimodal datasets without the need for either advanced segmentation algorithms or knowledge of visualization techniques. We demonstrate our approach using synthetic examples, industrial phantom objects created to stress bimodal scanning techniques, and real-world objects, and we discuss expert feedback.

image segmentation↗
NASA NTRS1999

Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83-0.97) and William's index values (range 0.37-0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.

NASA Discipline Cardiopulmonary↗
DOE OSTI2018

Superpixels for improved structure and terrain classification using multiple synthetic aperture radar image products

Various embodiments presented herein relate to assigning labels to segments of a synthetic aperture radar (SAR) image, where the segments are based upon a speckle-reduced SAR image product. A plurality of SAR images of a scene are co-registered to form a registered stack of SAR images. A speckle-reduced SAR image product is generated based upon at least one registered SAR image in the registered stack of SAR images. The speckle-reduced SAR image product is segmented into a plurality of superpixels, and boundaries of the superpixels are applied to the at least one registered SAR image to form a segmented SAR image. A segment of the SAR image is then labeled as including or not including a feature, wherein the label is assigned based upon values of pixels in the segment.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Contour interpolated radial basis functions with spline boundary correction for fast 3D reconstruction of the human articular cartilage from MR images

Purpose: The aim of this work is to demonstrate a new image processing technique that can provide a “near real-time” 3D reconstruction of the articular cartilage of the human knee from MR images which is user friendly. This would serve as a point-of-care 3D visualization tool which would benefit a consultant radiologist in the visualization of the human articular cartilage. Methods: The authors introduce a novel fusion of an adaptation of the contour method known as “contour interpolation (CI)” with radial basis functions (RBFs) which they describe as “CI-RBFs.” The authors also present a spline boundary correction which further enhances volume estimation of the method. A subject cohort consisting of 17 right nonpathological knees (ten female and seven male) is assessed to validate the quality of the proposed method. The authors demonstrate how the CI-RBF method dramatically reduces the number of data points required for fitting an implicit surface to the entire cartilage, thus, significantly improving the speed of reconstruction over the comparable RBF reconstruction method of Carr. The authors compare the CI-RBF method volume estimation to a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Results: The authors demonstrate how the CI-RBF method significantly reduces the number of data points (p-value < 0.0001) required for fitting an implicit surface to the cartilage, by 48%, 31%, and 44% for the patellar, tibial, and femoral cartilages, respectively. Thus, significantly improving the speed of reconstruction (p-value < 0.0001) by 39%, 40%, and 44% for the patellar, tibial, and femoral cartilages over the comparable RBF model of Carr providing a near real-time reconstruction of 6.49, 8.88, and 9.43 min for the patellar, tibial, and femoral cartilages, respectively. In addition, it is demonstrated how the CI-RBF method matches the volume estimation of a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Furthermore, the performance of the segmentation method used for the extraction of the femoral, tibial, and patellar cartilages is assessed with a Dice similarity coefficient, sensitivity, and specificity measure providing high agreement to manual segmentation. Conclusions: The CI-RBF method provides a fast, accurate, and robust 3D model reconstruction that matches Carr’s RBF method, 3D DOCTOR, and a manual benchmark method in accuracy and significantly improves upon Carr’s RBF method in data requirement and computational speed. In addition, the visualization tool has been designed to quickly segment MR images requiring only four mouse clicks per MR image slice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2014

TU-A-12A-10: Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation

Purpose: Recent advances in medical imaging technologies provide opportunities to quantify the tumor phenotype throughout the course of treatment non-invasively. The emerging field of Radiomics addresses this by converting medical images into minable data by applying a large number of quantitative imaging algorithms. Accurate tumor segmentation is one of the main challenges of Radiomics. It has been shown that semiautomatic segmentation approaches efficiently reduce inter-observer variability as compared to the time consuming manual delineations. In this study, a semiautomatic volumetric segmentation algorithm, implemented in the free and publicly available 3D-Slicer platform, was investigated in terms of its robustness for Radiomics features quantification. Methods: Fifty-six 3D-Radiomics features, quantifying phenotypic differences based on the tumor intensity, shape and texture, were extracted from the computed tomography images of twenty lung cancer patients. These Radiomics features were derived from the 3D-tumor volumes defined by three independent observers twice using 3D-Slicer, and compared to manual slice-by-slice delineations of five independent physicians in terms of intra-class correlation coefficient (ICC) and feature range. Results: Radiomics features extracted from 3D-Slicer segmentations had significantly higher reproducibility (ICC= 0.85 0.15, p=0.0009) compared to the features extracted from the manual segmentations (ICC= 0.77 0.17). Furthermore, the features extracted from 3D-Slicer based segmentations, spread over significantly smaller range across observers as compared to those of the manual delineations (p= 3.819e-07). Moreover, the features derived from 3D-Slicer segmentations overlapped in range with those of the manual delineations, as the lower(higher) limit(s) being significantly higher(lower) for the 3D-Slicer features (p= 0.007, p= 5.863e-06). Conclusion: 3D-Slicer based semiautomatic segmentation significantly improves the robustness of radiomics features and thus could serve as a potential alternative to the time consuming manual segmentation process. So 3D-Slicer can have a large application in Radiomics, and be employed for high-throughput data mining research of medical imaging in clinical oncology.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

L-PBF High-Throughput Data Pipeline Approach for Multi-modal Integration

Abstract Metal-based additive manufacturing requires active monitoring solutions for assessing part quality. Multiple sensors and data streams, however, generate large heterogeneous data sets that are impractical for manual assessment and characterization. In this work, an automated pipeline is developed that enables feature extraction from high-speed camera video and multi-modal data analysis. The framework removes the need for manual assessment through the utilization of deep learning techniques and training models in a weakly supervised paradigm. We demonstrate this pipeline’s capability over 700,000 high-speed camera frames. The pipeline successfully extracts melt pool and spatter geometries and links them to corresponding pyrometry, radiography, and processparameter information. 715 individual prints are examined to reveal melt pool areas that exceeds 0.07 mm 2 and pyrometry signal over a threshold (375 pyrometry units) were more likely to have defects. These automated processes enable massive throughput of characterization techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Unveiling the interaction of nanopatterned void superlattices with irradiation cascades

Nanopatterned microstructures in materials can have a profound impact on materials’ physical and chemical properties. While voids are typically considered as detrimental defects in irradiated materials, the patterning of nanoscale voids causes the formation of void superlattices and provides a highly efficient mechanism for gas storage. Despite the important applications of nanopatterned defect superlattices, how they degrade under irradiation remains unclear. Here we provide direct observation of the evolution of void superlattices under irradiation and elucidate the interaction of void superlattices with irradiation cascades. We reveal that the instability of void superlattices under irradiation is caused by heterogenous void shrinkage and demonstrate the imperative role of mixed 1D/3D diffusion of self-interstitial atoms and injected inert gas atoms on void shrinkage and void superlattice instability. Understanding the degradation mechanisms of nanopatterned microstructures is essential to designing damage-tolerant materials and broadening their applications in extreme environments.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A machine learning pipeline for identifying infiltration managed aquifer recharge locations from satellite imagery in the San Joaquin Valley, California

This study focuses on an agricultural region in California’s Central Valley, USA, where Managed Aquifer Recharge (MAR) is widely implemented to mitigate groundwater depletion under increasing water demand and climate variability. A deep learning and machine learning framework was developed to identify infiltration-MAR locations using satellite imagery and environmental data. The framework integrates surface water detection from Sentinel-2 imagery, geospatial delineation of water bodies, spatiotemporal tracking of water body dynamics, and supervised classification using meteorological, environmental, and topographic variables. The framework was applied to a 2379 km² study area southwest of Fresno, where 765 water bodies were detected, including 139 identified MAR sites based on publicly available datasets and expert knowledge. The classification model achieved an accuracy of 0.94 and an F1 score of 0.85. Feature importance analysis indicates that cropland, normalized difference vegetation index (NDVI), and evaporation are among the most influential predictors for infiltration-MAR. Notably, the framework suggests that engineered water management in infiltration-MAR systems can disrupt or even reverse the expected positive correlation between surface water extent and precipitation. These findings provide physically interpretable insights into the characteristics of existing infiltration-MAR facilities and demonstrate the potential of the proposed framework as a reproducible, interpretable, and potentially transferable tool for data-driven infiltration-MAR identification and inventory development under growing climatic and hydrological uncertainty.

Classification↗
DOE OSTI2022

Predicting Local Material Thickness from Steady-State Ultrasonic Wavefield Measurements Using a Convolutional Neural Network

Acoustic steady-state excitation spatial spectroscopy (ASSESS) is a full-field, ultrasonic non-destructive evaluation (NDE) technique used to locate and characterize defects in plate-like structures. ASSESS generates a steady-state, single-tone ultrasonic excitation in a structure and a scanning laser Doppler Vibrometer (LDV) measures the resulting full-field surface velocity response. Traditional processing techniques for ASSESS data rely on wavenumber domain analysis. This paper presents the alternative use of a convolutional neural network (CNN), trained using simulated ASSESS data, to predict the local plate thickness at every pixel in the wavefield measurement directly. The defect detection accuracy of CNN-based thickness predictions are shown to improve for defects of greater size, and for defects with higher thickness reductions. The CNN demonstrates the ability to predict thickness accurately in regions where Lamb wave dispersion relations are complex or unknown, such as near the boundaries of a test specimen, so long as the CNN is trained on data that accounts for these regions. The CNN also shows generalizability to ASSESS experimental data, despite an entirely simulated training dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Effective Li-Ion Transport Quantification in Composite Cathodes for All-Solid-State Batteries via Multiscale Modeling and Experiments

The tortuosity factor of composite cathodes significantly affects the rate performance of all-solid-state batteries (ASSBs) and has significant differences from systems with liquid electrolytes. Here, in this work, we report a simulation-experiment combined approach that quantifies the effective Li-ion transport in an ASSB composite cathode, which links tortuosity factor on ∼ μm scale to terminal voltage during cycling at the cell level (on ∼ cm scale). Two independent approaches of tortuosity factor quantification are considered: fitting electrochemical cycling data and verifying at different cycling rates and calculating from segmented tomography images, with the tortuosity factor quantified from both methods reaching self-consistency. The simulated terminal voltage using the quantified tortuosity factor has a small relative error of <3% compared to the experimental measurements. We find a significantly reduced value of the Bruggeman exponent of the catholyte phase (1.75), and using shape analysis, we show that rod-shaped catholyte particles play an important role in lowering the tortuosity factor.

Yao, Archie Mingze [Univ. of Michigan, Ann Arbor, ↗
DOE OSTI2024

Land Resources for Wind Energy Development Requires Regionalized Characterizations

Estimates of the land area occupied by wind energy differ by orders of magnitude due to data scarcity and inconsistent methodology. Here, we developed a method that combines machine learning-based imagery analysis and geographic information systems and examined the land area of 318 wind farms (15,871 turbines) in the U.S. portion of the Western Interconnection. We found that prior land use and human modification in the project area are critical for land-use efficiency and land transformation of wind projects. Projects developed in areas with little human modification have a land-use efficiency of 63.8 ± 8.9 W/m 2 (mean ±95% confidence interval) and a land transformation of 0.24 ± 0.07 m 2 /MWh, while values for projects in areas with high human modification are 447 ± 49.4 W/m 2 and 0.05 ± 0.01 m 2 /MWh, respectively. We show that land resources for wind can be quantified consistently with our replicable method, a method that obviates >99% of the workload using machine learning. To quantify the peripheral impact of a turbine, buffered geometry can be used as a proxy for measuring land resources and metrics when a large enough impact radius is assumed (e.g., >4 times the rotor diameter). Our analysis provides a necessary first step toward regionalized impact assessment and improved comparisons of energy alternatives.

17 WIND ENERGY↗
DOE OSTI2016

Segmentation of nanotomographic cortical bone images for quantitative characterization of the osteoctyte lacuno-canalicular network

A newly developed data processing method able to characterize the osteocytes lacuno-canalicular network (LCN) is presented. Osteocytes are the most abundant cells in the bone, living in spaces called lacunae embedded inside the bone matrix and connected to each other with an extensive network of canals that allows for the exchange of nutrients and for mechanotransduction functions. The geometrical three-dimensional (3D) architecture is increasingly thought to be related to the macroscopic strength or failure of the bone and it is becoming the focus for investigating widely spread diseases such as osteoporosis. To obtain 3D LCN images non-destructively has been out of reach until recently, since tens-of-nanometers scale resolution is required. Ptychographic tomography was validated for bone imaging in [1], showing clearly the LCN. The method presented here was applied to 3D ptychographic tomographic images in order to extract morphological and geometrical parameters of the lacuno-canalicular structures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗