Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

A quantitative assay for intercellular aggregation

In an earlier communication (Munn et al., J Immunol. Methods 166: 11-25, 1993), we presented the initial development of a quantitative assay for monitoring the rates of cellular aggregation based on digital image processing and video microscopy. This study describes some important enhancements and modifications to the procedure. A new index is introduced to characterize the three-dimensional morphology of the aggregates. This index is based on temporal changes in the projected area of the cells and cell aggregates during the course of the experiment. By drawing an analogy with the kinetic theory of gases, we have also introduced a procedure to normalize for variations in cell seeding density among different experiments. In addition, the image analysis technique has been improved by introducing a background subtraction algorithm to remove illumination defects and an adaptive segmentation procedure. These improvements allowed us to completely automate the image analysis procedure, thus minimizing user intervention and improving the reproducibility of the measurements. The enhanced visual assay is evaluated using some recent results from our studies on homotypic lymphocyte aggregation.

Non-NASA Center↗

3D automatic anatomy segmentation based on iterative graph-cut-ASM

Purpose: This paper studies the feasibility of developing an automatic anatomy segmentation (AAS) system in clinical radiology and demonstrates its operation on clinical 3D images. Methods: The AAS system, the authors are developing consists of two main parts: object recognition and object delineation. As for recognition, a hierarchical 3D scale-based multiobject method is used for the multiobject recognition task, which incorporates intensity weighted ball-scale (b-scale) information into the active shape model (ASM). For object delineation, an iterative graph-cut-ASM (IGCASM) algorithm is proposed, which effectively combines the rich statistical shape information embodied in ASM with the globally optimal delineation capability of the GC method. The presented IGCASM algorithm is a 3D generalization of the 2D GC-ASM method that they proposed previously in Chen et al.[Proc. SPIE, 7259, 72590C1-72590C-8 (2009)]. The proposed methods are tested on two datasets comprised of images obtained from 20 patients (10 male and 10 female) of clinical abdominal CT scans, and 11 foot magnetic resonance imaging (MRI) scans. The test is for four organs (liver, left and right kidneys, and spleen) segmentation, five foot bones (calcaneus, tibia, cuboid, talus, and navicular). The recognition and delineation accuracies were evaluated separately. The recognition accuracy was evaluated in terms of translation, rotation, and scale (size) error. The delineation accuracy was evaluated in terms of true and false positive volume fractions (TPVF, FPVF). The efficiency of the delineation method was also evaluated on an Intel Pentium IV PC with a 3.4 GHZ CPU machine. Results: The recognition accuracies in terms of translation, rotation, and scale error over all organs are about 8 mm, 10 deg. and 0.03, and over all foot bones are about 3.5709 mm, 0.35 deg. and 0.025, respectively. The accuracy of delineation over all organs for all subjects as expressed in TPVF and FPVF is 93.01% and 0.22%, and all foot bones for all subjects are 93.75% and 0.28%, respectively. While the delineations for the four organs can be accomplished quite rapidly with average of 78 s, the delineations for the five foot bones can be accomplished with average of 70 s. Conclusions: The experimental results showed the feasibility and efficacy of the proposed automatic anatomy segmentation system: (a) the incorporation of shape priors into the GC framework is feasible in 3D as demonstrated previously for 2D images; (b) our results in 3D confirm the accuracy behavior observed in 2D. The hybrid strategy IGCASM seems to be more robust and accurate than ASM and GC individually; and (c) delineations within body regions and foot bones of clinical importance can be accomplished quite rapidly within 1.5 min.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comparison of C-arm Computed Tomography and Digital Subtraction Angiography in Patients with Chronic Thromboembolic Pulmonary Hypertension

PurposeTo assess the feasibility and diagnostic performance of contrast-enhanced, C-arm computed tomography (CACT) of the pulmonary arteries compared to digital subtraction angiography (DSA) in patients suffering from chronic thromboembolic pulmonary hypertension (CTEPH).MaterialsFifty-two patients with CTEPH underwent ECG-gated DSA and contrast-enhanced CACT. Two readers (R1, R2) independently evaluated pulmonary artery segments and their sub-segmental branching using DSA and CACT for optimal image quality. Afterwards, the diagnostic findings, i.e., intraluminal filling defects, stenosis, and occlusion, were compared. Inter-modality and inter-observer agreement was calculated, and subsequently consensus reading was done and correlated to a reference standard representing the overall consensus of both modalities. Fisher’s exact test and Cohen’s Kappa were applied.ResultsA total of 1352 pulmonary segments were evaluated, of which 1255 (92.8 %) on DSA and 1256 (92.9 %) on CACT were rated to be fully diagnostic. The main causes of the non-diagnostic image quality were motion artifacts on CACT (R1:37, R2:78) and insufficient contrast enhancement on DSA (R1:59, R2:38). Inter-observer agreement was good for DSA (κ = 0.74) and CACT (κ = 0.75), while inter-modality agreement was moderate (R1: κ = 0.46, R2: κ = 0.47). Compared to the reference standard, the inter-modality agreement for CACT was excellent (κ = 0.96), whereas it was inferior for DSA (κ = 0.61) due to the higher number of abnormal consensus findings read as normal on DSA.ConclusionCACT of the pulmonary arteries is feasible and provides additional information to DSA. CACT has the potential to improve the diagnostic work-up of patients with CTEPH and may be particularly useful prior to surgical or interventional treatment.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Apparatus and method for a light direction sensor

The present invention provides a light direction sensor for determining the direction of a light source. The system includes an image sensor; a spacer attached to the image sensor, and a pattern mask attached to said spacer. The pattern mask has a slit pattern that as light passes through the slit pattern it casts a diffraction pattern onto the image sensor. The method operates by receiving a beam of light onto a patterned mask, wherein the patterned mask as a plurality of a slit segments. Then, diffusing the beam of light onto an image sensor and determining the direction of the light source.

Leviton, Douglas B.↗

A quantifiable and automated volume fraction characterization technique for secondary and tertiary γ′ precipitates in Ni-based superalloys

Highlights: • A new, automated γ′ volume fraction characterization technique has been introduced for Ni-base superalloys. • New image processing techniques can automatically and accurately segment γ′ precipitates from the surrounding γ matrix. • CALPHAD and γ′ phase extraction measurements validate the new characterization technique. - Abstract: Ni-based superalloys are extensively used in high temperature, high stress applications. The presence of coherent γ′-Ni{sub 3}Al precipitates provides the requisite elevated temperature strength and creep resistance in these alloys. Therefore, quantification of the precipitate size distribution and volume fraction is essential for accurate model predictions and future alloy design. Current γ′ volume fraction characterization techniques suffer from a lack of precision and repeatability. Without a reproducible procedure, unacceptable variations and errors have plagued the past 6 decades of superalloys research and have inhibited the implementation of accurate precipitation models for these alloys. Through the use of high resolution, low kV, scanning electron microscopy and state-of-the-art image post-processing, a new, accurate γ′ characterization technique is presented. Using the new technique, secondary γ′ volume fractions in superalloy ME3 were calculated, and confirmed through phase extraction, thus opening the possibility for validation of presently used superalloy precipitation databases.

36 MATERIALS SCIENCE↗

Correlated Nanoscale Analysis of the Emission from Wurtzite versus Zincblende (In,Ga)As/GaAs Nanowire Core–Shell Quantum Wells

Although the properties of wurtzite GaAs have been extensively researched during the past decade, little is known about the influence of the crystal polytype on ternary (In,Ga)As quantum well structures. We address this concern with a unique combination of correlated, spatially resolved measurement techniques on core–shell nanowires that contain extended segments of both the zincblende and wurtzite polytypes. Cathodoluminescence hyperspectral imaging reveals a blue-shift of the quantum well emission energy by 75 ± 15 meV in the wurtzite polytype segment. Nanoprobe X-ray diffraction and atom probe tomography enable k·p calculations for the specific sample geometry to reveal two comparable contributions to this shift. First, there is a 30% drop in In mole fraction going from the zincblende to the wurtzite segment. Second, the quantum well is under compressive strain, which has a much stronger impact on the hole ground state in the wurtzite than in the zincblende segment. Our findings illustrate the role of the crystal structure in tuning the emission of (In,Ga)As quantum wells and pave the way to exploit the possibilities of three-dimensional band gap engineering in core–shell nanowire heterostructures. At the same time, we have demonstrated an advanced characterization toolkit for the investigation of semiconductor nanostructures.

(In,Ga)As quantum well↗

X-ray microscopy enables multiscale high-resolution 3D imaging of plant cells, tissues, and organs

Capturing complete internal anatomies of plant organs and tissues within their relevant morphological context remains a key challenge in plant science. While plant growth and development are inherently multiscale, conventional light, fluorescence, and electron microscopy platforms are typically limited to imaging of plant microstructure from small flat samples that lack a direct spatial context to, and represent only a small portion of, the relevant plant macrostructures. We demonstrate technical advances with a lab-based X-ray microscope (XRM) that bridge the imaging gap by providing multiscale high-resolution three-dimensional (3D) volumes of intact plant samples from the cell to the whole plant level. Serial imaging of a single sample is shown to provide sub-micron 3D volumes co-registered with lower magnification scans for explicit contextual reference. High-quality 3D volume data from our enhanced methods facilitate sophisticated and effective computational segmentation. Advances in sample preparation make multimodal correlative imaging workflows possible, where a single resin-embedded plant sample is scanned via XRM to generate a 3D cell-level map, and then used to identify and zoom in on sub-cellular regions of interest for high-resolution scanning electron microscopy. In total, we present the methodologies for use of XRM in the multiscale and multimodal analysis of 3D plant features using numerous economically and scientifically important plant systems.

59 BASIC BIOLOGICAL SCIENCES↗

Reuniting crystallography with real space: Ab initio structure elucidation with 4D-STEM

Structure elucidation via single-crystal methods has historically lacked experimental access to real-space information, instead relying exclusively on diffraction-space measurements of Bragg reflections. Here we exploit the dual-space imaging power of 4D scanning transmission electron microscopy to meaningfully integrate real-space information into the crystallographic workflow. We show that virtual apertures assembled by segmentation of high-angle annular dark-field images enable i) pixel-by-pixel separation of coherent Bragg signal from clusters of closely spaced nanocrystals and ii) selective extraction of integrated intensities from thinner subregions of individual specimens, facilitating retroactive tuning of multiple scattering artifacts. This strategy empowers us to simply pick and choose whichever nanoscale regions of interest generate the highest-quality diffraction patterns, allowing us to solve several independent structures of the metal-organic framework UiO-66 from specimens whose agglomerated morphology proved intractable for conventional microcrystal electron diffraction. Our method is compatible with both rotational and serial approaches to data processing, ultimately divulging the first scanning nanobeam electron diffraction structures determined by direct methods at subangstrom resolution.

Saha, Ambarneil↗

Comparison of edges detected at different polarisations in MAESTRO data

Edge detection would appear to be a crucial tool for analyzing multi-polarized, multi-frequency, and multi-temporal Synthetic Aperture Radar (SAR) images. Edge structure provides a simple means for comparing different polarizations and frequencies, and for detecting changes over time. Due to the fact that edges and segments (homogeneous regions) are dual concepts, edge detection has an important role to play in identifying segments within which mean backscatter measurements for use in image classification can be made. As part of a general investigation into edge detection in SAR imagery, an initial investigation was carried out into the detectability and nature of edges in multi-polarized and multi-frequency SAR images. The contrast ratio (CR) operator was used to detect edges. This operator was previously shown to perform well at detecting edges in single-polarized and single-frequency SAR images.

Caves, Ronald G.↗

Convolutional networks for vehicle track segmentation

Existing methods to detect vehicle tracks in coherent change detection images, a product of combining two synthetic aperture radar images taken at different times of the same scene, rely on simple, fast models to label track pixels. These models, however, are unable to capture natural track features such as continuity and parallelism. More powerful, but computationally expensive models can be used in offline settings. We present an approach that uses dilated convolutional networks consisting of a series of 3-by-3 convolutions to segment vehicle tracks. The design of our networks considers the fact that remote sensing applications tend to operate in low power and have limited training data. As a result, we aim for small, efficient networks that can be trained end-to-end to learn natural track features entirely from limited training data. We demonstrate that our 6-layer network, trained on just 90 images, is computationally efficient and improves the F-score on a standard dataset to 0.992, up from 0.959 obtained by the current state-of-the-art method.

47 OTHER INSTRUMENTATION↗

A parametric study of various synthetic aperture telescope configurations for coherent imaging applications

The comparative advantages of synthetic aperture telescopes (SATs) of segmented primary mirror and common secondary mirror type, on the one hand, and on the other those employing an array of independent telescopes, are discussed. The diffraction-limited optical performance of both redundant and nonredundant subaperture configurations are compared in terms of point spread function characteristics and encircled energy plots. Coherent imaging with afocal telescope SATs involves a pupil-mapping operation followed by a Fourier transform one. A quantitative analysis of the off-axis optical performance degradation due to pupil-mapping errors is presented, together with the field-dependent effects of residual design aberrations of independent telescopes.

Harvey, James E.↗

Evaluation of the robustness of the preprocessing technique improving reversible compressibility of CT images: Tested on various CT examinations

Purpose: To modify the preprocessing technique, which was previously proposed, improving compressibility of computed tomography (CT) images to cover the diversity of three dimensional configurations of different body parts and to evaluate the robustness of the technique in terms of segmentation correctness and increase in reversible compression ratio (CR) for various CT examinations.Methods: This study had institutional review board approval with waiver of informed patient consent. A preprocessing technique was previously proposed to improve the compressibility of CT images by replacing pixel values outside the body region with a constant value resulting in maximizing data redundancy. Since the technique was developed aiming at only chest CT images, the authors modified the segmentation method to cover the diversity of three dimensional configurations of different body parts. The modified version was evaluated as follows. In randomly selected 368 CT examinations (352 787 images), each image was preprocessed by using the modified preprocessing technique. Radiologists visually confirmed whether the segmented region covers the body region or not. The images with and without the preprocessing were reversibly compressed using Joint Photographic Experts Group (JPEG), JPEG2000 two-dimensional (2D), and JPEG2000 three-dimensional (3D) compressions. The percentage increase in CR per examination (CR{sub I}) was measured.Results: The rate of correct segmentation was 100.0% (95% CI: 99.9%, 100.0%) for all the examinations. The median of CR{sub I} were 26.1% (95% CI: 24.9%, 27.1%), 40.2% (38.5%, 41.1%), and 34.5% (32.7%, 36.2%) in JPEG, JPEG2000 2D, and JPEG2000 3D, respectively.Conclusions: In various CT examinations, the modified preprocessing technique can increase in the CR by 25% or more without concerning about degradation of diagnostic information.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-E-J-224: Multimodality Segmentation of Head and Neck Tumors

Purpose: Develop an algorithm that is able to automatically segment tumor volume in Head and Neck cancer by integrating information from CT, PET and MR imaging simultaneously. Methods: Twenty three patients that were recruited under an adaptive radiotherapy protocol had MR, CT and PET/CT scans within 2 months prior to start of radiotherapy. The patients had unresectable disease and were treated either with chemoradiotherapy or radiation therapy alone. Using the Velocity software, the PET/CT and MR (T1 weighted+contrast) scans were registered to the planning CT using deformable and rigid registration respectively. The PET and MR images were then resampled according to the registration to match the planning CT. The resampled images, together with the planning CT, were fed into a multi-channel segmentation algorithm, which is based on Gaussian mixture models and solved with the expectation-maximization algorithm and Markov random fields. A rectangular region of interest (ROI) was manually placed to identify the tumor area and facilitate the segmentation process. The auto-segmented tumor contours were compared with the gross tumor volume (GTV) manually defined by the physician. The volume difference and Dice similarity coefficient (DSC) between the manual and autosegmented GTV contours were calculated as the quantitative evaluation metrics. Results: The multimodality segmentation algorithm was applied to all 23 patients. The volumes of the auto-segmented GTV ranged from 18.4cc to 32.8cc. The average (range) volume difference between the manual and auto-segmented GTV was −42% (−32.8%–63.8%). The average DSC value was 0.62, ranging from 0.39 to 0.78. Conclusion: An algorithm for the automated definition of tumor volume using multiple imaging modalities simultaneously was successfully developed and implemented for Head and Neck cancer. This development along with more accurate registration algorithms can aid physicians in the efforts to interpret the multitude of imaging information available in radiotherapy today. This project was supported by a grant by Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

A statistical approach to combining multisource information in one-class classifiers

A new method is introduced in this paper for combining information from multiple sources to support one-class classification. The contributing sources may represent measurements taken by different sensors of the same physical entity, repeated measurements by a single sensor, or numerous features computed from a single measured image or signal. The approach utilizes the theory of statistical hypothesis testing, and applies Fisher's technique for combining p-values, modified to handle nonindependent sources. Classifier outputs take the form of fused p-values, which may be used to gauge the consistency of unknown entities with one or more class hypotheses. The approach enables rigorous assessment of classification uncertainties, and allows for traceability of classifier decisions back to the constituent sources, both of which are important for high-consequence decision support. Application of the technique is illustrated in two challenge problems, one for skin segmentation and the other for terrain labeling. Finally, the method is seen to be particularly effective for relatively small training samples.

97 MATHEMATICS AND COMPUTING↗

Dedicated breast CT: Fibroglandular volume measurements in a diagnostic population

Purpose: To determine the mean and range of volumetric glandular fraction (VGF) of the breast in a diagnostic population using a high-resolution flat-panel cone-beam dedicated breast CT system. This information is important for Monte Carlo-based estimation of normalized glandular dose coefficients and for investigating the dependence of VGF on breast dimensions, race, and pathology. Methods: Image data from a clinical trial investigating the role of dedicated breast CT that enrolled 150 women were retrospectively analyzed to determine the VGF. The study was conducted in adherence to a protocol approved by the institutional human subjects review boards and written informed consent was obtained from all study participants. All participants in the study were assigned BI-RADS{sup Registered-Sign} 4 or 5 as per the American College of Radiology assessment categories after standard diagnostic work-up and underwent dedicated breast CT exam prior to biopsy. A Gaussian-kernel based fuzzy c-means algorithm was used to partition the breast CT images into adipose and fibroglandular tissue after segmenting the skin. Upon determination of the accuracy of the algorithm with a phantom, it was applied to 137 breast CT volumes from 136 women. VGF was determined for each breast and the mean and range were determined. Pathology results with classification as benign, malignant, and hyperplasia were available for 132 women, and were used to investigate if the distributions of VGF varied with pathology. Results: The algorithm was accurate to within {+-}1.9% in determining the volume of an irregular shaped phantom. The study mean ({+-} inter-breast SD) for the VGF was 0.172 {+-} 0.142 (range: 0.012-0.719). VGF was found to be negatively correlated with age, breast dimensions (chest-wall to nipple length, pectoralis to nipple length, and effective diameter at chest-wall), and total breast volume, and positively correlated with fibroglandular volume. Based on pathology, pairwise statistical analysis (Mann-Whitney test) indicated that at the 0.05 significance level, there was no significant difference in distributions of VGF without adjustment for age between malignant and nonmalignant breasts (p= 0.41). Pairwise comparisons of the distributions of VGF in increasing order of mammographic breast density indicated all comparisons were statistically significant (p < 0.002). Conclusions: This study used a different clinical prototype breast CT system than that in previous studies to image subjects from a different geographical region, and used a different algorithm for analysis of image data. The mean VGF estimated from this study is within the range reported in previous studies, indicating that the choice of 50% glandular weight fraction to represent an average breast for Monte Carlo-based estimation of normalized glandular dose coefficients in mammography needs revising. In the study, the distributions of VGF did not differ significantly with pathology.

60 APPLIED LIFE SCIENCES↗

Improved UTE-based attenuation correction for cranial PET-MR using dynamic magnetic field monitoring

Purpose: Ultrashort echo time (UTE) MRI has been proposed as a way to produce segmented attenuation maps for PET, as it provides contrast between bone, air, and soft tissue. However, UTE sequences require samples to be acquired during rapidly changing gradient fields, which makes the resulting images prone to eddy current artifacts. In this work it is demonstrated that this can lead to misclassification of tissues in segmented attenuation maps (AC maps) and that these effects can be corrected for by measuring the true k-space trajectories using a magnetic field camera. Methods: The k-space trajectories during a dual echo UTE sequence were measured using a dynamic magnetic field camera. UTE images were reconstructed using nominal trajectories and again using the measured trajectories. A numerical phantom was used to demonstrate the effect of reconstructing with incorrect trajectories. Images of an ovine leg phantom were reconstructed and segmented and the resulting attenuation maps were compared to a segmented map derived from a CT scan of the same phantom, using the Dice similarity measure. The feasibility of the proposed method was demonstrated inin vivo cranial imaging in five healthy volunteers. Simulated PET data were generated for one volunteer to show the impact of misclassifications on the PET reconstruction. Results: Images of the numerical phantom exhibited blurring and edge artifacts on the bone–tissue and air–tissue interfaces when nominal k-space trajectories were used, leading to misclassification of soft tissue as bone and misclassification of bone as air. Images of the tissue phantom and thein vivo cranial images exhibited the same artifacts. The artifacts were greatly reduced when the measured trajectories were used. For the tissue phantom, the Dice coefficient for bone in MR relative to CT was 0.616 using the nominal trajectories and 0.814 using the measured trajectories. The Dice coefficients for soft tissue were 0.933 and 0.934 for the nominal and measured cases, respectively. For air the corresponding figures were 0.991 and 0.993. Compared to an unattenuated reference image, the mean error in simulated PET uptake in the brain was 9.16% when AC maps derived from nominal trajectories was used, with errors in the SUV{sub max} for simulated lesions in the range of 7.17%–12.19%. Corresponding figures when AC maps derived from measured trajectories were used were 0.34% (mean error) and −0.21% to +1.81% (lesions). Conclusions: Eddy current artifacts in UTE imaging can be corrected for by measuring the true k-space trajectories during a calibration scan and using them in subsequent image reconstructions. This improves the accuracy of segmented PET attenuation maps derived from UTE sequences and subsequent PET reconstruction.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-F-T-119: Development of Heart Prediction Model to Increase Accuracy of Dose Reconstruction for Radiotherapy Patients

Purpose: To assess individual variation in heart volume and location in order to develop a prediction model of the heart. This heart prediction model will be used to calculate individualized heart doses for radiotherapy patients in epidemiological studies. Methods: Chest CT images for 30 adult male and 30 adult female patients were obtained from NIH Clinical Center. Image-analysis computer programs were used to segment the whole heart and 8 sub-regions and to measure the volume of each sub- region and the dimension of the whole heart. An analytical dosimetry method was used for the 30 adult female patients to estimate mean heart dose during conventional left breast radiotherapy. Results: The average volumes of the whole heart were 803.37 cm{sup 3} (COV 18.8%) and 570.19 cm{sup 3} (COV 18.8%) for adult male and female patients, respectively, which are comparable with the international reference volumes of 807.69 cm{sup 3} for males and 596.15 cm{sup 3} for females. Some patient characteristics were strongly correlated (R{sup 2}>0.5) with heart volume and heart dimensions (e.g., Body Mass Index vs. heart depth in males: R{sup 2}=0.54; weight vs. heart width in the adult females: R{sup 2}=0.63). We found that the mean heart dose 3.805 Gy (assuming prescribed dose of 50 Gy) in the breast radiotherapy simulations of the 30 adult females could be an underestimate (up to 1.6-fold) or overestimate (up to 1.8-fold) of the patient-specific heart dose. Conclusion: The study showed the significant variation in patient heart volumes and dimensions, resulting in substantial dose errors when a single average heart model is used for retrospective dose reconstruction. We are completing a multivariate analysis to develop a prediction model of the heart. This model will increase accuracy in dose reconstruction for radiotherapy patients and allow us to individualize heart dose calculations for patients whose CT images are not available.

60 APPLIED LIFE SCIENCES↗

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗