Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Panel-Segmentation: A Python Package for Automated Solar Array Metadata Extraction Using Satellite Imagery

The NREL Python Panel-Segmentation package is a toolkit that automates the process of extracting accurate and valuable metadata related to solar array installations, using publicly available Google Maps satellite imagery. Previously published work includes automated azimuth estimation for individual solar installations in satellite images. Our continued research focuses on automated detection and classification of solar installation mounting configuration (tracking or fixed-tilt; rooftop, ground, or carport). Specifically, a Faster-RCNN Resnet-50 feature pyramid network (FPN) model was trained and validated on 862 manually labeled satellite images. This model was used to perform object detection on satellite imagery, locating and classifying individual solar installations' mounting configuration and type. Model results showed a mean average precision score (mAP) of 77.79%, with the model strongest at detecting fixed-tilt ground mount and fixed-tilt carport installations. The object detection model and its outputs have been incorporated into the Panel-Segmentation package's automated metadata extraction pipeline, which returns the mounting configuration and azimuth for individual solar arrays in satellite imagery. The complete image data set with labels has been released on the U.S. Department of Energy (DOE) DuraMAT DataHub, to encourage further research in this area.

deep learning↗
DOE OSTI2023

An efficient instance segmentation approach for studying fission gas bubbles in irradiated metallic nuclear fuel

Abstract Gaseous fission products from nuclear fission reactions tend to form fission gas bubbles of various shapes and sizes inside nuclear fuel. The behavior of fission gas bubbles dictates nuclear fuel performances, such as fission gas release, grain growth, swelling, and fuel cladding mechanical interaction. Although mechanical understanding of the overall evolution behavior of fission gas bubbles is well known, lacking the quantitative data and high-level correlation between burnup/temperature and microstructure evolution blocks the development of predictive models and reduces the possibility of accelerating the qualification for new fuel forms. Historical characterization of fission gas bubbles in irradiated nuclear fuel relied on a simple threshold method working on low-resolution optical microscopy images. Advanced characterization of fission gas bubbles using scanning electron microscopic images reveals unprecedented details and extensive morphological data, which strains the effectiveness of conventional methods. This paper proposes a hybrid framework, based on digital image processing and deep learning models, to efficiently detect and classify fission gas bubbles from scanning electron microscopic images. The developed bubble annotation tool used a multitask deep learning network that integrates U-Net and ResNet to accomplish instance-level bubble segmentation. With limited annotated data, the model achieves a recall ratio of more than 90%, a leap forward compared to the threshold method. The model has the capability to identify fission gas bubbles with and without lanthanides to better understand the movement of lanthanide fission products and fuel cladding chemical interaction. Lastly, the deep learning model is versatile and applicable to the micro-structure segmentation of similar materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

RhizoNet: semantic segmentation of plant roots using CNN (RhizoNet) v0.0.1

RhizoNet is designed for the semantic segmentation of plant root scans, utilizing a sophisticated deep learning network known as Residual Unet. It specializes in processing color images of plants cultivated in a hydroponic EcoFAB system, captured using an Epson scanner. The core of the algorithm is based on Residual U-nets, which significantly improve prediction accuracy. This is achieved through the implementation of a convex hull operation, which effectively delineates the primary root component by leveraging spatio-temporal image data. This enables researchers to accurately assess predicted biomass and monitor plant growth over time.

Ushizima, Daniela↗
DOE OSTI2023

Automated Progress Monitoring in Modular Construction Factories Using Computer Vision and Building Information Modeling

Modular construction methods have recently gained interest due to the advantages offered in terms of safety, quality, and productivity for projects. In this method, a significant portion of the construction is performed off-site in factories where modular components are built in different workstations, assembled on the production line, and shipped to the site for installation. Due to the labor-intensive nature of tasks, cycle times in modular construction factories are highly variable, which commonly leads to major bottlenecks and delays in construction projects. To remedy this effect, recent methods rely on sensors such as RFID to monitor the production process, which is reportedly expensive, and intrusive to the work process. Recently, computer vision-based methods have been proposed to track the production process in modular construction factories. However, these methods overlook monitoring the assembly process on the production line. Therefore, this paper presents a method to monitor the assembly process by integrating computer vision-based methods with Building Information Modeling (BIM). The proposed method detects the modular units using object segmentation; superimposes the installation area with the corresponding 2D region using BIM, and identifies the installation of the components using image processing techniques. The proposed method has been validated using surveillance videos captured from a modular construction factory in the US. Successful implementation of the proposed method can lead to timely identification of delays during the assembly process and reduce delays in modular integrated construction projects.

building information modeling↗
DOE OSTI2023

Automatic Rural Road Centerline Detection and Extraction from Aerial Images for a Forest Fire Decision Support System

To effectively manage the terrestrial firefighting fleet in a forest fire scenario, namely, to optimize its displacement in the field, it is crucial to have a well-structured and accurate mapping of rural roads. The landscape’s complexity, mainly due to severe shadows cast by the wild vegetation and trees, makes it challenging to extract rural roads based on processing aerial or satellite images, leading to heterogeneous results. This article proposes a method to improve the automatic detection of rural roads and the extraction of their centerlines from aerial images. This method has two main stages: (i) the use of a deep learning model (DeepLabV3+) for predicting rural road segments; (ii) an optimization strategy to improve the connections between predicted rural road segments, followed by a morphological approach to extract the rural road centerlines using thinning algorithms, such as those proposed by Zhang–Suen and Guo–Hall. After completing these two stages, the proposed method automatically detected and extracted rural road centerlines from complex rural environments. This is useful for developing real-time mapping applications.

Lourenço, Miguel (ORCID:0000000157673394)↗
DOE OSTI2025

Microstructure of Neutron-Irradiated Al 3 Hf-Al Thermal Neutron Absorber Materials

A thermal neutron-absorbing metal matrix composite (MMC) comprised of Al 3 Hf particles in an aluminum matrix was developed to filter out thermal neutrons and create a fast flux environment for material testing in a mixed-spectrum nuclear reactor. Intermetallic Al 3 Hf particles capture thermal neutrons and are embedded in a highly conductive aluminum matrix that provides conductive cooling of the heat generated due to thermal neutron capture by the hafnium. These Al 3 Hf-Al MMCs were fabricated using powder metallurgy via hot pressing. The specimens were neutron-irradiated to between 1.12 and 5.38 dpa and temperatures ranging from 286 °C to 400 °C. The post-irradiation examination included microstructure characterization using transmission electron microscopy (TEM) and energy-dispersive X-ray spectroscopy. This study reports the microstructural observations of four irradiated samples and one unirradiated control sample. All the samples showed the presence of oxide at the particle–matrix interface. The irradiated specimens revealed needle-like structures that extended from the surface of the Al 3 Hf particles into the Al matrix. An automated segmentation tool was implemented based on a YOLO11 computer vision-based approach to identify dislocation lines and loops in TEM images of the irradiated Al-Al 3 Hf MMCs. This work provides insight into the microstructural stability of Al 3 Hf-Al MMCs under irradiation, supporting their consideration as a novel neutron absorber that enables advanced spectral tailoring.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Scaling Building Energy Audits through Machine Learning Methods on Novel Drone Image Data

Building energy audits are time-consuming and labor-intensive. This paper describes a new method using machine learning (ML) techniques on novel data sources (drone images) to improve the identification of building characteristics and retrofit opportunities, and thereby reduce the effort for audits. The new ML method includes: (1) Building footprint extraction using line extraction, polygonization, and polygon-merging, (2) Building envelope extraction using PIX4d modeling software to reconstruct a building 3D model, (3) Visualization tool for viewing images from the 3D model, (4) Window-to-wall ratio (WWR) using state-of-art deep neural network semantic segmentation, (5) Envelope thermal anomaly detection using an unsupervised machine learning clustering algorithm, and (6) Rooftop energy equipment detection based on an object detection algorithm. The testing of this method involved a comparison of additional ML-generated information overlaid on current ‘state-of-practice’ audit and remote assessment baselines using evaluation metrics: labor time and associated cost, marginal benefits of using ML-generated information in workflows for audits and remote assessments, integration potential with existing processes and tools, and replicability/scalability of the method. In two test buildings in California that had comprehensive drawings and meter data available, the ML method effectively generated a building footprint, envelope, rooftop equipment, WWR, and locations of envelope thermal anomalies. Projected target segments of the ML method are sites with minimal drawings and energy data, and underserved sectors such as multistoried housing, disadvantaged communities, and schools for which the ML method can enable identification of building asset characteristics and prioritization of envelope retrofits and decentralized energy equipment retrofits.

Singh, Reshma↗
DOE OSTI2023

Lowering the computational barrier: Partially Bayesian neural networks for transparency in medical imaging AI

Deep Neural Networks (DNNs) can provide clinicians with fast and accurate predictions that are highly valuable for high-stakes medical decision-making, such as in brain tumor segmentation and treatment planning. However, these models largely lack transparency about the uncertainty in their predictions, potentially giving clinicians a false sense of reliability that may lead to grave consequences in patient care. Growing calls for Transparent and Responsible AI have promoted Uncertainty Quantification (UQ) to capture and communicate uncertainty in a systematic and principled manner. However, traditional Bayesian UQ methods remain prohibitively costly for large, million-dimensional tumor segmentation DNNs such as the U-Net. In this work, we discuss a computationally-efficient UQ approach via the partially Bayesian neural networks (pBNN). In pBNN, only a single layer, strategically selected based on gradient-based sensitivity analysis, is targeted for Bayesian inference. We illustrate the effectiveness of pBNN in capturing the full uncertainty for a 7.8-million parameter U-Net. We also demonstrate how practitioners and model developers can use the pBNN's predictions to better understand the model's capabilities and behavior.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reduced volume of diabetic pancreatic islets in rodents detected by synchrotron X-ray phase-contrast microtomography and deep learning network

The pancreatic islet is a highly structured micro-organ that produces insulin in response to rising blood glucose. Here we develop a label-free and automatic imaging approach to visualize the islets in situ in diabetic rodents by the synchrotron radiation X-ray phase-contrast microtomography (SRμCT) at the ID17 station of the European Synchrotron Radiation Facility. The large-size images (3.2 mm × 15.97 mm) were acquired in the pancreas in STZ-treated mice and diabetic GK rats. Each pancreas was dissected by 3000 reconstructed images. The image datasets were further analysed by a self-developed deep learning method, AA-Net. All islets in the pancreas were segmented and visualized by the three-dimension (3D) reconstruction. After quantifying the volumes of the islets, we found that the number of larger islets (=>1500 μm 3 ) was reduced by 2-fold (wt 1004 ± 94 vs GK 419 ± 122, P < 0.001) in chronically developed diabetic GK rat, while in STZ-treated diabetic mouse the large islets were decreased by half (189 ± 33 vs 90 ± 29, P < 0.001) compared to the untreated mice. Our study provides a label-free tool for detecting and quantifying pancreatic islets in situ. It implies the possibility of monitoring the state of pancreatic islets in vivo diabetes without labelling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

In-situ determination of strain during transient burst testing and the temperature dependence of Zircaloy-4 claddings

Understanding fuel system behavior during postulated loss-of-coolant accidents is pertinent for continued safe and efficient operation of light water reactors, particularly as higher burnups are being pursued and safety margins re-evaluated. Conventional mechanical models for the incumbent Zr alloys typically rely on the assumption that steady-state creep is the dominant fuel cladding response during transient accident conditions. To investigate this assumption, simulated accident burst testing was performed on Zircaloy-4 claddings with balloon behavior measured in-situ. Here, two distinct loading conditions were utilized during burst testing: (1) constant-gas-inventory where pressure was allowed to increase with temperature and (2) constant pressure. In-situ strains and strain rates were measured via 2-dimensional digital image correlation techniques and synchronized with temperature to determine deformation dependencies. The temperature dependence of strain rate was characterized by a two segment Arrhenius relationship, with a distinct transition between the high and low temperature/strain regimes. The average activation energy of the lower temperature/strain regime was 328 ± 25 kJ/mol, in agreement with the ~320 kJ/mol used for conventional LOCA models. However, the higher temperature/strain segment, which encompassed most of ballooning, showed increased activation energies as well as a dependence on whether the burst region was in view. For tests that burst away from the camera view, the average high temperature/strain segment activation energy was 635 ± 150 kJ/mol. For samples where the rupture opening formed in view, the average activation energy was 1015 ± 179 kJ/mol. This observed shift in temperature dependence indicates a transition in deformation mechanism at the end of life, possibly to time independent failure mechanisms, which has not yet been visualized in the literature for Zr alloys. Parameters at the transition points were analyzed to determine thresholds for this change in behavior, which occurred at an average hoop strain of 6.9 ± 2.1 %.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Automated identification of deformation twin systems in Mg WE43 from SEM DIC

In this study, the application of machine learning and computer vision approaches to microscale deformation data for the automated identification of deformation twinning systems, and their associated twin area, is introduced. Deformation data was obtained during in-situ SEM compression testing of a WE43 Mg alloy using digital image correlation (DIC) modified for use with electron microscopy. A 5.7 mm × 3.4 mm area of interest was analyzed, generating ~100 million data points of deformation. Experimental twin trace directions were determined by applying k-means clustering, morphological thinning, and Hough transforms to the deformation data. The identification of deformation twinning was achieved by consideration of the twin trace direction, its strain value, and its evolution. The deformation map was divided into areas corresponding to individual active twin systems, enabling the analysis of microstructure dependence of deformation behavior and twinning activity. The performance of the proposed twinning identification approach was evaluated by accuracy, precision, and sensitivity metrics. The effect of the tuning parameters used in the algorithm on the performance is also discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Single-Volume Scatter Camera (Final Report)

This document serves as a comprehensive final report for the Single-Volume Scatter Camera (SVSC) project. Most of the work over the course of this project has been documented in journal articles, conference papers, and other reports. We therefore reference those materials for detailed presentation of our technical results. The most recent efforts on the project have not been published and are presented in detail here. We present characterizations of two neutron scatter camera prototypes; one using a monolithic geometry, and one using an optically segmented geometry. Both detectors employ plastic scintillator with SiPM-based readout. For the monolithic prototype, we present calibrations of several detector parameters made using a set of dark counts. In particular, we employ a coincidence analysis to characterize the distribution external optical crosstalk, along with the relative timing of the different SiPMs. For the optically segmented prototype we present the results of calibrations made using a tagged 22 Na source, as well as the results of an imaging measurement made using a tagged AmBe source.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗
DOE OSTI2025

From pixels to patterns: Coupling Optical Coherence Tomography and machine learning for monitoring coastal wetland root systems

Coastal wetlands are crucial in shoreline stabilization, carbon sequestration, and storm protection. Yet, due to limitations in traditional destructive sampling techniques, the belowground biomass (live root mass) and necromass (dead and decaying roots) remain difficult to assess in coastal wetlands, limiting our understanding on coastal resilience, nutrient cycling, and soil structure. This study employs Optical Coherence Tomography (OCT) as a high-resolution imaging technique to analyze root biomass and necromass in the Terrebonne Basin, Louisiana. A Random Forest (RF) model was developed to classify root health states based on OCT-derived features, achieving an accuracy of 70% in distinguishing live from dead root segments. The results demonstrate that OCT, combined with ML, offers a promising novel approach to root analysis, providing fine-scale insights into root morphology and decay patterns that are not easily captured by conventional methods. This research lays the foundation for future integration of OCT with complementary imaging modalities such as X-ray Computed Tomography (XCT) and advanced ML algorithms to enhance classification accuracy and scalability. Future work aims to expand the dataset diversity across different wetland types and apply the methodology for large-scale, repeatable assessments of root biomass turnover and accumulation, with important implications for wetland monitoring, conservation, and restoration under changing environmental conditions.

AI/ML↗
DOE OSTI2023

Design of Electrostatic Aberration Correctors for Scanning Transmission Electron Microscopy

Abstract In a scanning transmission electron microscope (STEM), producing a high-resolution image generally requires an electron beam focused to the smallest point possible. However, the magnetic lenses used to focus the beam are unavoidably imperfect, introducing aberrations that limit resolution. Modern STEMs overcome this by using hardware aberration correctors comprised of many multipole elements, but these devices are complex, expensive, and can be difficult to tune. We demonstrate a design for an electrostatic phase plate that can act as an aberration corrector. The corrector is comprised of annular segments, each of which is an independent two-terminal device that can apply a constant or ramped phase shift to a portion of the electron beam. We show the improvement in image resolution using an electrostatic corrector. Engineering criteria impose that much of the beam within the probe-forming aperture be blocked by support bars, leading to large probe tails for the corrected probe that sample the specimen beyond the central lobe. We also show how this device can be used to create other STEM beam profiles such as vortex beams and probes with a high degree of phase diversity, which improve information transfer in ptychographic reconstructions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

PHASE: Personalized Head-based Automatic Simulation for Electromagnetic properties in 7T MRI

Accurate and individualized human head models are becoming increasingly important for electromagnetic (EM) simulations. These simulations depend on precise anatomical representations to realistically model electric and magnetic field distributions, particularly when evaluating Specific Absorption Rate (SAR) within safety guidelines. State of the art simulations use the Virtual Population due to limited public resources and the impracticality of manually annotating patient data at scale. Here, this paper introduces Personalized Head-based Automatic Simulation for EM properties (PHASE), an automated open-source toolbox that generates high-resolution, patient-specific head models for EM simulations using paired T1-weighted (T1w) magnetic resonance imaging (MRI) and computed tomography (CT) scans with 14 tissue labels. To evaluate the performance of PHASE models, we conduct semi-automated segmentation and EM simulations on 15 real human patients, serving as the gold standard reference. The PHASE model achieved comparable global SAR and localized SAR averaged over 10 grams of tissue (SAR-10g), demonstrating its potential as a promising tool for generating large-scale human model datasets in the future. The code and models of PHASE toolbox have been made publicly available: https://github.com/hrlblab/PHASE.

Deep learning↗
DOE OSTI2024

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Efficient and Flexible Sensitivity Matrix Computation for Adaptive Electrical Capacitance Volume Tomography

Electrical capacitance tomography is a widely used sensor modality for flow imaging in many industrial settings. Adaptive Electrical Capacitance Volume Tomography (AECVT) extends the capabilities of traditional ECT by enabling direct volumetric imaging and an improved resolution. Construction of the sensitivity matrix is a necessary step to obtain flow images. This step requires computation of the electric field inside the sensing domain, which is done via a typical field solver such as the finite element method. In this work, we present an efficient and flexible method to construct the sensitivity matrix for Adaptive Electrical Capacitance Volume Tomography (AECVT) based on individual electrode segment excitations and their judicious combination to form desired matrix elements. We illustrate how the proposed method yields the same sensitivity matrix as the traditional method but at a much lower computational cost. Once all segment contributions are obtained, we also indicate how the proposed method, unlike the traditional approach, can generate the sensitivity matrix on demand for an arbitrary combination of synthetic electrodes and obviating the need for any additional field computations. Finally, we present image reconstruction results for two different experimental scenarios where the mutual capacitance data and the corresponding sensitivity vectors are obtained through the proposed measurement combination scheme.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗