Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Imaging and Segmenting Grains and Subgrains Using Backscattered Electron Techniques

We present two new methods of processing data from backscattered electron signals in a scanning electron microscope to image grains and subgrains. The first combines data from multiple backscattered electron images acquired at different specimen geometries to (1) better reveal grain boundaries in recrystallized microstructures and (2) distinguish between recrystallized and unrecrystallized regions in partially recrystallized microstructures. The second utilizes spherical harmonic transform indexing of electron backscatter diffraction patterns to produce high angular resolution orientation data that enable the characterization of subgrains. Subgrains are produced during high-temperature plastic deformation and have boundary misorientation angles ranging from a few degrees down to a few hundredths of a degree. Here, we also present an algorithm to automatically segment grains from combined backscattered electron image data or grains and subgrains from high angular resolution electron backscatter diffraction data. Together, these new techniques enable rapid measurements of individual grains and subgrains from large populations.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images

Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Region-Growing Segmentation Approach to Delineating Timberline from Satellite-Derived Tree Fractional Cover Products

Timberline marks the transitions from continuous forests to sparse forests and tundra landscapes. As the spatial distribution and dynamics of timberline are closely associated with regional energy and carbon balance, mapping timberline is important to a wide range of environmental and ecological studies. However, current timberline delineation approaches remain under-developed. We proposed an automatic timberline delineation method based on a seeded region-growing segmentation technique and satellite-derived products of tree fractional cover. We applied our approach to the West Siberian Plain and Alaska treeline regions as defined by the Circumpolar Arctic Vegetation Map. The results demonstrate the effectiveness of the proposed method for the accurate delineation of the timberlines that spatially align well with very-high-resolution satellite images. Based on the delineated timberlines, we find regional-scale tree encroachment to be not as substantial as previously reported. The proposed approach can be applied to understanding climate-induced forest responses and inform forest management practices.

Circumpolar Arctic Vegetation Map↗
DOE OSTI2022

Design space exploration and decision‐making for a segmented ultralight morphing 50‐MW wind turbine

Abstract Wind turbine design encompasses many different aspects including aerodynamic, structural, electrical, and control system design. To achieve optimal plant performance, a system design approach is utilized in which the performance of the whole wind turbine is evaluated and quantified during operational scenarios with subsystem interactions. In this paper, the design for a Segmented Ultralight Morphing Rotor (SUMR) 50‐MW wind turbine is presented utilizing levelized cost of energy (LCOE) for design choices, with additional quantification of simulated performance shortcomings at the 50‐MW scale. The multi‐disciplinary design process results in a final ultra‐scale turbine configuration that outperforms other existing offshore wind farms regarding the LCOE.

Kianbakht, Sepideh↗
DOE OSTI2026

NuGraph2 with context-aware inputs: physics-inspired improvements in semantic segmentation

Graph neural networks have recently shown strong promise for event reconstruction tasks in Liquid Argon Time Projection Chambers, yet their performance remains limited for underrepresented classes of particles, such as Michel electrons. In this work, we investigate physics-informed strategies to improve semantic segmentation within the NuGraph2 architecture. We explore three complementary approaches: (i) enriching the input representation with context-aware features derived from detector geometry and track continuity, (ii) introducing auxiliary decoders to capture class-level correlations, and (iii) incorporating energy-based regularization terms motivated by Michel electron energy distributions. Experiments on MicroBooNE public datasets show that physics-inspired feature augmentation yields the largest gains, particularly boosting Michel electron precision and recall by disentangling overlapping latent space regions. In contrast, auxiliary decoders and energy-regularization terms provided limited improvements, partly due to the hit-level nature of NuGraph2, which lacks explicit particle- or event-level representations. Our findings highlight that embedding physics context directly into node-level inputs is more effective than imposing task-specific auxiliary losses, and suggest that future hierarchical architectures such as NuGraph3, with explicit particle- and event-level reasoning, will provide a more natural setting for advanced decoders and physics-based regularization. The code for this work is publicly available on Github at https://github.com/vitorgrizzi/nugraph_phys/tree/main_phys.

Other Experiments↗
DOE OSTI2022

Understanding the role of segmentation on process-structure–property predictions made via machine learning

Here, the present study investigated the effect of porosity surface determination methods on performance of machine learning models used to predict the tensile properties of AlSi10Mg processed by laser powder bed fusion from micro-computed tomography data. Machine learning models applied in this work include support vector machines, neural networks, decision trees, and Bayesian classifiers. The effects of isosurface thresholding and local gradient approaches for porosity segmentation, as well as image filtering schemes, on model precision were evaluated for samples produced under differing levels of global energy density.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗
DOE OSTI2019

Improved diagnosis of the number of stenosed coronary artery vessels by segmentation with scatter and photo-peak window data for attenuation correction in myocardial perfusion SPECT

Background: Attenuation correction using segmentation of scatter and photo-peak window data (SSPAC) enables an evaluation of the attenuation map in a patient-specific manner without additional radiation exposure. We compared the accuracy of SSPAC and non-corrected myocardial perfusion scintigraphy methods for diagnosing the number of stenosed coronary artery vessels. Methods and Results: We retrospectively reviewed the data from 183 consecutive patients who underwent {sup 99m}Tc-tetrofosmin stress/rest SPECT examination and a coronary angiography within 3 months. The MPS images were reconstructed with and without SSPAC attenuation correction. We examined the accuracy of the quantitative interpretation using summed differential score in the detection of coronary artery disease (CAD). The attenuation maps were successfully determined in 179 of 183 patients (98%). In terms of the vessel-based diagnostic ability, sensitivity, specificity, positive predictive and negative predictive values of the SSPAC and non-correction methods for diagnosing CAD in individual coronary territories were 77%*, 89%, 74%*, and 90%* vs 51%, 87%, 62%, and 82%, respectively (*P < .05). In 35 patients with multi-vessel CAD, those values were 78%*, 81%, 93%, and 55%* vs 49%, 81%, 89%, and 34%, respectively (*P < .05; AUC: 0.82 vs 0.62, P < .05). Conclusion: SSPAC-corrected SPECT myocardial perfusion images exhibit improved accuracy in the detection of the number of stenosed coronary artery vessels, even in patients with multi-vessel CAD.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

In situ laser profilometry for material segmentation and digital reconstruction of a multicomponent additively manufactured part

In addition to its ability to produce geometrically complex parts, additive manufacturing offers a unique opportunity to collect data about a component while it is being fabricated. However, there has only been limited effort to characterize parts morphologically and compositionally in situ. In this article, we present a layer-by-layer, laser profilometry-based in situ characterization technique as a method to digitally reconstruct a multi-material part. Data collected by the laser profilometer yields height maps and grayscale images which are voxelized using purpose-built software to volumetrically reconstruct the part. Additionally, the same part was also analyzed using X-ray computed tomography (CT) which was not able to resolve the different compositional regions within the part, but captured the filament morphology. The part was then bisected to compare the digital reconstruction to the actual part morphology and composition. Overall, the digital reconstruction was in good agreement with both the CT and bisected images. Deviations between the digital reconstruction and the CT/bisected images are likely the result of image segmentation settings or material shifts after data was collected. The in situ characterization method demonstrated here sets the stage for real time process monitoring and paves the way for additively manufactured parts that are “born qualified.”

36 MATERIALS SCIENCE↗
DOE OSTI2022

Improving the performance of PM6 donor polymer by random ternary copolymerization of BDD and DTBT segments

Developing high-performance wide bandgap polymer donors to match the rapidly growing non-fullerene small molecule acceptors (NF-SMAs) is of great importance to further improve the photovoltaic performances of organic solar cells (OSCs). PM6 and D18 are two leading wide bandgap donor polymers, but their performances are highly sensitive to the molecular weights, which have distinct impact on the morphology and thereby the charge generation and recombination processes. Here, in this work, we reported the random ternary copolymerization of PM6 and D18 segments to develop random terpolymers with finely tuned photoelectronic properties and optimized blend morphology for high-performance OSCs. The resulting random terpolymers (PMD-5, PMD-10, PMD-15 and PMD-20) exhibited finely tuned absorptions, energy levels and blend morphology. The optimal morphology of PMD-15:L8-BO contributed to the fast exciton diffusion and dissociation, efficient charge extraction with suppressed recombination. Thus, the power conversion efficiency was improved from 17.22% of the control PM6 devices and 17.47% of the control D18 devices to 18.12% of PMD-15 based devices, which is the top performance of random terpolymers. Moreover, the PMD-15 exhibited much higher batch-to-batch reproducibility at a broad molecular weight range than that of PM6 and D18, showing promising for practical applications.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Common risk segment mapping: Streamlining exploration for carbon storage sites, with application to coastal Texas and Louisiana

Large-scale deployment of Carbon Capture and Storage (CCS) will require a commensurately large number of sites. Efficient screening methods are needed to create investment assurance and focus efforts on the most promising sites. The problem is similar to petroleum exploration, for which there are well-developed (though seldom published) workflows, including Common Risk Segment (CRS) mapping. In brief, the process requires 1) defining the key play elements; 2) identifying candidate geologic intervals for each; 3) creating fact-based maps for those intervals; 4) determining minimum criteria for the success of each element; 5) reinterpreting the fact-based maps in terms of chance of success; and 6) combining the individual maps to form a composite, basin-scale view of prospectivity. We adapt the CRS process to screening for CO 2 storage sites. Critically, we redefine the process in terms of cost of characterization and development, rather than chance of success. For illustration, we apply the process to the example of the Lower Miocene on the Texas and Louisiana Gulf Coast. We show that the predictions are consistent with historic hydrocarbon production volumes and rates. The power of the CRS method is that it creates a systematic approach to geologic evaluation and translates complex, multidimensional analysis into clear, graphical and easily comprehended business inputs. The results highlight sweet spots and identifies critical risks, suggesting a focus for further data collection and analysis. Furthermore, the method developed here can be applied to both surface and subsurface factors anywhere that there is interest in geologic storage of CO 2 .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Segmentation and Classification of Fission as Pores in Reactor Irradiated Annular U–10Zr Metallic Fuel Using Machine Learning Models

Metallic fuels, particularly U—10Zr, are promising candidates for next-generation sodium-cooled fast reactors. Irradiation of nuclear fuels in reactors can lead to the formation of solid and gas fission product which subsequently forms microstructural pores, deteriorating fuel performance. Due to the massive amount of pores and complex phases formed, a quantitative description of fission gas pores is not yet available, preventing the development of microstructure-informed fuel performance modeling for fuel qualification. This paper applied a pre-trained deep learning model to ~10,260 high magnification scanning electron microscopy images. This method increased the accuracy of fission gas pore segmentation and allows statistical features to be extracted which cannot be achieved manually. A pre-trained decision tree model worked on the segemenation results and further classified the pores into different categories to produce a correlation between the pores, movement of lanthanides, and temperature gradient during irradiation. Finally, this paper emphasizes the potentials of machine learning models to accelerate fuel research, development, and qualification for advanced reactors.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network

Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.

36 MATERIALS SCIENCE↗