Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Imaging, understanding, and control of nanoscale materials transformations

The development of liquid cells for transmission electron microscopy has enabled breakthroughs in our ability to follow nanoscale structural, morphological, or chemical changes during materials growth and applications. Time-resolved high-resolution imaging and chemical analysis through liquids opened the opportunity to capture nanoscale dynamic processes of materials, including reaction intermediates and the transformation pathways. In this article, a series of work is highlighted with topics ranging from liquid cell developments to in situ studies of nanocrystal growth and transformations, dendrite formation, and suppression of lithium dendrites through in situ characterization of the solid–electrolyte interphase chemistry. The understanding garnered is expected to accelerate the discovery of novel materials for applications in energy storage, catalysis, sensors, and other functional devices.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Understanding structure-processing relationships in metal additive manufacturing via featurization of microstructural images

Understanding and predicting accurate property-structure-processing relationships for additively manufactured components is important for both forward and inverse design of robust, reliable parts and assemblies. While direct mapping of process parameters to properties is sometimes plausible, it is often rendered difficult due to poor microstructural control. Exploring the direct relationship between processing conditions and microstructural features can thus provide significant physical insights and aid the overall design process. Here, in this study, we develop an automated high-throughput framework to simulate an uncertainty-aware additive manufacturing (AM) process, characterize microstructural images, and extract meaningful features/descriptors. A kinetic Monte Carlo (KMC) based model of the AM process is used to simulate microstructural evolution for a diverse set of experimentally relevant processing conditions. We perform a parametric study to explore the relationship between microstructural features and processing conditions. Our results indicate that a many-to-one mapping can exist between processing conditions and typical descriptors; therefore, multiple descriptors are thus necessary to unambiguously represent microstructural images. Our work provides crucial quantitative and qualitative in-formation that would aid in the selection of features for microstructural images. Featurized microstructures could then be utilized to build data-driven models for predictive control of microstructures and thereby properties of additively manufactured components.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Computational modeling and neutron imaging to understand interface shape and solute segregation during the vertical gradient freeze growth of BaBrCl:Eu

In this work we apply continuum models to analyze phase change, heat transfer, fluid flow, solute transport, and segregation in order to understand prior neutron imaging observations of the vertical gradient freeze growth of Eu-doped BaBrCl. The models provide a rigorous framework in which to understand the mechanisms that are responsible for the complicated evolution of interface shape and dopant distribution in the growth experiment. We explain how a transition in the solid/liquid interface shape from concave to convex is driven by changes in radial heat transfer caused by furnace design. We also provide a mechanistic explanation of how dynamic growth conditions and changes of the flow structure in the melt result in complicated segregation patterns in this system. A growth pause caused by controller lock-up is shown to result in a band of solute depletion in accordance with classical theory. However, changing flow patterns during growth result in a non-monotonic axial distribution of solute that cannot be explained by simple application of classical segregation models. We assert that the approach presented here, namely the use of rigorous models in conjunction advanced diagnostics, such as neutron imaging, provides an exciting path forward for process optimization and control, accelerating the incremental advances that have, in the past, typically relied on empiricism, experience, and intuition.

36 MATERIALS SCIENCE↗
DOE OSTI2024

The VIBES Are Shifting: Assessing Emergent Capabilities in Multi-Modal Models

Researchers assessing open-source domains such as the internet, and particularly those studying information conflict, often have no single prescribed workflow. In the course of their research, they may need to perform a diverse array of tasks far beyond simply identifying an ever-changing set of objects. These analytical tasks can include ascertaining the provenance of images, understand an image in the context of accompanying text-based data, or identifying indicators of digital image manipulation. They must further be able to do this at the scale of tens of thousands of images or more. Traditional machine vision models have typically lacked the flexibility and breadth of performance sufficient for these needs. The research team from Pacific Northwest National Laboratory assessed the performance of a single baseline CLIP ViT-L model against a series of analytical tasks relevant for the study of online information conflict.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fill Factor Loss in Fielded Photovoltaic Modules Due to Metallization Failures, Characterized by Luminescence and Thermal Imaging

Understanding the causes of photovoltaic module failure in the field can be achieved using spatially-resolved imaging tools in combination with current-voltage (IV) characterization. We evaluate 23 field-degraded modules by comparing their IV characteristics with module images obtained by electroluminescence, photoluminescence, UV-fluorescence, and dark lock-in thermography. We identify primarily metallization failures (metallization series resistance, solder point heating, broken fingers, disrupted interconnects) in these modules that has led to a severe drop in the fill factor and up to 35% power loss over only 2 years of deployment.

14 SOLAR ENERGY↗
DOE OSTI2021

Quantifying particle-scale 3D granular dynamics during rapid compaction from time-resolved in situ 2D x-ray images

Understanding the particle-scale dynamics of granular materials during rapid compaction and flow is of fundamental importance for manufacturing, planetary science, geology, and defense applications. Time-resolved 2D radiography and static 3D x-ray tomography are powerful in situ tools for studying particle-scale dynamics but provide detail only in 2D or with significant time-scale limitations, respectively. Here, we introduce a new method that uses 2D in situ x-ray imaging for determining time-resolved 3D particle-scale dynamics in rapidly compressed granular materials. The method employs initial particle packing structures obtained from x-ray tomography, a 2D x-ray image generation algorithm, and an optimization algorithm. We first describe and validate the method using finite element simulations. Furthermore, we then apply the technique to x-ray phase-contrast images obtained during rapid compaction of granular materials with varying particle morphology and sample thickness. The depth-resolved particle-scale dynamics reveal complex velocity and porosity fields evolving heterogeneously along and perpendicular to the compaction direction. We characterize these features, their fluctuations near the compaction front, and the compaction front thickness. Our technique can be applied to understanding granular dynamics during rapid compaction events, and rearrangements during slower, but non-quasi-static, flows.

36 MATERIALS SCIENCE↗
DOE OSTI2022

NaroNet: Discovery of tumor microenvironment elements from highly multiplexed images

Understanding the spatial interactions between the elements of the tumor microenvironment -i.e. tumor cells. fibroblasts, immune cells- and how these interactions relate to the diagnosis or prognosis of a tumor is one of the goals of computational pathology. We present NaroNet, a deep learning framework that models the multi-scale tumor microenvironment from multiplex-stained cancer tissue images and provides patient-level interpretable predictions using a seamless end-to-end learning pipeline. Trained only with multiplex-stained tissue images and their corresponding patient-level clinical labels, NaroNet unsupervisedly learns which cell phenotypes, cell neighborhoods, and neighborhood interactions have the highest influence to predict the correct label. To this end, NaroNet incorporates several novel and state-of-the-art deep learning techniques, such as patch-level contrastive learning, multi-level graph embeddings, a novel max-sum pooling operation, or a metric that quantifies the relevance that each microenvironment element has in the individual predictions. We validate NaroNet using synthetic data simulating multiplex-immunostained images where a patient label is artificially associated to the -adjustable- probabilistic incidence of different microenvironment elements. We then apply our model to two sets of images of human cancer tissues: 336 seven-color multiplex-immunostained images from 12 high-grade endometrial cancer patients; and 382 35-plex mass cytometry images from 215 breast cancer patients. In both synthetic and real datasets, NaroNet provides outstanding predictions of relevant clinical information while associating those predictions to the presence of specific microenvironment elements.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

New perspectives on materials and device dynamics using time-resolved full-field diffraction X-ray imaging

Understanding how materials evolve during synthesis, processing, or device operation requires experimental access to structural dynamics across wide ranges of length and time scales, often in bulk samples or even within packaged devices. Time-resolved full-field diffraction X-ray microscopy has recently emerged as a powerful way to meet this need by combining the penetration and structural sensitivity of X-ray diffraction with objective-lens-based magnification, sensitive high-resolution X-ray imaging detectors, and pump-probe and real-time imaging strategies. Advances in full-field X-ray diffraction microscopy, often termed dark-field X-ray microscopy (DFXM), enable simultaneous imaging of extended fields of view while retaining crystallographic selectivity. Time-resolved DFXM promises to enable advances in materials processing and dynamics, electrochemical and photochemical processes, and the design of electronic devices. This Perspective summarizes the key instrumental concepts that define the performance of these methods, including the choice of imaging optics, detector considerations, and the impact of source time structure at synchrotron light sources and X-ray free-electron lasers (XFELs). We discuss the simultaneous use of complementary imaging modes that are increasingly used in practice. The early demonstrations of the potential of time-resolved DFXM include real-time defect and grain-boundary dynamics during metal annealing, stroboscopic imaging of functional devices with high strain sensitivity, and ultrafast pump-probe implementations at XFELs that directly visualize acoustic-wave propagation and energy dissipation in bulk crystals.

Dark-field X-ray microscopy↗
DOE OSTI2023

Temperature-Dependent Morphological Evolution during Corrosion of the Ni-20Cr Alloy in Molten Salt Revealed by Multiscale Imaging

Understanding the mechanisms leading to the degradation of alloys in molten salts at elevated temperatures is significant for developing several key energy generation and storage technologies, including concentrated solar and next-generation nuclear power plants. Specifically, the fundamental mechanisms of different types of corrosion leading to various morphological evolution characteristics for changing reaction conditions between the molten salt and alloy remain unclear. Here, in this work, the three-dimensional (3D) morphological evolution of Ni–20Cr in KCl–MgCl 2 is studied at 600 °C by combining in situ synchrotron X-ray and electron microscopy techniques. By further comparing different morphology evolution characteristics in the temperature range of 500–800 °C, the relative rates between diffusion and reaction at the salt–metal interface lead to different morphological evolution pathways, including intergranular corrosion and percolation dealloying. In this work, the temperature-dependent mechanisms of the interactions between metals and molten salts are discussed, providing insights for predicting molten salt corrosion in real-world applications.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Linking Transient Voltage to Spatially-Resolved Luminescence Imaging to Understand Reliability of Perovskite Photovoltaics

In this work, we present a methodology to separate effects of perovskite device metastability from irreversible degradation, using stress/rest cycling under constant current bias while collecting a series of electroluminescence images and continuously monitoring voltage. We develop a simulation model and procedures for image processing to better understand the effects of ion parameters on the transient nature of voltage and evolving electroluminescence images.

electroluminescence↗
DOE OSTI2021

Linking Transient Voltage to Spatially-Resolved Luminescence Imaging to Understand Reliability of Perovskite Photovoltaics: Preprint

In this work, we present a methodology to separate effects of perovskite device metastability from irreversible degradation, using stress/rest cycling under constant current bias while collecting a series of electroluminescence images and continuously monitoring voltage. We develop a simulation model and procedures for image processing to better understand the effects of ion parameters on the transient nature of voltage and evolving electroluminescence images.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

In situ x-ray imaging to understand subsurface behavior during continuous wave laser drilling

A limited understanding regarding the underlying dynamics and mechanisms of material removal during continuous wave laser drilling has presented significant challenges in achieving precision and process control. Here, to address this, we employed high-fidelity, in situ synchrotron x-ray imaging to reveal previously unknown material behaviors during continuous wave laser drilling with power modulation. Our findings highlight that high-aspect ratio drill holes are achieved when the laser modulation frequency falls within the range of 8–12 kHz, provided that the laser average power and modulation amplitude levels meet the specified limits. Under these conditions, we identified a material removal mechanism driven by incremental accumulation of recoil pressure that gradually pushes material upward from deep within the substrate to the surface. This mechanism manifested as a low-frequency fluctuation in the vapor depression depth, resulting in periodic instances of material ejection. Furthermore, our study underscores that rapid expansion of the melt pool and the widening of the drill hole opening can impede effective material removal by redirecting energy from material ejection to increasing the melt pool size. This investigation contributes essential insights into the subsurface dynamics involved in the drilling of high-aspect ratio holes, furthering our fundamental understanding of this intricate process.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Optical Imaging for Understanding of Thermal Barrier Coated Piston Engine Performance

Thermal barrier coatings (TBC) applied to pistons have been a recently renewed research topic in the field of internal combustion engines. Single cylinder testing of a conventional C15™ Tier 4 final pro-duction steel piston and a TBC coated piston showed that the Yttrium stabilized Zirconia (YSZ) TBC did not significantly alter engine performance, with the TBC piston having slower combustion rates and higher criteria emissions. For deeper understanding, research continued by studying 3D-piston sections optically in a constant pressure vessel using photodiodes, four high-speed cameras (natural luminosity, CH*, and OH*), and visualization of the flame from two orthogonal directions. Particle Im-aging Velocimetry (PIV) algorithms were adapted to perform Combustion Imaging Velocimetry (CIV) to aid in quantification of the observed visual combustion flow field differences. The optical work showed that the TBC piston flame development is slower, spatially different, with lower mixing energy for the TBC variant. Geometric profiles of engine pistons and optical vessel 3D-piston sections were measured using a Coordinate Measurement Machine (CMM), and surface roughness was measured with a stylus surface profilometer. CMM results showed that the TBC piston bowl had reasonable macroscopic accuracy, but the rim had a larger radius with less reentrancy. A discussion of the results and analyses in relation to future TBC effort and direction concludes the work.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
DOE OSTI2022

Particle classification by image analysis improves understanding of corn stover degradation mechanisms during deconstruction

Biomass feedstock heterogeneity is a principal roadblock to implementation of the biorefinery concept. Even within an identical cultivar of corn stover, different bales contain not only varying abundance moisture, ash, glucan, and other chemical compounds, but also varying abundance of tissue anatomies (e.g., leaf, husk, cob, or stalk). These different anatomical components not only differ in their response to pretreatment and enzymatic hydrolysis to glucose, but also vary in their mechanical and conveyance properties. Although this heterogeneous nature of corn stover feedstock has been identified as a challenge, a fundamental knowledge gap of how these tissues behave during biorefining processing remains. Here, we demonstrate the use of a commercial fiber image analyzer typically used for wood fiber characterization to monitor the particle size and shapes of non-woody feedstock during milling, pretreatment, and hydrolysis. Additionally, we present novel use of Gaussian process classification to distinguish bundle, parenchyma, and fiber particles to an accuracy of 96.4%. Quantitative probability distribution plots for characteristics such as length and roundness allow elucidation of particle morphology as pretreatment and enzymatic hydrolysis progress. In both stalk pith and stalk rind, particles peel into individual cells whose walls are subsequently fragmented during enzymatic hydrolysis.

09 BIOMASS FUELS↗