Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

3D and Multimodal X‐Ray Microscopy Reveals the Impact of Voids in CIGS Solar Cells

Small voids in the absorber layer of thin-film solar cells are generally suspected to impair photovoltaic performance. They have been studied on Cu(In,Ga)Se 2 cells with conventional laboratory techniques, albeit limited to surface characterization and often affected by sample-preparation artifacts. Here, synchrotron imaging is performed on a fully operational as-deposited solar cell containing a few tens of voids. By measuring operando current and X-ray excited optical luminescence, the local electrical and optical performance in the proximity of the voids are estimated, and via ptychographic tomography, the depth in the absorber of the voids is quantified. Besides, the complex network of material-deficit structures between the absorber and the top electrode is highlighted. Despite certain local impairments, the massive presence of voids in the absorber suggests they only have a limited detrimental impact on performance.

14 SOLAR ENERGY↗
DOE OSTI2023

Multimodal Few-Shot Segmentation of Electron Micrographs

Scanning transmission electron microscopy (STEM) is one of the most used methods of analyzing the chemistry and composition of materials. By analyzing microstructures, these microscopes can help scientists better understand the molecular underpinnings of microelectronics, batteries, and more. However, STEM data can be difficult to interpret, so recent developments have been made in applications of machine learning to analyze these images. The PNNL-developed pyCHIP Classifier has achieved results in segmenting STEM these images via few-shot learning, a method which requires little data and human input, perfect for quickly analysis. In my internship I (Eli Meyers) investigated a multimodal improvement of this classifier by incorporating energy dispersive x-ray spectroscopy (EDS) data into the classification process for a more accurate segmentation. Furthermore, I encoded the spectral data by training a mass spectrometry encoder on the EDS data to extract a more meaningful representation of the data.

36 MATERIALS SCIENCE↗
NASA NTRS1994

Multimodal correlation and intraoperative matching of virtual models in neurosurgery

The multimodal correlation between different diagnostic exams, the intraoperative calibration of pointing tools and the correlation of the patient's virtual models with the patient himself, are some examples, taken from the biomedical field, of a unique problem: determine the relationship linking representation of the same object in different reference frames. Several methods have been developed in order to determine this relationship, among them, the surface matching method is one that gives the patient minimum discomfort and the errors occurring are compatible with the required precision. The surface matching method has been successfully applied to the multimodal correlation of diagnostic exams such as CT, MR, PET and SPECT. Algorithms for automatic segmentation of diagnostic images have been developed to extract the reference surfaces from the diagnostic exams, whereas the surface of the patient's skull has been monitored, in our approach, by means of a laser sensor mounted on the end effector of an industrial robot. An integrated system for virtual planning and real time execution of surgical procedures has been realized.

Ceresole, Enrico↗
DOE OSTI2026

Thermal cycling-driven microstructural changes of eutectic Al–Si phase change materials in SS304 containers revealed by multi-modal imaging

Aluminum-based Al–Si alloys are widely used as phase change materials (PCMs) in thermal energy storage (TES) systems owing to their high volumetric latent heat and superior thermal conductivity. However, their long-term reliability is limited by degradation processes that remain insufficiently understood. In this work, we employ a multimodal, correlative characterization framework to systematically resolve the degradation behavior of eutectic Al–Si PCMs in contact with SS304 containers under repeated thermal cycling. By integrating high-resolution electron microscopy, three-dimensional X-ray fluorescence (3D XRF) imaging, and differential scanning calorimetry (DSC), we directly link spatially resolved compositional and microstructural evolution to changes in thermophysical properties. The correlative analysis reveals that elemental leaching of Fe, Cr, and Ni from the stainless-steel container into the PCM drives the formation of intermetallic compounds (IMCs) both at the interface and within the bulk PCM, leading to pronounced compositional heterogeneity. These interfacial reactions and diffusion-induced transformations progressively destabilize the Al–Si eutectic, reducing the effective phase-transforming fraction. Consistent with these observations, DSC measurements show a decrease in melting temperature and latent heat of fusion with thermal cycling. These results underscore the critical influence of interfacial reactions and material compatibility on the stability, durability, and overall performance of Al–Si-based TES systems.

25 ENERGY STORAGE↗
DOE OSTI2022

Kinetics and evolution of solid-state metal dealloying in thin films with multimodal analysis

Thin-film solid-state metal dealloying (thin-film SSMD) is an emerging technique that uses self-organization to design nanostructured thin films. The resulting 3D bicontinuous nanostructures are promising for a wide range of applications, such as catalysis and energy storage. In this work, we prepared thin films by SSMD using Ti-Cu as the parent alloy and Mg as the solvent. Using a multimodal approach, we combined synchrotron X-ray spectroscopy, diffraction, and high-resolution electron-based spectroscopy and imaging to study their morphological, structural, and chemical evolution. The processing-structure relationship was analyzed as a function of parent alloy composition and dealloying temperature and time. Morphological transitions from globular, to lamellar, to bicontinuous structures, in conjunction with a ligament size evolution, were identified as functions of the parent alloy composition. The dealloying rate increased with increasing concentration of interdiffusing elements (dissolving component) in the parent alloy. The parting limit, a dealloying compositional threshold, was systematically analyzed and determined to be 30%–40%. The order of crystalline phase formation is CuMg 2 , Cu 2 Mg, and Ti; the Ti phase first shows self-reorganization during dealloying, separate from the crystallization process. The coarsening in thin-film SSMD was identified and not entirely self-similar; in addition to the increase of ligament size over time, the formation of larger globular ligaments were also observed. This work furthers our fundamental understanding of thin-film SSMD and nanostructured thin-film design, where the thermodynamic and kinetic effects differ from the bulk counterparts. The fact that dealloying and diffusion outpaces the crystallization and new phase formation also offers opportunities to utilize thin-film SSMD in certain alloy systems in which deleterious intermetallic phases need to be suppressed, that may not be possible in the bulk geometry.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

SANE: strategic autonomous non-smooth exploration for multiple optima discovery in multi-modal and non-differentiable black-box functions

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, material structure image spaces, and molecular embedding spaces. Often these systems are black-boxes and time-consuming to evaluate, which resulted in strong interest towards active learning methods such as Bayesian optimization (BO). However, these systems are often noisy which make the black box function severely multi-modal and non-differentiable, where a vanilla BO can get overly focused near a single or faux optimum, deviating from the broader goal of scientific discovery. To address these limitations, here we developed Strategic Autonomous Non-Smooth Exploration (SANE) to facilitate an intelligent Bayesian optimized navigation with a proposed cost-driven probabilistic acquisition function to find multiple global and local optimal regions, avoiding the tendency to becoming trapped in a single optimum. To distinguish between a true and false optimal region due to noisy experimental measurements, a human (domain) knowledge driven dynamic surrogate gate is integrated with SANE. We implemented the gate-SANE into pre-acquired piezoresponse spectroscopy data of a ferroelectric combinatorial library with high noise levels in specific regions, and piezoresponse force microscopy (PFM) hyperspectral data. SANE demonstrated better performance than classical BO to facilitate the exploration of multiple optimal regions and thereby prioritized learning with higher coverage of scientific values in autonomous experiments. Our work showcases the potential application of this method to real-world experiments, where such combined strategic and human intervening approaches can be critical to unlocking new discoveries in autonomous research.

Biswas, Arpan [University of Tennessee, Knoxville,↗
NASA NTRS1990

The Magellan Venus radar mapping mission

The NASA Magellan Venus Radar Mapper spacecraft, which will be placed into orbit around Venus on August 10, 1990, is described and its mission is discussed. The orbiter's 12-cm wavelength, multimode radar system is examined and the applications of its modes are addressed. In the SAR mode, it can image most of the Venus surface at a resolution of better than 300 m, approaching 120 m over more than half the planet. In the altimeter mode, the radar will determine topographic relief to a vertical accuracy of better than 50 m averaged over a surface resolution cell approximately 10 km in diameter. In the radiometer mode, the radar receiver can determine the surface radio emission brightness temperature with an absolute accuracy of 20 K, at a resolution of 2 K. The nature of the data products and the archiving plans are also considered.

Saunders, R. S.↗
NASA NTRS2013

NASA Tech Briefs, September 2013

Topics include: ISS Ammonia Leak Detection Through X-Ray Fluorescence; A System for Measuring the Sway of the Vehicle Assembly Building; Fast, High-Precision Readout Circuit for Detector Arrays; Victim Simulator for Victim Detection Radar; Hydrometeor Size Distribution Measurements by Imaging the Attenuation of a Laser Spot; Quasi-Linear Circuit; High-Speed, High-Resolution Time-to-Digital Conversion; Li-Ion Battery and Supercapacitor Hybrid Design for Long Extravehicular Activities; Ultrasonic Low-Friction Containment Plate for Thermal and Ultrasonic Stir Weld Processes; High-Powered, Ultrasonically Assisted Thermal Stir Welding; Next-Generation MKIII Lightweight HUT/Hatch Assembly; Centrifugal Sieve for Gravity-Level-Independent Size; Segregation of Granular Materials; Ion Exchange Technology Development in Support of the Urine Processor Assembly; Nickel-Graphite Composite Compliant Interface and/or Hot Shoe Material; UltraSail CubeSat Solar Sail Flight Experiment; Mechanism for Deploying a Long, Thin-Film Antenna From a Rover; Counterflow Regolith Heat Exchanger; Acquisition and Retaining Granular Samples via a Rotating Coring Bit; Very-Low-Cost, Rugged Vacuum System; Medicine Delivery Device With Integrated Sterilization and Detection; FRET-Aptamer Assays for Bone Marker Assessment, C-Telopeptide, Creatinine, and Vitamin D; Multimode Directional Coupler for Utilization of Harmonic Frequencies from TWTAs; Dual-Polarization, Multi-Frequency Antenna Array for use with Hurricane Imaging Radiometer; Complementary Barrier Infrared Detector (CBIRD) Contact Methods; Autonomous Control of Space Nuclear Reactors; High-Power, High-Speed Electro-Optic Pockels Cell Modulator; Covariance Analysis Tool (G-CAT) for Computing Ascent, Descent, and Landing Errors; Enigma Version 12; Micrometeoroid and Orbital Debris (MMOD) Shield Ballistic Limit Analysis Program; Spitzer Telemetry Processing System; Planetary Protection Bioburden Analysis Program; Wing Leading Edge RCC Rapid Response Damage Prediction Tool (IMPACT2); ISSM: Ice Sheet System Model; Automated Loads Analysis System (ATLAS); Integrated Main Propulsion System Performance Reconstruction Process/Models. Phoenix Telemetry Processor; Contact Graph Routing Enhancements Developed in ION for DTN; GFEChutes Lo-Fi; Advanced Strategic and Tactical Relay Request Management for the Mars Relay Operations Service; Software for Generating Troposphere Corrections for InSAR Using GPS and Weather Model Data; Ionospheric Specifications for SAR Interferometry (ISSI); Implementation of a Wavefront-Sensing Algorithm; Sally Ride EarthKAM - Automated Image Geo-Referencing Using Google Earth Web Plug-In; Trade Space Specification Tool (TSST) for Rapid Mission Architecture (Version 1.2); Acoustic Emission Analysis Applet (AEAA) Software; Memory-Efficient Onboard Rock Segmentation; Advanced Multimission Operations System (ATMO); Robot Sequencing and Visualization Program (RSVP); Automating Hyperspectral Data for Rapid Response in Volcanic Emergencies; Raster-Based Approach to Solar Pressure Modeling; Space Images for NASA JPL Android Version; Kinect Engineering with Learning (KEWL); Spacecraft 3D Augmented Reality Mobile App; MPST Software: grl_pef_check; Real-Time Multimission Event Notification System for Mars Relay; SIM_EXPLORE: Software for Directed Exploration of Complex Systems; Mobile Timekeeping Application Built on Reverse-Engineered JPL Infrastructure; Advanced Query and Data Mining Capabilities for MaROS; Jettison Engineering Trajectory Tool; MPST Software: grl_suppdoc; PredGuid+A: Orion Entry Guidance Modified for Aerocapture; Planning Coverage Campaigns for Mission Design and Analysis: CLASP for DESDynl; and Space Place Prime.

Source record↗
DOE OSTI2026

Global Multimodal Dataset for Nighttime Light Super-Resolution

The dataset is a collection of spatially and temporally registered high-resolution and low-resolution nighttime light (NTL) images, high-resolution land-use binary masks, and high-resolution road density images from around the world. The NTL images are sourced from the NASA Black Marble product VNP46A2 and the LuoJia1-01 satellite. The land-use binary masks are derived from Google's and the World Resources Institute's DynamicWorld dataset, and the road density images are sourced from OpenStreetMap.

Nighttime lights↗
NASA NTRSDate not supplied

Concept-based Analysis of Neural Networks via Vision-Language Models

The analysis of vision-based deep neural networks (DNNs) is highly desirable but it is very challenging due to the difficulty of expressing formal specifications for vision tasks and the lack of efficient verification procedures. In this paper, we propose to leverage emerging multimodal, vision-language, foundation models (VLMs) as a lens through which we can reason about vision models. VLMs have been trained on a large body of images accompanied by their textual description, and are thus implicitly aware of high-level, human-understandable concepts describing the images. We describe a logical specification language Con spec designed to facilitate writing specifications in terms of these concepts. To define and formally check Con spec specifications, we build a map between the internal representations of a given vision model and a VLM, leading to an efficient verification procedure of natural-language properties for vision models. We demonstrate our techniques on a ResNet-based classifier trained on the RIVAL-10 dataset using CLIP as the multimodal model.

Large Vision Language Models↗
DOE OSTI2021

Spatio-temporal ablation dynamics and plasma chemistry of aluminum induced by temporally modulated ytterbium fiber laser

Here, in this work, we studied single-pulse ablation dynamics of a temporally modulated continuous wave laser-material interaction with Al using in situ multimodal time-resolved diagnostics that describe in detail the associated physical and chemical processes. Time-resolved scattering, emission imaging, and optical emission spectroscopy unveiled a sequence of events spread out across three distinct phases: (i) early phase ablation process, associated with particle generation and liquid Al column formation (<20 μs), (ii) secondary detonation when sufficient ejected material is accumulated over the surface (20-50 μs), and (iii) molten liquid Al pool oscillation on the surface, followed by large droplet ejection from the liquid pool (100-500 μs). Atomic Al and AlO were observed with optical emission spectroscopy at different ratios during the entire lifetime of the event, verifying the formation of oxidized Al vapor upon its interaction with air. Morphological and compositional characterization confirmed surface oxidation and material re-solidification in the form of protrusions produced during the irradiation process. This work provides insights into the complex physical and chemical mechanisms of single-pulse ablation in the sub-millisecond laser pulse regime, which are critically important for parameter optimization in a variety of laser processing, microfabrication, and deposition applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Austenitic 347H stainless steel offers superior mechanical properties and corrosion resistance required for extreme operating conditions such as high temperature. The change in microstructure due to composition and process variations is expected to impact material properties. Identifying microstructural features such as grain boundaries thus becomes an important task in the process-microstructure-properties loop. Applying convolutional neural network (CNN)-based deep learning models is a powerful technique to detect features from material micrographs in an automated manner. In contrast to microstructural classification, supervised CNN models for segmentation tasks require pixel-wise annotation labels. However, manual labeling of the images for the segmentation task poses a major bottleneck for generating training data and labels in a reliable and reproducible way within a reasonable timeframe. Microstructural characterization especially needs to be expedited for faster material discovery by changing alloy compositions. Here, in this study, we attempt to overcome such limitations by utilizing multimodal microscopy to generate labels directly instead of manual labeling. We combine scanning electron microscopy images of 347H stainless steel as training data and electron backscatter diffraction micrographs as pixel-wise labels for grain boundary detection as a semantic segmentation task. The viability of our method is evaluated by considering a set of deep CNN architectures. We demonstrate that despite producing instrumentation drift during data collection between two modes of microscopy, this method performs comparably to similar segmentation tasks that used manual labeling. Additionally, we find that naïve pixel-wise segmentation results in small gaps and missing boundaries in the predicted grain boundary map. By incorporating topological information during model training, the connectivity of the grain boundary network and segmentation performance is improved. Finally, our approach is validated by accurate computation on downstream tasks of predicting the underlying grain morphology distributions which are the ultimate quantities of interest for microstructural characterization.

36 MATERIALS SCIENCE↗
NASA NTRS1996

Multimode Data-Compression System

Data-compression system developed to satisfy need for high-speed, high-performance compression of data from sources as diverse as medical images, high-definition television images, audio signals, readouts from scientific instruments, and binary data files. Maximum data-transmission capability of communication channel or storage capacity of storage device multiplied by approximately compression ratio. Various combinations of lossless and lossy compression chosen to suit various data streams.

Fang, Wai-Chi↗
DOE OSTI2025

Pursuing theranostics: a multimodal architecture approach

Theranostics is a field of nuclear medicine which uses the same targeting vector and chelating system for both a diagnostic and therapeutic radionuclide, allowing for uniformity in imaging and treatment.

Bender, Aidan A. [Nuclear Engineering Program, Uni↗
DOE OSTI2026

Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET

Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.

Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗
DOE OSTI2023

Spatially resolved multimodal vibrational spectroscopy under high pressures

In this perspective, we discuss the potential impact on in situ studies under controlled environments of a novel multimodal spectroscopic technique, optical photothermal infrared + Raman spectroscopy, which enables the simultaneous collection of infrared and Raman scattering spectra, along with hyperspectral imaging and chemical imaging with wavelength-independent sub-500 nm spatial resolution. A brief review of the current literature regarding the O-PTIR technique is presented along with recent work from our own lab on determining the crystallinity of soft and inorganic materials. The results highlight the possibility of resolving differences in the crystallinity of soft materials associated with changes in material processing. Here, we also demonstrate the first reported use of a diamond anvil cell with simultaneous infrared and Raman measurements that showcases, using a high energy material as an example, the potential use of O-PTIR spectroscopy in diamond anvil cell techniques.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗