Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

The scientific case for concurrent neutron and X-ray scattering and spectroscopy

The interrogation of materials with X-rays or neutrons to determine structure, energetics, and dynamics is fundamental to advancing physical and chemical materials science and enabling innovative material technologies. A persistent challenge in materials development is that progress depends on understanding structure and dynamics across multiple length and time scales in increasingly complex, multicomponent systems featuring interfaces, heterogeneity, and hierarchical organization. Despite rapidly growing demands on materials characterization, current experimental approaches are almost exclusively based on isolated X-ray or neutron scattering and spectroscopy, reflecting a paradigm largely unchanged for decades. To assess the scientific need for a new experimental paradigm, a 3-day workshop sponsored by the U.S. National Science Foundation (NSF) was held at the SpringHill Suites, San Jose, California, from June 2 to 4, 2022. The workshop brought together 70 national and international experts who critically evaluated opportunities enabled by concurrent neutron and X-ray (NeX) scattering, spectroscopy, and imaging experiments. The participants reached a clear consensus that establishing NeX capabilities is crucial for advancing the science of complex materials in the United States. This report illustrates the scientific drivers for NeX experiments through representative examples spanning biomaterials, energy materials, soft matter, nanomaterials, quantum materials, geoscience, and applied materials research. The complementarity of neutrons and X-rays is essential for robust model development and refinement, particularly in multiphase and multicomponent systems. While joint refinement of data from separate experiments is valuable, concurrent measurements uniquely eliminate uncertainties arising from sample evolution, environmental drift, and irreproducibility associated with experiments performed at different locations and times. Realizing NeX capabilities will require the development of new instrumentation, data analysis frameworks, and robust sample environments compatible with both neutron and X-ray probes. Addressing these challenges will enable unambiguous interpretation of complex materials behavior and open new frontiers in materials research.

X-ray↗
DOE OSTI2023

In planta single-molecule imaging and holographic force spectroscopy to study real-time, multimodal turnover dynamics of polysaccharides and associated carbohydrate metabolites

Cellular production of polysaccharides from simple sugar molecules serves critical roles in a variety of metabolic processes essential to the survival of every living organism. In the context of photosynthetically fixed carbon, cell wall polysaccharides synthesis is particularly of interest for increased biomass accumulation for human food, animal feed, and bioenergy related applications. Despite a long history of research in plant cell biology, our understanding of in planta cell wall biosynthesis and its regulation is far from complete due to lack of a comprehensive microscopy toolkit that encompass the multiple spatial and temporal scales in which cell wall polysaccharides fibrils are synthesized and assembled into intricate cell wall networks. In this project, a multidisciplinary team of scientists from Rutgers University, Vanderbilt University, and Oak Ridge National Laboratory carried out innovative multimodal, multiscale microscopy studies of cell wall synthesis using single-molecule force-spectroscopy, super-resolution fluorescence microscopy, and in vivo live cell imaging. Our novel multimodal and holistic imaging approach revealed plant cell wall polysaccharides synthesis processes in unprecedented detail across multiple spatiotemporal scales, from a single-molecule to a single-cell. Besides, the team has made technical and scientific innovations across multiple research fields—microscopy, bioengineering, single-molecule biophysics, and plant biology, etc.—to accomplish the goals. The results from this project will greatly advance the mechanistic and holistic understanding of in planta cell wall synthesis, which will accelerate the development of better transgenic crops for bioenergy applications. Moreover, the new toolbox, combining powerful advanced microscopy assays with cell/protein engineering, will have broader impacts on molecular and cellular biology fields by paving the way for studying cellular processes occurring across multiple physical scales with multimodal microscopy methodologies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Multimodal, Multidimensional, and Multiscale X-ray Imaging at the National Synchrotron Light Source II

Over the last couple of decades, the synchrotron radiation research community has witnessed tremendous advancement in the field of x-ray imaging and microscopy. Continuing enhancement of the light sources’ brightness, advances in x-ray focusing optics, incorporation of precision instruments, and development of innovative imaging techniques are some of the leading contributors for the rapid progress. New imaging and microscopy beamlines, such as the ones at the National Synchrotron Light Source II (NSLS-II), a Department of Energy (DOE) Office of Science user facility located at DOE’s Brookhaven National Laboratory, are capable of performing more sophisticated and complicated measurements than ever before, either on their own or used together as a suite of tools. These sophisticated and complex measurements exhibit attributes for multimodal, multidimensional, and multiscale imaging. Recent popularity of these methods is strongly driven by the current trends in materials characterizations, where researchers desire to map out hierarchical materials structure over a large range of length scales, to understand structure-property correlation, to quantify materials structures in 3D, and/or to perform operando or in situ experiments. It is important to emphasize that “materials” under investigation are not only synthesized materials but also the natural materials. In this article, we describe multimodal, multidimensional and multiscale x-ray imaging capabilities of the NSLS-II beamlines and how these methods are used to tackle complex scientific problems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Toward Intelligent Multimodal Holography for Real-Time Chemical Imaging of Dynamic Ion Separation

Molecular-level visualization of ion transport and separation dynamics in complex environments is crucial for advancing energy systems, water purification, and critical materials recovery. Achieving this requires imaging platforms that combine structural sensitivity, chemical specificity, and real-time operation. Digital off-axis holography (DOAH) provides high-throughput, label-free quantitative phase imaging but inherently lacks chemical selectivity. Integrating DOAH with complementary spectroscopic channels such as fluorescence or hyperspectral imaging introduces the needed molecular specificity, while also creating challenges in multimodal data fusion, synchronization, and computational throughput. Artificial intelligence offers a powerful route to address these limitations by uniting physics-based reconstruction with data-driven interpretation. In this Perspective, we outline a framework for intelligent multimodal holography and demonstrate its potential using a preliminary AI-driven test case. Raw DOAH holograms of lanthanide solutions subjected to magnetic field gradients were analyzed using multi-agent AI workflows that autonomously selected reconstruction tools, extracted NMF components, and generated scientific claims consistent with true paramagnetic and diamagnetic behavior. This demonstration shows how AI-enabled reasoning can deliver real-time chemical–structural interpretation directly from raw holograms. Together, these advances define a path toward adaptive, intelligent holography platforms capable of supporting in situ chemical separations, dynamic ion transport analysis, and next-generation interfacial science.

Ricchiuti, Giovanna↗
NASA NTRS1991

Real time quantitative imaging for semiconductor crystal growth, control and characterization

A quantitative real time image processing system has been developed which can be software-reconfigured for semiconductor processing and characterization tasks. In thermal imager mode, 2D temperature distributions of semiconductor melt surfaces (900-1600 C) can be obtained with temperature and spatial resolutions better than 0.5 C and 0.5 mm, respectively, as demonstrated by analysis of melt surface thermal distributions. Temporal and spatial image processing techniques and multitasking computational capabilities convert such thermal imaging into a multimode sensor for crystal growth control. A second configuration of the image processing engine in conjunction with bright and dark field transmission optics is used to nonintrusively determine the microdistribution of free charge carriers and submicron sized crystalline defects in semiconductors. The IR absorption characteristics of wafers are determined with 10-micron spatial resolution and, after calibration, are converted into charge carrier density.

Wargo, Michael J.↗
DOE OSTI2023

Experimental Assessment of Mammalian Lipidome Complexity Using Multimodal 21 T FTICR Mass Spectrometry Imaging

Herein, we assess the complementarity and complexity of data that can be detected within mammalian lipidome mass spectrometry imaging (MSI) via matrix-assisted laser desorption ionization (MALDI) and nanospray desorption electrospray ionization (nano-DESI). We do so by employing 21 T Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) with absorption mode FT processing in both cases, allowing unmatched mass resolving power per unit time (≥613k at m/z 760, 1.536 s transients). While our results demonstrated that molecular coverage and dynamic range capabilities were greater in MALDI analysis, nano-DESI provided superior mass error, and all annotations for both modes had sub-ppm error. Taken together, these experiments highlight the coverage of 1676 lipids and serve as a functional guide for expected lipidome complexity within nano-DESI-MSI and MALDI-MSI. To further assess the lipidome complexity, mass splits (i.e., the difference in mass between neighboring peaks) within single pixels were collated across all pixels from each respective MSI experiment. The spatial localization of these mass splits was powerful in informing whether the observed mass splits were biological or artificial (e.g., matrix related). Mass splits down to 2.4 mDa were observed (i.e., sodium adduct ambiguity) in each experiment, and both modalities highlighted comparable degrees of lipidome complexity. Further, we highlight the persistence of certain mass splits (e.g., 8.9 mDa; double bond ambiguity) independent of ionization biases. Here, we also evaluate the need for ultrahigh mass resolving power for mass splits ≤4.6 mDa (potassium adduct ambiguity) at m/z > 1000, which may only be resolved by advanced FTICR-MS instrumentation.

21T-FTICR-MS↗
DOE OSTI2023

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗
DOE OSTI2025

Multimode turbulent flow measurements using magnetic resonance imaging- and laser-based techniques and computational fluid dynamics simulations

We studied the flow field characteristics of a turbulent flow over a regularized cube array with a perpendicular injection flow through the floor between the second and third cubical elements, representing the complex flow interactions of a 3D jet and the wake flows behind cubical obstacles. Four different experimental measurements were performed: two magnetic resonance imaging-based measurements for three-dimensional three-component velocity (MRV) and concentration (MRC) and two laser-based techniques, particle image velocimetry (PIV) and planar laser-induced fluorescence (PLIF), for two-dimensional two-component velocity and concentration measurement, respectively. The mainstream Reynolds number is Re = 15 000⁠, based on the primary inlet velocity U m and channel height D H ⁠, whereas the injector Reynolds number is Re j = 3400⁠, based on the injector velocity U j and the injector's exit width D j ⁠. Numerical simulations were performed for the studied flow configuration of turbulent flow over a regularized cube array using Reynolds-averaged Navier–Stokes (RANS) and large-eddy simulation (LES) approaches. Results obtained from experimental measurements—including MRV, MRC, PIV, and PLIF—as well as RANS and LES simulations are discussed and compared along several horizontal and vertical planes of the studied configuration. In addition, 3D turbulent flow structures, such as leading-edge vortex, horseshoe vortex, and jet shear-layer vortex, and the isosurfaces of scalar concentration successfully revealed by MRV and MRC techniques were found to be in very good agreement with those 3D features extracted from RANS and LES simulations. In conclusion, the high-resolution experimental and numerical database obtained from this study could be useful for validation and verification of numerical codes.

Computational fluid dynamics↗
DOE OSTI2020

Quantum Super-resolution Bioimaging using Massively Entangled Multimode Squeezed Light

This report presents a new method for realizing a super-resolution quantum imaging using massively entangled multimode squeezed light (MEMSL). Each branch of the entangled multimode light interacts with the sample and bears the spatially varying optical phase delay. When imaging optics with finite pupil sizes are used, information is lost. Thanks to the analyticity in the Fourier plane, a noiseless measurement would recover the lost information and accomplish super resolution imaging beating the Rayleigh diffraction limit. I proved rigorously in a fully quantum formalism and presented that (1) such information recovery is possible and (2) the information recovery can be accomplished with much less resources when MEMSL is used than those needed in any non-entangled or non-squeezed classical imaging method. Furthermore, the action of the optical loss in the imaging system that degrades the imaging performance is also rigorously analyzed and presented. Several bioimaging applications that can benefit tremendously from the proposed quantum imaging scheme are also suggested.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

In situ , in vivo , and in operando imaging and spectroscopy of liquids using microfluidics in vacuum

This review offers a succinct overview of the development of a vacuum-compatible microfluidic reactor system for analysis at the liquid vacuum interface (SALVI), and its diverse applications in in situ, in vivo, and in operando imaging of liquid surfaces as well as the air-liquid (a-l), liquid-liquid (l-l), and solid-liquid (s-l) interfaces in the past decade. SALVI is one of the first microfluidics-based reactors that has enabled direct analysis of volatile liquids in vacuum surface tools such as scanning electron microscopy (SEM) and time-of-flight secondary ion mass spectrometry (ToF-SIMS). Its integration into ambient and vacuum spectroscopy and microscopy is illustrated. Several applications are highlighted including (1) imaging nanoparticles in liquid using in situ SEM; (2) mapping the evolving l-l interface using in situ x-ray absorption spectroscopy and ToF-SIMS; (3) following complex a-l interfacial oxidation reaction products using in situ ToF-SIMS; (4) capturing biological interfaces of cells and microbes via in vivo multimodal and correlative imaging; and (5) monitoring the dynamic solid electrode and liquid electrolyte interface using in operando molecular imaging. Finally, outlook and recommendations are presented. Besides showing the holistic information volume obtained by real-time multiplexed imaging, this review intends to convey the importance of tool development in revolutionizing surface and interface analysis using vacuum platforms previously limited to solid surfaces. Microfluidics is manifested to be not limited to ambient conditions in many examples in this review. Moreover, fundamental interfacial phenomena underpinning mass and charge transfer can now be pursued in real time via innovated chemical imaging and spectroscopy.

42 ENGINEERING↗
DOE OSTI2022

Multimodal analysis and characterization of the boehmite layer formed on AA6061 before and after alkaline etching

Low-enriched uranium (LEU) alloyed with 10% Mo (U-10Mo) is being considered as a promising alternative to oxide-based dispersion fuel with high-enriched uranium for use in research reactors. The configuration of this proposed LEU monolithic LEU fuel plate consists of a U-10Mo plate-type fuel foil with a 25 µm zirconium interlayer barrier clad with an aluminum alloy (AA6061). In certain research reactors, the clad AA6061 is coated with a boehmite layer to prevent corrosion. The boehmite layer has a high-pH passivation range, which makes it resistant to oxidation. Boehmite is usually formed on the AA6061 surface by autoclave processing. Before the boehmite layer is added, the surface of the AA6061 is cleaned using techniques such as polishing and wet etching. In this study, we use multimodal analysis to examine how pretreatment of AA6061 using polishing followed by alkaline etching affects the chemical composition of the boehmite layer. X-ray photoelectron microscopy (XPS), transmission electron microscopy (TEM), and x-ray diffraction (XRD) were used to study the chemical changes in the boehmite layer caused by alkaline etching pretreatment. XPS provides quantitative analysis for the Al:O ratio as well as oxidation states present on the surface, which suggests slight oxidation of the boehmite surface after alkaline etching of the AA6061 surface. We further explored this suggested oxidation of the boehmite surface using high-resolution transmission electron microscopy with selected area electron diffraction (SAED) and grazing incidence x-ray diffraction (GI-XRD), which suggested only a small amount of aluminum oxide at the surface. The multimodal analysis and imaging yielded new insights for optimizing boehmite growth on AA6061 for research reactors.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image

Abstract Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.

Astronomy & Astrophysics↗
NASA NTRS1989

Use of anomolous thermal imaging effects for multi-mode systems control during crystal growth

Real time image processing techniques, combined with multitasking computational capabilities are used to establish thermal imaging as a multimode sensor for systems control during crystal growth. Whereas certain regions of the high temperature scene are presently unusable for quantitative determination of temperature, the anomalous information thus obtained is found to serve as a potentially low noise source of other important systems control output. Using this approach, the light emission/reflection characteristics of the crystal, meniscus and melt system are used to infer the crystal diameter and a linear regression algorithm is employed to determine the local diameter trend. This data is utilized as input for closed loop control of crystal shape. No performance penalty in thermal imaging speed is paid for this added functionality. Approach to secondary (diameter) sensor design and systems control structure is discussed. Preliminary experimental results are presented.

Wargo, Michael J.↗
DOE OSTI2025

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

NDA Tech: Multimodal Data Fusion with 3D Gamma-Ray Imaging for Safeguards

The ultimate project goal is to improve quantitative results obtained by the IAEA with the H420 gamma ray imager. Distribution to the IAEA will be through incorporation of project results into the software provided with the device by our commercial partner, H3D, Inc. Toward achieving that goal, we have started discussions with H3D to identify the requisite software components and how they will mesh with their own internally developed contextual data systems and other extant software components. We have identified the coded-aperture response data cube as a key structure. Discussions on contextual imaging were informative but somewhat inconclusive as the project lead on contextual data (LBNL) has not been available.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗