Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Imaging grain microstructure in a model ceramic energy material with optically generated coherent acoustic phonons

Characterization of microstructure, chemistry and function of advanced energy materials remains a challenge for instrumentation science with tremendous opportunity for new discoveries. This active area of research is starting to make considerable strides with examples ranging from methodologies that employ bright X-rays, electron microscopy and optical spectroscopy. However, further development of instruments, capable of multimodal measurements, is necessary to fully reveal complex microstructure evolution in realistic environments and dynamical systems that are far from equilibrium. In this regard, laser-based instruments have a unique advantage as multiple measurement methodologies are easily combined into a single instrument using standard optics. A new pump-probe method that uses optically generated acoustic phonons is expanding standard optical characterization by providing depth resolved information. Here we report on a noteworthy extension of this pump-probe method to image grain microstructure in ceria. Rich information regarding the orientation of individual crystallites is obtained by monitoring acoustic phonon velocities and noting how the polarization of the probe beam influences the detected signal amplitude. When paired with other optical microscopies, this methodology will provide new perspectives for optical characterization of ceramic materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

Bolme, David↗
DOE OSTI2026

Neutron Grating Interferometry at the High Flux Isotope Reactor

Neutron imaging is a non-destructive probe that can spatially resolve bulk materials’ internal features/structures. Neutron imaging spatial resolution is driven by detector technology, i.e., pixel size, and is currently on the order of 10–20 µm. This limitation can be alleviated by the use of neutron grating interferometry – an advanced neutron imaging technique – that enables simultaneous access to three contrast mechanisms: attenuation, differential phase, and small-angle neutron scattering. Recently, a Talbot-Lau neutron grating interferometry has been implemented at the Multimodal Advanced Radiography Station at the High Flux Isotope Reactor. In this work, the design, setup and performance of the grating apparatus are presented.

Zhang, Yuxuan [ORNL] (ORCID:0000000200831408)↗
DOE OSTI2025

Towards Content Authenticity: Multimodal Fake News Detection and AI-Generated Text Identification

In today’s digital world, the spread of fake news and the rise of AI-generated text have become major threats to content authenticity and public trust. This thesis addresses both challenges through two complementary research directions: detecting fake news using multimodal features, and identifying AI-generated text using semantic and structural reasoning. The first part of the work focuses on fake news detection by introducing a novel model that combines text and image features through a unique rotational attention mechanism. Unlike traditional attention methods, this approach rotates the roles of query, key, and value across modalities to capture deeper interactions. Additionally, the model incorporates external domain information by linking news posts to top-ranked websites from Google search results, which helps assess the credibility of content based on its broader web context. This results in a more reliable and accurate fake news detection system that outperforms existing state-of-the-art methods. The second part presents SGG-ATD, a new framework for detecting AI-generated text. It uses masked language modeling to measure sentence coherence, followed by constructing a graph where keywords—both original and predicted—are connected based on semantic and contextual similarity. A Graph Convolutional Network (GCN) is then used to learn structural relationships within the text for final classification. Experimental results demonstrate that SGG-ATD achieves high F1-scores and consistently outperforms strong baselines. This method contributes to robust AI text detection, supporting accountability and resilience against AI-driven misinformation.

Gupta, Nidhi↗
DOE OSTI2023

Multimodal microscopy of extended defects in β-Ga 2 O 3 (010) EFG crystals

Beta-phase gallium oxide (β-Ga 2 O 3 ) has attracted attention in recent years as a potentially low cost, large area substrate and active layer material for high power, high temperature power electronics and sensing devices. However, growth of β-Ga 2 O 3 crystals is complicated by easily activated (100) and (001) cleavage planes, the presence of low angle grain boundaries (LAGBs) and twins, and the potential formation of polycrystalline grains. In this study, β-Ga 2 O 3 crystals were grown by the edge-defined film-fed growth technique with an (010) principal face. Two crystals with apparently randomly formed high angle grain boundaries (HAGBs) were selected and analyzed by electron backscatter diffraction, electron channeling contrast imaging, and cathodoluminescence to investigate the nature of the LAGBs and the source of the HAGB formation. It was discovered that planar LAGBs lying parallel to the (010) plane exist in the region immediately preceding the start of an HAGB. Increased misorientation across the LAGB was observed, approaching the initiation of a new grain. We present multimodal microscopy characterization, correlating misorientation and variation in optoelectronic properties with LAGBs and the associated dislocations.

14 SOLAR ENERGY↗
DOE OSTI2026

QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding

Quantum computing calibration depends on interpreting experimental data, and calibration plots provide the most universal human-readable representation for this task, yet no systematic evaluation exists of how well vision-language models (VLMs) interpret them. We introduce QCalEval, the first VLM benchmark for quantum calibration plots: 243 samples across 87 scenario types from 22 experiment families, spanning superconducting qubits and neutral atoms, evaluated on six question types in both zero-shot and in-context learning settings. The best general-purpose zero-shot model reaches a mean score of 72.3, and many open-weight models degrade under multi-image in-context learning, whereas frontier closed models improve substantially. A supervised fine-tuning ablation at the 9-billion-parameter scale shows that SFT improves zero-shot performance but cannot close the multimodal in-context learning gap. As a reference case study, we release NVIDIA Ising Calibration 1, an open-weight model based on Qwen3.5-35B-A3B that reaches 74.7 zero-shot average score.

Cao, Shuxiang↗
DOE OSTI2023

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Charging Reactions Promoted by Geometrically Necessary Dislocations in Battery Materials Revealed by In Situ Single-Particle Synchrotron Measurements

Crystallographic defects exist in many redox active energy materials, e.g., battery and catalyst materials, which significantly alter their chemical properties for energy storage and conversion. However, there is lack of quantitative understanding of the interrelationship between crystallographic defects and redox reactions. Herein, crystallographic defects, such as geometrically necessary dislocations, are reported to influence the redox reactions in battery particles through single-particle, multimodal, and in situ synchrotron measurements. Through Laue X-ray microdiffraction, many crystallographic defects are spatially identified and statistically quantified from a large quantity of diffraction patterns in many layered oxide particles, including geometrically necessary dislocations, tilt boundaries, and mixed defects. The in situ and ex situ measurements, combining microdiffraction and X-ray spectroscopy imaging, reveal that LiCoO 2 particles with a higher concentration of geometrically necessary dislocations provide deeper charging reactions, indicating that dislocations may facilitate redox reactions in layered oxides during initial charging. The present study illustrates that a precise control of crystallographic defects and their distribution can potentially promote and homogenize redox reactions in battery materials.

25 ENERGY STORAGE↗
DOE OSTI2020

Imaging biomarkers in neurodegeneration: current and future practices

There is an increasing role for biological markers (biomarkers) in the understanding and diagnosis of neurodegenerative disorders. The application of imaging biomarkers specifically for the in vivo investigation of neurodegenerative disorders has increased substantially over the past decades and continues to provide further benefits both to the diagnosis and understanding of these diseases. This review forms part of a series of articles which stem from the University College London/University of Gothenburg course “Biomarkers in neurodegenerative diseases”. In this review, we focus on neuroimaging, specifically positron emission tomography (PET) and magnetic resonance imaging (MRI), giving an overview of the current established practices clinically and in research as well as new techniques being developed. We will also discuss the use of machine learning (ML) techniques within these fields to provide additional insights to early diagnosis and multimodal analysis.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Recurrence analysis of friction based dry-couplant ultrasonic Lamb waves in plate-like structures

Here, in this study, the effect of friction on the generation of dry-coupled Lamb waves is experimentally investigated. Recurrence analysis is performed to analyze the complex behavior of friction based dry-coupled Lamb waves. In particular, the effect of the normal force, which is necessary for a stronger dry-coupled Lamb wave generation and the friction, on the transmission of mechanical energy and determinism characteristics of Lamb waves are investigated. The results verify that larger friction coefficient and friction force are crucial for generation and propagation of strong Lamb waves supporting the fact that the main mechanism to transfer mechanical energy using dry-couplant is friction. The sensitivity of Lamb waves to the friction coefficient, highlights the importance of designing specific pads with respect to condition of the surface. Besides, the results show that the normal force and friction coefficient can change the determinism characteristics behavior of multimode Lamb waves. Furthermore, it is shown that the determinism value is sensitive to the friction coefficient and normal force. A similar trend is observed in the determinism values and friction coefficient. In general, a smaller friction coefficient indicates smaller determinism value. Additionally, it is shown that a normal load can change the behavior of a system, as observed from recurrence plots, owing to changes in the Lamb waves trajectories in the phase-space domain. In addition, it is shown that recurrence plots enable the detection of mode transitions in multimode Lamb waves. Recurrence analysis is a complementary tool to frequency domain methods for accurate analysis of multimode Lamb waves behavior.

42 ENGINEERING↗
DOE OSTI2023

From Optimization to Sampling Through Gradient Flows

Optimization and sampling algorithms play a central role in science and engineering as they enable finding optimal predictions, policies, and recommendations, as well as expected and equilibrium states of complex systems. The notion of “optimality” is formalized by the choice of an objective function, while the notion of an “expected” state is specified by a probabilistic model for the distribution of states. Optimizing rugged objective functions and sampling multimodal distributions is computationally challenging, especially in high-dimensional problems. Here, for this reason, many optimization and sampling methods have been developed by researchers working in disparate fields such as Bayesian statistics, molecular dynamics, genetics, quantum chemistry, machine learning, weather forecasting, econometrics, and medical imaging.

Trillos, N. García↗
DOE OSTI2023

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Simultaneous on-chip generation of violet, blue, cyan, green, yellow, orange, and red light from an octave-spanning infrared frequency comb

An integrated, multi-spectral visible-light source could significantly benefit technologies such as displays, medical imaging, spectroscopy, visible-light communications, and astrophysics. However, despite recent advances in chip-scale visible lasers, simultaneously generating light of all colors in a single chip has been challenging. Existing solutions are either not suitable for full chip-scale integration, or are fundamentally difficult to scale. Here we demonstrate the simultaneous on-chip generation of infrared, red, orange, yellow, green, cyan, blue, and violet light. Leveraging the low loss, low dispersion, and high density of modes of an adiabatic multimode silicon nitride (SiN) microresonator, we use a single infrared pump of moderate power (~130 mW) to produce an octave-spanning infrared frequency comb that is then converted to different portions of the visible spectrum. We measure non-mode-locked combs and soliton steps corresponding to mode-locked states, making our comb generator suitable for applications that demand either low or high coherence. Since the required pump power is compatible with high-power lasers demonstrated in the same SiN platform, our multi-octave light generator can be fully integrated in a chip-scale form factor. We envision that such a light source will be a catalyst for the development and deployment of miniaturized multi-spectral technologies for quantum systems, medical imaging, displays, and spectroscopy.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Correlated 4D-STEM and EDS for the classification of fine Beta-precipitates in aluminum alloy AA 6063-T6

Tuning the properties of aluminum alloys AA 6063-T6 involves artificial aging to induce precipitate formation, particularly β’’ and β’ phases. Previous characterization challenges due to their similar appearance are addressed here by correlating 4D scanning transmission electron microscopy (4DSTEM) and energy-dispersive spectroscopy (EDS) mapping. This approach allows us to analyze the structure and composition of precipitates individually, overcoming limitations of conventional imaging and structural analysis techniques when the precipitates appear simultaneously, as is often the case. We present detailed characterizations of needle-shaped Beta precipitates, revealing distinct diffraction patterns (DPs) and compositional differences. The method's applicability extends beyond aluminum alloys, offering a promising strategy for complex composite material characterization with multimodal scanning transmission electron microscopy (STEM) techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Probing corrosion using a simple and versatile in situ multimodal corrosion measurement system

In this work, we have developed a unique in situ multimodal corrosion system that is capable of acquiring electrochemical data, sample imaging/visualization and hydrogen collection, simultaneously. Each of these modalities yield valuable information pertaining to the ongoing corrosion process. Combining them can yield holistic information on the role of microstructure, processing history, presence of coatings, etc., on the sequence of steps occurring during the corrosion process, and how they correlate with the acquired electrochemical data. Four materials systems, namely AA6061-T6 aluminum alloy, AZ91 magnesium alloy, galvanized DP590 steel, and pure Zn, were investigated under open circuit potential and under potentiodynamic polarization. The multimodal corrosion system was utilized to observe processes such as surface passivation and dissolution, pit and filiform corrosion initiation and propagation, and was correlated with location and magnitude of hydrogen evolution. This approach is shown to yield a truly multimodal understanding of the ongoing corrosion processes.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Highly efficient visible and near-IR photon pair generation with thin-film lithium niobate

Efficient on-chip entangled photon pair generation at telecom wavelengths is an integral aspect of emerging quantum optical technologies, particularly for quantum communication and computing. However, moving to shorter wavelengths enables the use of more accessible silicon detector technology, and opens up applications in imaging and spectroscopy. Here, we present high brightness ((1.6 ± 0.3) × 10 9 pairs/s/mW/nm) visible–near-IR photon pair generation in a periodically poled lithium niobate nanophotonic waveguide. The degenerate spectrum of the photon pairs is centered at 811 nm with a bandwidth of 117 nm when pumped with a spectrally multimode laser diode. The measured on-chip source efficiency of (2.3 ± 0.5) × 10 11 pairs/s/mW is on par with source efficiencies at telecom wavelengths and is also orders of magnitude higher than the efficiencies of other visible sources implemented in bulk crystal or diffused waveguide-based technologies. Further improvements in the brightness and efficiencies are possible by pumping the device with a single-frequency laser, which would also shrink the pair bandwidth. These results represent the shortest wavelength of photon pairs generated in a nanophotonic waveguide reported to date by nearly an octave.

42 ENGINEERING↗