Boost the biopharmaceutical industry’s research efficiency with hyperscale data distribution; DOE SBIR Phase I Final Technical Report
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “multimodal imaging”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Utilizing distributed acoustic sensing and ocean bottom fiber optic cables for submarine structural characterization
The sparsity of permanent seismic instrumentation in marine environments often limits the availability of subsea information on geohazards, including active fault systems, in both time and space. One sensing resource that provides observational access to the seafloor environment are existing networks of ocean bottom fiber optic cables; these cables, coupled to modern distributed acoustic sensing (DAS) systems, can provide dense arrays of broadband seismic observations capable of recording both seismic events and the ambient noise wavefield. Here, we report a marine DAS application which demonstrates the strength and limitation of this new technique on submarine structural characterization. Based on ambient noise DAS records on a 20 km section of a fiber optic cable offshore of Moss Landing, CA, in Monterey Bay, we extract Scholte waves from DAS ambient noise records using interferometry techniques and invert the resulting multimodal dispersion curves to recover a high resolution 2D shear-wave velocity image of the near seafloor sediments. We show for the first time that the migration of coherently scattered Scholte waves observed on DAS records can provide an approach for resolving sharp lateral contrasts in subsurface properties, particularly shallow faults and depositional features near the seafloor. Our results provide improved constraints on shallow submarine features in Monterey Bay, including fault zones and paleo-channel deposits, thus highlighting one of many possible geophysical uses of the marine cable network.
47 OTHER INSTRUMENTATION↗
Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance
Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.
Peluso, Alina [ORNL] (ORCID:0000000328950406)↗
Using multimodal X-ray computed tomography to advance 3D petrography: A non-destructive investigation of olivine inside a carbonaceous chondrite
Rocks form in three dimensions through time and studying them provides information from inside dynamic systems we cannot otherwise observe. Yet how we typically access the interior of the rocks themselves to gain that information may limit our understanding and influence how we reconstruct the processes that formed them. Here, we demonstrate combined non-destructive 3D X-ray imaging techniques that produce quantitative densitometric and crystallographic maps of entire individual grains inside a rock. Olivine grains throughout a sample of the carbonaceous chondrite Northwest Africa (NWA) 11346 were each characterized by size, shape, composition, zoning intensity, and crystallographic orientation. The addition of 3D crystallographic mapping to calibrated 3D densitometric analysis—used to calculate chemical composition—demonstrates a fully non-destructive petrographic method and provides unique insight. For instance, in our case, using crystallographic data to delineate individual grains and then measuring the 3D size, shape, and composition of each distinguishes variably reset relict grains from those later crystallized after a melting event. Intersection in a 2D slice could not have led to this interpretation because the integration of three-dimensional size, rounding, composition, location, and crystallographic orientation measured from each grain forms the key patterns. Multimodal laboratory X-ray imaging has strong potential to advance 3D petrography.
36 MATERIALS SCIENCE↗
A unified large language model–based framework for heterogeneous PV image diagnosis
With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.
Li, Baojie↗
Microanalytical Approaches to Characterizing REE in Appalachian Basin Underclays
The search for a reliable U.S. domestic source of rare earth elements (REE) is necessary to support the demand of advanced energy applications (e.g., catalysts, electronics, magnets). Sedimentary deposits may be sources for selectively recovering REE and critical metals—specifically the interbedded seat rock, or underclay, that underlies or forms the floor of a coal seam. This material is often a major component of coal waste fines and refuse and thus readily available. This study examines several Appalachian Basin underclays associated with actively mined coal seams as potential feedstocks for the REE. Multimodal microanalytical electron microscopy (SEM, FIB-SEM, EMPA) synchrotron-based µXRF, and image processing techniques are coupled with detailed elemental and mineral data to classify the 2D and 3D petrophysical properties of the materials. The REE contents of Appalachian Basin underclays were measured from 235–399 ppm and predominantly observed as discrete REE-bearing minerals such as monazite and xenotime on the order of 10–100 µm in size. These REE-bearing minerals typically accounted for less than 1% of the scanned areas and volumes under SEM and FIB-SEM analysis, with the exception of regions enriched in crandallite. Synchrotron-based µXRF elemental maps further identified several REE deposition environments in different underclays, including micro-scale (10–100 µm) light REEs co-localizing with Ca and P, micro-scale heavy REEs with Fe, and large-scale light REEs (>200 µm) co-localizing with Sr, Ba, Ca and P.
36 MATERIALS SCIENCE↗
RadioGalaxyNET: Dataset and novel computer vision algorithms for the detection of extended radio galaxies and infrared hosts
Abstract Creating radio galaxy catalogues from next-generation deep surveys requires automated identification of associated components of extended sources and their corresponding infrared hosts. In this paper, we introduce RadioGalaxyNET, a multimodal dataset, and a suite of novel computer vision algorithms designed to automate the detection and localization of multi-component extended radio galaxies and their corresponding infrared hosts. The dataset comprises 4 155 instances of galaxies in 2 800 images with both radio and infrared channels. Each instance provides information about the extended radio galaxy class, its corresponding bounding box encompassing all components, the pixel-level segmentation mask, and the keypoint position of its corresponding infrared host galaxy. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder (ASKAP) radio telescope, corresponding infrared images, and instance-level annotations for galaxy detection. We benchmark several object detection algorithms on the dataset and propose a novel multimodal approach to simultaneously detect radio galaxies and the positions of infrared hosts.
Astronomy & Astrophysics↗
Deep learning with plasma plume image sequences for anomaly detection and prediction of growth kinetics during pulsed laser deposition
Abstract Materials synthesis platforms that are designed for autonomous experimentation are capable of collecting multimodal diagnostic data that can be utilized for feedback to optimize material properties. Pulsed laser deposition (PLD) is emerging as a viable autonomous synthesis tool, and so the need arises to develop machine learning (ML) techniques that are capable of extracting information from in situ diagnostics. Here, we demonstrate that intensified-CCD image sequences of the plasma plume generated during PLD can be used for anomaly detection and the prediction of thin film growth kinetics. We develop multi-output (2 + 1)D convolutional neural network regression models that extract deep features from plume dynamics that not only correlate with the measured chamber pressure and incident laser energy, but more importantly, predict parameters of an auto-catalytic film growth model derived from in situ laser reflectivity experiments. Our results demonstrate how ML with in situ plume diagnostics data in PLD can be utilized to maintain deposition conditions in an optimal regime. Further, the predictive capabilities of plume dynamics on the kinetics of film growth or other film properties prior to deposition provides a means for rapid pre-screening of growth conditions for the non-expert, which promises to accelerate materials optimization with PLD.
36 MATERIALS SCIENCE↗
Utilization of coupled eigenmodes in Akiyama atomic force microscopy probes for bimodal multifrequency sensing
Akiyama atomic force microscopy probes represent a unique means of combining several of the desirable properties of tuning fork and cantilever probe designs. As a hybridized mechanical resonator, the vibrational characteristics of Akiyama probes result from a complex coupling between the intrinsic vibrational eigenmodes of its constituent tuning fork and bridging cantilever components. Here, through a combination of finite element analysis modeling and experimental measurements of the thermal vibrations of Akiyama probes, we identify a complex series of vibrational eigenmodes and measure their frequencies, quality factors, and spring constants. We then demonstrate the viability of Akiyama probes to perform bimodal multi-frequency force sensing by performing a multimodal measurement of a surface's nanoscale photothermal response using photo-induced force microscopy imaging techniques. Further performing a parametric search over alternative Akiyama probe geometries, we propose two modified probe designs to enhance the capability of Akiyama probes to perform sensitive bimodal multifrequency force sensing measurements.
77 NANOSCIENCE AND NANOTECHNOLOGY↗
Serial Scanning and Registration of High Resolution Quantitative Computed Tomography Volume Scans for the Determination of Local Bone Density Changes
Progress in development of the methods required to study bone remodeling as a function of time is reported. The following topics are presented: 'A New Methodology for Registration Accuracy Evaluation', 'Registration of Serial Skeletal Images for Accurately Measuring Changes in Bone Density', and 'Precise and Accurate Gold Standard for Multimodality and Serial Registration Method Evaluations.'
Whalen, Robert T.↗
Nanoscale x-ray and electron tomography
We present that three-dimensional (3D) tomographic imaging of the structural, chemical, and physical properties of a material provides key knowledge that links the structure of a material to both its processing and structure that is central to studies across a broad spectrum of materials. For many decades, tomography using x-rays or electrons has proven to be an essential 3D characterization tool. In recent years, advances in technology have significantly pushed the envelope of these techniques in many respects, enabling new imaging capabilities at the nanometer and atomic scale. This article highlights several such developments in nanoscale x-ray and electron tomography. The five articles that appear in this issue of MRS Bulletin discuss research frontiers that include multimodal x-ray tomography at the nanoscale, x-ray spectroscopic tomography, dark-field x-ray microscopy, electron nanotomography for functional nanomaterials, and atomistic imaging by electron tomography. Lastly, these articles give a holistic view of the status of these techniques and promising future directions, as well highlighting their applications for scientific problems.
36 MATERIALS SCIENCE↗
The Zwicky Transient Facility Bright Transient Survey. III. BTSbot: Automated Identification and Follow-up of Bright Transients with Deep Learning
Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.
Rehemtulla, Nabeel (ORCID:0000000256832389)↗
Digital Beamforming Scatterometer
This paper discusses scatterometer measurements collected with multi-mode Digital Beamforming Synthetic Aperture Radar (DBSAR) during the SMAP-VEX 2008 campaign. The 2008 SMAP Validation Experiment was conducted to address a number of specific questions related to the soil moisture retrieval algorithms. SMAP-VEX 2008 consisted on a series of aircraft-based.flights conducted on the Eastern Shore of Maryland and Delaware in the fall of 2008. Several other instruments participated in the campaign including the Passive Active L-Band System (PALS), the Marshall Airborne Polarimetric Imaging Radiometer (MAPIR), and the Global Positioning System Reflectometer (GPSR). This campaign was the first SMAP Validation Experiment. DBSAR is a multimode radar system developed at NASA/Goddard Space Flight Center that combines state-of-the-art radar technologies, on-board processing, and advances in signal processing techniques in order to enable new remote sensing capabilities applicable to Earth science and planetary applications [l]. The instrument can be configured to operate in scatterometer, Synthetic Aperture Radar (SAR), or altimeter mode. The system builds upon the L-band Imaging Scatterometer (LIS) developed as part of the RadSTAR program. The radar is a phased array system designed to fly on the NASA P3 aircraft. The instrument consists of a programmable waveform generator, eight transmit/receive (T/R) channels, a microstrip antenna, and a reconfigurable data acquisition and processor system. Each transmit channel incorporates a digital attenuator, and digital phase shifter that enables amplitude and phase modulation on transmit. The attenuators, phase shifters, and calibration switches are digitally controlled by the radar control card (RCC) on a pulse by pulse basis. The antenna is a corporate fed microstrip patch-array centered at 1.26 GHz with a 20 MHz bandwidth. Although only one feed is used with the present configuration, a provision was made for separate corporate feeds for vertical and horizontal polarization. System upgrades to dual polarization are currently under way. The DBSAR processor is a reconfigurable data acquisition and processor system capable of real-time, high-speed data processing. DBSAR uses an FPGA-based architecture to implement digitally down-conversion, in-phase and quadrature (I/Q) demodulation, and subsequent radar specific algorithms. The core of the processor board consists of an analog-to-digital (AID) section, three Altera Stratix field programmable gate arrays (FPGAs), an ARM microcontroller, several memory devices, and an Ethernet interface. The processor also interfaces with a navigation board consisting of a GPS and a MEMS gyro. The processor has been configured to operate in scatterometer, Synthetic Aperture Radar (SAR), and altimeter modes. All the modes are based on digital beamforming which is a digital process that generates the far-field beam patterns at various scan angles from voltages sampled in the antenna array. This technique allows steering the received beam and controlling its beam-width and side-lobe. Several beamforming techniques can be implemented each characterized by unique strengths and weaknesses, and each applicable to different measurement scenarios. In Scatterometer mode, the radar is capable to.generate a wide beam or scan a narrow beam on transmit, and to steer the received beam on processing while controlling its beamwidth and side-lobe level. Table I lists some important radar characteristics
Rincon, Rafael F.↗
Venus Radar Mapper (VRM) - Multimode radar system design
The paper describes the radar design of the Venus Radar Mapper (VRM), which is intended to acquire global radar imaging and altimetry data of the Venus surface. The radar design requirements are satisfied through the use of an existing Voyager antenna for the SAR function and newly developed sensor and altimeter antenna subsystems. The sensor utilizes a block adaptive quantizer to maximize science data return with minimum transmission of radar data back to earth.
Johnson, William T. K.↗
Multimodal Atomic Force Microscopy for the Characterization of Metallic Particulates
This study investigates the utility of multimodal, or functional, atomic force microscopy (AFM) for the characterization of individual particles and particle ensembles. In single-particle analyses, AFM imaging modes provided orthogonal insights into mechanical and magnetic properties that are not accessible through conventional electron microscopy. Although the experiments were inherently delicate and time-intensive, with an observed sample loss rate of approximately 30%, these techniques enabled the qualitative differentiation of grain structures and magnetic domains, underscoring the challenges of experimental robustness. For particle ensembles, AFM enabled the extraction of reliable 2D and 3D particle size distributions. However, efforts to chemically differentiate particles based on mechanical property contrasts were limited by scaling effects and the qualitative nature of the data. Overall, multimodal AFM offers valuable complementary information, but its application requires careful consideration of methodological limitations, particularly for sample integrity, calibration, and scalability of mechanical and magnetic measurements. This report is organized to first address the application of AFM to single-particle analysis using various imaging modalities, followed by its potential role in ensemble-level particle screening and differentiation.
36 MATERIALS SCIENCE↗
Are Phosphatidic Acids Ubiquitous in Mammalian Tissues or Overemphasized in Mass Spectrometry Imaging Applications?
Abstract Mass spectrometry imaging (MSI) is an invaluable tool for the spatial visualization of molecules in vivo. However, the question of whether observed annotations are endogenous or artificial (i. e., from in‐source fragmentation) is critical and has been largely unexplored in multimodal MSI. In matrix‐assisted laser desorption/ionization (MALDI)‐MSI datasets from researchers worldwide, PAs were found to represent up to 18 % of annotations in rat brain. Rat brain was additionally imaged here using nanospray desorption electrospray ionization (nano‐DESI), a softer ionization strategy. No PAs observed with MALDI were present in the nano‐DESI dataset. Further investigation strongly indicated lipid fragmentation to PAs for MALDI‐MSI, but not with nano‐DESI‐MSI. We finally extend this observation to the MALDI‐MSI analyses of human tissues, showing that PA annotations comprised up to 16 % of annotations. Therefore, this study shows that MSI annotations should be carefully interrogated, as in‐source fragmentation or modification of lipids may contribute substantially to false annotations and incorrect biological interpretations.
Vandergrift, Gregory W.↗
High Cooperativity Using a Confocal-Cavity–QED Microscope
Cavity quantum electrodynamics (QED) with cooperativity far greater than unity enables high-fidelity quantum sensing and information processing. The high-cooperativity regime is often reached through the use of short single-mode resonators. More complicated multimode resonators, such as the near-confocal optical Fabry-Pérot cavity, can provide intracavity atomic imaging in addition to high cooperativity. This capability has recently proved important for exploring quantum many-body physics in the driven-dissipative setting. In this work, we show that a confocal-cavity–QED microscope can realize cooperativity in excess of 110. This cooperativity is on par with the very best single-mode cavities (which are far shorter) and 21 times greater than single-mode resonators of similar length and mirror radii. The 1.7-µm imaging resolution is naturally identical to the photon-mediated interaction range. We measure these quantities by determining the threshold of cavity superradiance when small optically tweezed BoseEinstein condensates are pumped at various intracavity locations. Transmission measurements of an ex situ cavity corroborate these results. We provide a theoretical description that shows how cooperativity enhancement arises from the dispersive coupling to the atoms of many near-degenerate modes.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Improved Fundamental Understanding of Aluminum Chemistry and Interactions of Aluminate Anion with Co-Anions: ORNL Project Progress Report
The U.S. Department of Energy (DOE)’s Hanford Site in Washington State houses 177 underground storage tanks containing millions of gallons of nuclear and chemical waste with high aluminum content. Aluminum (Al) salt reactions with strong bases produce aluminum hydroxides, like boehmite (γ-AlOOH), which are main components of insoluble nuclear waste sludge. Understanding the morphology, crystallinity, and dissolution behavior of boehmite under waste tank conditions is necessary for improving waste management and mitigation strategies. The ORNL team uses in situ multimodal analysis strategy to study Al chemistry of simulated tank waste using microfluidic reactors and advanced chemical imaging and mass spectrometry (MS) techniques. Because the SALVI device is vacuum compatible and transferrable among different platforms, we can use it in scanning electron microscopy (SEM), vacuum ultraviolet single photon mass spectrometry (VUV SPI-MS), and time-of-flight secondary ion mass spectrometry (ToF-SIMS) to study the chemical speciation and colloid stability in liquids in this project. Additionally, ex situ transmission electron microscopy (TEM) and x-ray diffraction (XRD) spectroscopy can be used to verify particle phase to further the understanding of the Al-bearing phases. This report gives a summary of the technical progress of the ORNL tasks. A plan for year 2 performance is recommended in the summary.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗