Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Exploring Causal Physical Mechanisms via Non-Gaussian Linear Models and Deep Kernel Learning: Applications for Ferroelectric Domain Structures

Rapid emergence of multimodal imaging in scanning probe, electron, and optical microscopies has brought forth the challenge of understanding the information contained in these complex data sets, targeting the intrinsic correlations between different channels, and further exploring the underpinning causal physical mechanisms. Here, we develop such an analysis framework for Piezoresponse Force Microscopy. We argue that under certain conditions, we can bootstrap experimental observations with the prior knowledge of materials structure to get information on certain nonobserved properties, and demonstrate linear causal analysis for PFM observables. We further demonstrate that the strength of individual causal links between complex descriptors can be ascertained using the deep kernel learning (DKL) model. In this DKL analysis, we use the prior information on domain structure within the image to predict the physical properties. This analysis demonstrates the correlative relationships between morphology, piezoresponse, elastic property, etc., at nanoscale. The prediction of morphology and other physical parameters illustrates a mutual interaction between surface condition and physical properties in ferroelectric materials. Overall, this analysis is universal and can be extended to explore the correlative relationships of other multichannel data sets, and allow for high-fidelity reconstruction of underpinning functionalities and physical mechanisms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Real-time Object Bounding in LiDAR Data With Computer Vision

The Multimodal Measurement System is a roadside radiation measurement testbed used to detect radiation sources in passing vehicles. It works by combining sensor signals from various modalities to produce a thorough scan of the source. A LiDAR sensor is used to measure the dimensions of the vehicle and provide a velocity estimate. However, the current LiDAR setup uses propriety software for which the source code is unavailable and cannot be updated to improve performance. Therefore, it is imperative to the accuracy of the analysis to create a custom vehicle detection that can return the dimensions and velocity of passing vehicles in real time. This new custom detection is written in C++ using the PointCloud Library, which keeps it lightweight. It also utilizes Docker and the Robot Operating System, which allows the versatility of running both on a small computer or the Lawrence Livermore National Laboratory cluster while utilizing different models of LiDAR sensors. The custom detection outperforms the current detection model, which increases the accuracy of radiation source detection.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗
DOE OSTI2020

Connecting Femtosecond Transient Absorption Microscopy with Spatially Coregistered Time Averaged Optical Imaging Modalities

Multimodal all-optical imaging involving coregistered femtosecond transient absorption microscopy (TAM), time-integrated photoluminescence (PL), and steady-state modalities such as confocal reflectance and transmission offers an appealing approach to gain a comprehensive understanding of complex electronic excited-state phenomena in spatially heterogeneous systems. A unique combination of these modalities allows us to unravel not only the competing electronic excited-state dynamical processes but also the underlying morphological information with simultaneous high temporal and spatial resolution. However, correlating the various images obtained from time-resolved and time-independent modalities is generally nontrivial and particularly challenging when the electronic dynamics under study evolve in both time and space. Here, we demonstrate a new approach for rationally correlating time-resolved microscopy with coregistered time-integrated or steady-state modalities. Specifically, our approach involves an extended global lifetime analysis of the time-resolved microscopic data set to separate distinct dynamical processes taking place on commensurate time scales, and the resulting decay-associated amplitude maps (DAAMs) were applied to explore correlations with the images acquired using time-independent modalities. The feasibility of our approach was validated through analyzing a multimodal data set acquired from a thin film of chloride-containing mixed lead halide perovskites (CH 3 NH 3 PbI 3–x Cl x ) using femtosecond transient absorption, time-integrated PL, and confocal reflectance microscopies. Analysis of the results obtained enable us to gain new insight into the complex ultrafast relaxation dynamics in this highly heterogeneous system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Multimodal X-ray nano-spectromicroscopy analysis of chemically heterogeneous systems

Abstract Understanding the nanoscale chemical speciation of heterogeneous systems in their native environment is critical for several disciplines such as life and environmental sciences, biogeochemistry, and materials science. Synchrotron-based X-ray spectromicroscopy tools are widely used to understand the chemistry and morphology of complex material systems owing to their high penetration depth and sensitivity. The multidimensional (4D+) structure of spectromicroscopy data poses visualization and data-reduction challenges. This paper reports the strategies for the visualization and analysis of spectromicroscopy data. We created a new graphical user interface and data analysis platform named XMIDAS (X-ray multimodal image data analysis software) to visualize spectromicroscopy data from both image and spectrum representations. The interactive data analysis toolkit combined conventional analysis methods with well-established machine learning classification algorithms (e.g. nonnegative matrix factorization) for data reduction. The data visualization and analysis methodologies were then defined and optimized using a model particle aggregate with known chemical composition. Nanoprobe-based X-ray fluorescence (nano-XRF) and X-ray absorption near edge structure (nano-XANES) spectromicroscopy techniques were used to probe elemental and chemical state information of the aggregate sample. We illustrated the complete chemical speciation methodology of the model particle by using XMIDAS. Next, we demonstrated the application of this approach in detecting and characterizing nanoparticles associated with alveolar macrophages. Our multimodal approach combining nano-XRF, nano-XANES, and differential phase-contrast imaging efficiently visualizes the chemistry of localized nanostructure with the morphology. We believe that the optimized data-reduction strategies and tool development will facilitate the analysis of complex biological and environmental samples using X-ray spectromicroscopy techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗
DOE OSTI2023

An Agenda for Multimodal Foundation Models for Earth Observation

Archives of remote sensing (RS) data are increasing swiftly as new sensing modalities with enhanced spatiotemporal resolution become operational. While promising new breakthroughs, the sheer volume of RS archives stretches the limits of human analysts and existing AI tools, as most models are: i) limited to single data modalities; ii) task-specific; iii) heavily reliant on labeled data. The emerging Foundation Models (FMs) have the potential to address these limitations. Trained on vast unlabeled datasets through self-supervised learning, FMs enable generic feature extraction that facilitate specialization to a wide variety of downstream tasks. This paper describes a vision towards an FM for multimodal Earth Observation data (FM4EO), discussing key building blocks and open challenges. We put particular emphasis on multimodal reasoning, a topic underexplored in EO. Our ultimate goal is a practical path toward FM4EO with capacity to unlock breakthroughs in few-shot learning scenarios, multimodal geographic knowledge integration, synthesis, and hypothesis generation.

Ambrozio Dias, Philipe↗
DOE OSTI2026

Multimodal framework for the joint analysis of single-cell RNA and T cell receptor sequencing data predicts T cell response to cancer immunotherapy

T cell states are prognostic in different cancer types. Recent technologies enable joint profiling of T cell RNA and T cell receptor (TCR) sequences at single-cell resolution. Here we present the TCR-RNA Integrating Model (TRIM), a multi-modal variational autoencoder framework that integrates RNA-TCR data and predicts T cell clonality and transcriptional states. TRIM learns a shared representation of the data conditioned on patient, tissue source, and treatment timepoint. We applied TRIM to three independent datasets that included T cells collected before and after checkpoint inhibitor treatment, sourced either from blood and tumor biopsies in patients with head and neck squamous cell carcinoma and colorectal cancer, or from tumor and adjacent tissue in a pan-cancer dataset. In all settings, TRIM accurately predicted intra-tumor T cell clonal expansion and transcriptional status based on T cells from blood or normal tissue before treatment, demonstrating its utility in modeling multimodal T cell data and predicting T cell response to treatment and disease progression.

60 APPLIED LIFE SCIENCES↗