Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

121 records · Page 7

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning↗

Multimode Metastructures: Novel Hybrid 3D Lattice Topologies

With the rapid proliferation of additive manufacturing and 3D printing technologies, architected cellular solids including truss-like 3D lattice topologies offer the opportunity to program the effective material response through topological design at the mesoscale. The present report summarizes several of the key findings from a 3-year Laboratory Directed Research and Development Program. The program set out to explore novel lattice topologies that can be designed to control, redirect, or dissipate energy from one or multiple insult environments relevant to Sandia missions, including crush, shock/impact, vibration, thermal, etc. In the first 4 sections, we document four novel lattice topologies stemming from this study: coulombic lattices, multi-morphology lattices, interpenetrating lattices, and pore-modified gyroid cellular solids, each with unique properties that had not been achieved by existing cellular/lattice metamaterials. The fifth section explores how unintentional lattice imperfections stemming from the manufacturing process, primarily sur face roughness in the case of laser powder bed fusion, serve to cause stochastic response but that in some cases such as elastic response the stochastic behavior is homogenized through the adoption of lattices. In the sixth section we explore a novel neural network screening process that allows such stocastic variability to be predicted. In the last three sections, we explore considerations of computational design of lattices. Specifically, in section 7 using a novel generative optimization scheme to design novel pareto-optimal lattices for multi-objective environments. In section 8, we use computational design to optimize a metallic lattice structure to absorb impact energy for a 1000 ft/s impact. And in section 9, we develop a modified micromorphic continuum model to solve wave propagation problems in lattices efficiently.

36 MATERIALS SCIENCE↗

Learning instrument invariant characteristics for generating high-resolution global coral reef maps

Coral reefs are one of the most biologically complex and diverse ecosystems within the shallow marine environment. Unfortunately, these underwater ecosystems are threatened by a number of anthropogenic challenges, including ocean acidification and warming, overfishing, and the continued increase of marine debris in oceans. This requires a comprehensive assessment of the world's coastal environments, including a quantitative analysis on the health and extent of coral reefs and other associated marine species, as a vital Earth Science measurement. However, limitations in observational and technological capabilities inhibit global sustained imaging of the marine environment. Harmonizing multimodal data sets acquired using different remote sensing instruments presents additional challenges, thereby limiting the availability of good quality labeled data for analysis. In this work, we develop a deep learning model for extracting domain invariant features from multimodal remote sensing imagery and creating high-resolution global maps of coral reefs by combining various sources of imagery and limited hand-labeled data available for certain regions. This framework allows us to generate, for the first time, coral reef segmentation maps at 2-meter resolution, which is a significant improvement over the kilometer-scale state-of-the-art maps. Additionally, this framework doubles accuracy and IoU metrics over baselines that do not account for domain invariance.

Domain Adaptation↗

Challenges in spatial metabolomics and proteomics for functional tissue unit and single-cell resolution

While transcriptomics is the most broadly applied technology for global spatial and single cell measurements in healthy and diseased tissues. Transcripts are often used as a proxy for protein and even metabolite measurements, but it has become commonly accepted that extrapolating this kind of information is a poor proxy and not a substitute for direct measurement. Within the last decade advanced developments of mass spectrometry-based assays have made these direct measurements not only possible, but routine. Where mass spectrometry has become an enabling technology, and various methods can now detect hundreds of metabolites and thousands of proteins from samples. Not only can this be performed within bulk measurements, but much effort has been directed into translating these measurements to single cells and tissues at cellular resolution. The information obtained from mass spectrometry is now able to trace metabolic events and decipher feedback loops across anatomical regions, connecting genetic and metabolic networks that define phenotypes. Herein, we will broadly overview developments in the field over the past decade, leading into several case studies which highlight the direct measurement of metabolites, proteins, and proteoforms from thinly sliced tissues. Much of this work is feasible due to multidisciplinary team science, and we offer brief perspective on paths forward and the challenges that persist with adoption and application of spatial omics.

59 BASIC BIOLOGICAL SCIENCES↗

Multimode Storage of Quantum Microwave Fields in Electron Spins over 100 ms

In this work, we report long coherence times (up to 300 ms) for near-surface bismuth donor electron spins in silicon coupled to a superconducting microresonator, biased at a clock transition. This enables us to demonstrate the partial absorption of a train of weak microwave fields in the spin ensemble, their storage for 100 ms, and their retrieval, using a Hahn-echo-like protocol. Phase coherence and quantum statistics are preserved in the storage.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards Content Authenticity: Multimodal Fake News Detection and AI-Generated Text Identification

In today’s digital world, the spread of fake news and the rise of AI-generated text have become major threats to content authenticity and public trust. This thesis addresses both challenges through two complementary research directions: detecting fake news using multimodal features, and identifying AI-generated text using semantic and structural reasoning. The first part of the work focuses on fake news detection by introducing a novel model that combines text and image features through a unique rotational attention mechanism. Unlike traditional attention methods, this approach rotates the roles of query, key, and value across modalities to capture deeper interactions. Additionally, the model incorporates external domain information by linking news posts to top-ranked websites from Google search results, which helps assess the credibility of content based on its broader web context. This results in a more reliable and accurate fake news detection system that outperforms existing state-of-the-art methods. The second part presents SGG-ATD, a new framework for detecting AI-generated text. It uses masked language modeling to measure sentence coherence, followed by constructing a graph where keywords—both original and predicted—are connected based on semantic and contextual similarity. A Graph Convolutional Network (GCN) is then used to learn structural relationships within the text for final classification. Experimental results demonstrate that SGG-ATD achieves high F1-scores and consistently outperforms strong baselines. This method contributes to robust AI text detection, supporting accountability and resilience against AI-driven misinformation.

Gupta, Nidhi↗

Integrating the Mobility Energy Productivity Metric Into the Delaware Department of Transportation Statewide Model

The Mobility Energy Productivity (MEP) metric quantifies the quality of mobility at a given location and evaluates how changes in the transportation system impact mobility over time, such as through infrastructure investments. This study demonstrates the integration of the MEP metric into the Delaware Department of Transportation's (DelDOT's) transportation planning process by utilizing data from its statewide travel demand model. Specifically, the study assesses MEP for the 2020 baseline conditions and three alternative scenarios - 2030, Churchman, and Old Orchard - across multiple travel modes, including driving, walking, biking, and transit. The findings highlight that mobility and accessibility in Delaware are primarily supported by the driving mode, while transit services remain relatively limited, often ranking below biking and walking in many areas. In the 2030 scenario, where network operations and opportunities expand as projected, overall statewide accessibility declines, although Kent and Sussex counties experience improvements. The results from the Churchman and Old Orchard scenarios indicate that local network enhancements can positively influence accessibility, though primarily at a localized level, demonstrating MEP's capability to capture regional accessibility changes. Further, the National Renewable Energy Laboratory team successfully transferred MEP operational knowledge to the DelDOT team through dockerization, enabling DelDOT to independently run MEP for various scenarios of interest. Integrating MEP into DelDOT's planning framework supports future project evaluations and decision-making by incorporating access to opportunities as a key dimension of transportation system assessment.

33 ADVANCED PROPULSION SYSTEMS↗

Unveiling the Structure and Dynamics of Water Confined in Colloidal Boehmite Suspensions

Thin fluid layers confined between nanoparticles play an important role in several natural and industrial systems, including radioactive wastes stored in tanks at the U.S. Department of Energy’s Hanford site. Multimodal neutron and computational approaches have been integrated to examine the properties of one, two, and four layers of water (H 2 O or D 2 O) on nanoparticulate, hydrous, or deuterated boehmite (γ-AlOOH or γ-AlOOD). Exposure of deuterated boehmite to H 2 O at 90 °C yielded rapid H/D isotopic exchange likely driven by a Grotthus-like proton-hopping mechanism. The in-plane and out-of-plane vibrations of the structural hydroxyls involved in this exchange were observed for both the hydrated and deuterated boehmite. These observations were confirmed by molecular dynamics simulations that also showed that single water molecules on the (010) surface bond to the structure via four bonds: two from hydrogens (deuteriums) on the water to surrounding oxygens and two from the water’s oxygen to surrounding OD/OH. Bulk water-like properties began to appear once four monolayers of water had been added, but steric crowding limited water diffusion rates once two monolayers had been added. The super-Arrhenius temperature dependence observed at four monolayers indicated glass-like behavior in a well-formed hydrogen-bonding network. Such a network is not sufficiently developed, however, when the surface water coverage is less than four layers. In conclusion, the unique nature of these layers can provide critical information for understanding forces between particles in proximity, and resultant effects on suspension rheology.

Anovitz, Lawrence M. [Oak Ridge National Laborator↗

Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

O'Hare Airport roadway traffic prediction via data fusion and Gaussian process regression

This study proposes an approach of leveraging information gathered from multiple traffic data sources at different resolutions to obtain approximate inference on the traffic distribution of Chicago's O'Hare Airport area. Specifically, it proposes the ingestion of traffic datasets at different resolutions to build spatiotemporal models for predicting the distribution of traffic volume on the road network. Due to its good adaptability and flexibility for spatiotemporal data, the Gaussian process (GP) regression was employed to provide short-term forecasts using data collected by loop detectors (sensors) and supplemented by telematics data. The GP regression is used to make predictions of the distribution of the proportion of sensor data traffic volume represented by the telematics data for each location of the sensors. Consequently, the fitted GP model can be used to determine the approximate traffic distribution for a testing location outside of the training points. Policymakers in the transportation sector can find the results of this work helpful for making informed decisions relating to current and future transportation conditions in the area.

42 ENGINEERING↗

Structure and Sulfur: Tuning the Viscoelastic and Surface Properties of Natural Keratin Fibers

Natural keratin fibers, such as wool, possess a complex hierarchical structure that governs their mechanical properties and surface energy. However, the extent to which these characteristics are influenced by combined contributions of structural variations (e.g., fiber diameter, intermediate filament (IF) packing) and chemical composition (e.g., disulfide bond density) remains poorly understood. In this study, we investigate wool fibers from five sheep breeds (Merino, Polwarth, Cheviot, Eider, and Devon) to elucidate how these factors influence viscoelasticity and surface interactions. Using a multimodal approach integrating interfacial and bulk characterization methods, including inverse gas chromatography (IGC), atomic force microscopy-infrared spectroscopy (AFM-IR), X-ray photoelectron spectroscopy (XPS), uniaxial tensile testing, and synchrotron small-angle X-ray scattering (SAXS), we show that the nanometer-thick 18-methyleicosanoic acid (18-MEA) layer is consistently present across all wool types and plays a key role in governing hydrophobicity and surface heterogeneity. A controlled isothermal treatment at 200 °C, designed to cleave disulfide bonds, results in a nearly 40% reduction in specific surface area across all fiber types, accompanied by a significant decrease in tensile strength and 80% reduction in elongation at break for Merino and Devon wool, but limited influence on the mechanical properties of Eider fibers. Furthermore, rate-dependent tensile testing within the elastic regime reveals distinct viscoelastic responses among the fiber types, suggesting that the sulfur-rich protein matrix surrounding IFs and its structure contribute actively to stress partitioning. Altogether, when combined with conclusions from SAXS measurements of IF spacing, our work offers compelling insights into the role of the keratin-associated protein (KAP) matrix in shaping wool fiber mechanics. Differences in mechanical behavior among wool types, despite similar IF spacing or sulfur content, highlight the importance of matrix composition and cross-linking density, suggesting that the molecular architecture of the KAP network may be a dominant factor in determining fiber performance.

X-ray scattering↗

Impacts of the Conductive Networks on Solid‐State Battery Operation

The micromorphology of composite cathodes is known to play a vital role in determining all-solid-state battery (ASSB) performance. However, much of our current understanding is derived from empirical observations, lacking a deeper mechanistic foundation. The “rocking chair” concept of battery chemistry requires maintaining charge neutrality, emphasizing the necessity of examining electrode micromorphology from the perspective of conductive networks. This study systematically investigates the microscopic electrochemical impacts of conductive network micromorphology by varying the Li + -to-e − channel ratio in cathodes comprising LiNbO 3 -coated LiNi 0.8 Co 0.1 Mn 0.1 O 2 , Li 6 PS 5 Cl, and carbon fibers. Utilizing multiscale synchrotron-based spectro-microscopy, we unravel that unbalanced Li + and e − conducting channels intensify charge polarization within active cathode particles and accelerate their degradation. A further model system with X-ray nano-tomography resolved e − and Li + channels indicates that spatially uniform and well-paired Li + and e − conducting channels are highly desirable as they could promote more uniform lithiation/delithiation, mitigating microscopic electrochemical polarization. Electrode-scale X-ray holotomography analysis reveals that the impact of conductive networks is particle-size-dependent, with smaller cathode particles being more significantly affected. These findings provide mechanistic insights into the interplay between conductive networks and all-solid-state battery operation, laying the groundwork for rational design and optimization of cathode architectures in future solid-state battery technologies.

36 MATERIALS SCIENCE↗

Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties With Deep Learning Multi‐Member and Stochastic Parameterizations

Abstract Deep learning is a powerful tool to represent subgrid processes in climate models, but many application cases have so far used idealized settings and deterministic approaches. Here, we develop stochastic parameterizations with calibrated uncertainty quantification to learn subgrid convective and turbulent processes and surface radiative fluxes of a superparameterization embedded in an Earth System Model (ESM). We explore three methods to construct stochastic parameterizations: (a) a single Deep Neural Network (DNN) with Monte Carlo Dropout; (b) a multi‐member parameterization; and (c) a Variational Encoder Decoder with latent space perturbation. We show that the multi‐member parameterization improves the representation of convective processes, especially in the planetary boundary layer, compared to individual DNNs. The respective uncertainty quantification illustrates that methods (b) and (c) are advantageous compared to a dropout‐based DNN parameterization regarding the spread of convective processes. Hybrid simulations with our best‐performing multi‐member parameterizations remained challenging and crash within the first days. Therefore, we develop a pragmatic partial coupling strategy relying on the superparameterization for condensate emulation. Partial coupling reduces the computational efficiency of hybrid Earth‐like simulations but enables model stability over 5 months with our multi‐member parameterizations. However, our hybrid simulations exhibit biases in thermodynamic fields and differences in precipitation patterns. Despite this, the multi‐member parameterizations enable improvements in reproducing tropical extreme precipitation compared to a traditional convection parameterization. Despite these challenges, our results indicate the potential of a new generation of multi‐member machine learning parameterizations leveraging uncertainty quantification to improve the representation of stochasticity of subgrid effects.

Behrens, Gunnar [Deutsches Zentrum für Luft‐ und R↗