Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “modal model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Beyond the Hype: Navigating the Promise and Pitfalls of Multi-Modal Models for Materials Science

Multi-modal models offer great potential for accelerating discovery in materials and chemical systems, but their adoption raises crucial questions: What materials science challenges are best addressed by multi-modal approaches? How do we weigh the benefits against the resource investment required for multi-modal data acquisition? And critically, how can we optimize experimental workflows to leverage these models effectively? In this presentation, I will delve into the development of multi-modal characterization and analytics, focusing on their application in the demanding fields of next-generation microelectronics and energy storage materials. I will share challenges encountered in designing these workflows, highlighting lessons learned and posing questions that remain unanswered.

AI↗
DOE OSTI2021

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Gumby: Quantifying multi-modal model resiliency

With the rise of cheap data and sensors, more use cases are emerging for multi-input models. Research has shown that including multiple data modalities can improve performance, suggesting that deep learning models can successfully learn to leverage complementary information from different modalities. However, this improved predictive power comes with unanticipated costs: additional inputs change model resiliency and expand the threat space for adversarial attacks. We first provide theoretical underpinnings for how adversarial success scales with input dimension. We then characterize the performance of a suite of multispectral deep learning models with different fusion approaches, quantify their relative reliance on different input bands, and evaluate their robustness to naturalistic and adversarial image corruptions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

The VIBES Are Shifting: Assessing Emergent Capabilities in Multi-Modal Models

Researchers assessing open-source domains such as the internet, and particularly those studying information conflict, often have no single prescribed workflow. In the course of their research, they may need to perform a diverse array of tasks far beyond simply identifying an ever-changing set of objects. These analytical tasks can include ascertaining the provenance of images, understand an image in the context of accompanying text-based data, or identifying indicators of digital image manipulation. They must further be able to do this at the scale of tens of thousands of images or more. Traditional machine vision models have typically lacked the flexibility and breadth of performance sufficient for these needs. The research team from Pacific Northwest National Laboratory assessed the performance of a single baseline CLIP ViT-L model against a series of analytical tasks relevant for the study of online information conflict.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

AstroCLIP: a cross-modal foundation model for galaxies

ABSTRACT We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used – without any model fine-tuning – for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation from both images and spectra, and (4) morphology classification. Our approach to implementing AstroCLIP consists of two parts. First, we embed galaxy images and spectra separately by pre-training separate transformer-based image and spectrum encoders in self-supervised settings. We then align the encoders using a contrastive loss. We apply our method to spectra from the Dark Energy Spectroscopic Instrument and images from its corresponding Legacy Imaging Survey. Overall, we find remarkable performance on all downstream tasks, even relative to supervised baselines. For example, for a task like photometric redshift prediction, we find similar performance to a specifically trained ResNet18, and for additional tasks like physical property estimation (stellar mass, age, metallicity, and specific-star-formation rate), we beat this supervised baseline by 19 per cent in terms of R2. We also compare our results with a state-of-the-art self-supervised single-modal model for galaxy images, and find that our approach outperforms this benchmark by roughly a factor of two on photometric redshift estimation and physical property prediction in terms of R2, while remaining roughly in-line in terms of morphology classification. Ultimately, our approach represents the first cross-modal self-supervised model for galaxies, and the first self-supervised transformer-based architectures for galaxy images and spectra.

Parker, Liam (ORCID:0009000749521674)↗
DOE OSTI2022

Dynamic inflow and unsteady aerodynamics models for modal and stability analyses in OpenFAST

This work presents two aerodynamic models that are used to perform modal and stability analyses of wind turbines. Including aerodynamic effects in stability analyses is important to capture aerodynamic inertia, stiffness, and damping. The two models consist of a dynamic inflow model based on Øye’s model and an unsteady aerodynamics model based on a simplified Beddoes-Leishman dynamic stall model. Both models are written in a continuous-time state-space form, which is the form needed to perform linearizations within OpenFAST. In this article, we present the new models, perform some simple verifications against HAWC2 results, and then perform stability analyses. We investigate the contribution of the aerodynamic effects on the turbine modes, particularly the flapwise modes, which are the most affected. Because of the development presented in this work, Campbell diagrams accounting for dynamic stall and dynamic wake effects were generated for the first time using OpenFAST.

17 WIND ENERGY↗
DOE OSTI2024

A Novel Concentrating Solar Weathering Apparatus for Experimental Validation of Multi-Modal Degradation Models

High-performance coatings for Concentrating Solar Power (CSP) receivers are subjected to remarkable environmental stressors during normal operations. Applied to the receiver tubes, these coatings serve to maximize the solar absorptivity of the receiver, transferring as much heat as possible from the solar collectors into the heat-transfer fluid (HTF). The lifecycle of these coatings is not well-defined, and the harsh operational conditions make them difficult to test. NREL has designed, built, and tested an apparatus to expose these samples to design levels of environmental stress and well beyond, into accelerated and destructive conditions. The chamber is actively cooled, monitored, and has the capability to supply humidification for cycling tests, allowing us to test multi-modal degradation and failure conditions at high temperature, high flux, and high humidity conditions. These conditions can catalyze high-temperature oxidation, mechanical degradation, and other modes of absorptivity loss seen in selective solar receiver coatings. The experimental data can feed lifecycle models for expensive and necessarily resilient materials, offering insights to aid maintenance schedules, technoeconomic analysis, and material industry performance benchmarks. This presentation will demonstrate the apparatus design and performance, as well as initial results for aging on a selective receiver coating.

14 SOLAR ENERGY↗
DOE OSTI2023

Mshock HED Council Request FY24 [Slides]

ICF and HEDP experiments experience complicated loadings including successive shocks, but modeling and analytic work has mostly engaged the simpler shock or shock-reshock case. This is because the co propagating case is difficult to achieve with conventional (non-HED) drivers. Successive shocks will be challenging to model in BHR or modal model interpretations: 1) Ex: Consider the case where long wavelength modes re-invert coherently, but short wavelength nonlinear modes are spun up turbulently. 2) Necessitates more advanced diagnostics and analysis than simple “mixing layers.” High resolution spectral information (concomitant with Ω-EP campaigns) and higher-order moment analyses will be necessary to stress and validate the reduced BHR-type models.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A Deep Multimodal Representation Learning Framework for Accurate Molecular Properties Prediction

Drug discovery is a complex and challenging process, requiring the optimization of candidate compounds to identify those with the potential to become safe and effective drugs. Predicting molecular properties is an indispensable step in the drug discovery pipeline. Traditionally, this process is costly and time-intensive, involving multiple rounds of experiments and clinical trials, rendering it impractical for every candidate compound. Deep learning techniques have emerged as a promising approach to drug discovery to reduce the cost and time required to identify novel drugs. However, prevalent research in deep learning models focused on predicting molecular properties has primarily fixated on single-modal models, which utilize a single modality of data, neglecting the potential benefits of combining different data modalities. To overcome this limitation, we introduce MRL-Mol: a deep \textbf{M}ultimodal \textbf{R}epresentation \textbf{L}earning framework for accurate \textbf{Mol}ecular properties prediction. MRL-Mol harnesses three data modalities: sequence, graph, and image, augmenting the depth of comprehension. Leveraging a large-scale unlabeled dataset~($\sim$1M unique molecules), we pretrain MRL-Mol to extract inter- and intra-modal information. Our study demonstrates the superior performance of MRL-Mol in predicting molecular properties across six benchmark datasets, including both classification and regression tasks. Notably, MRL-Mol outperforms other state-of-the-art molecular properties prediction models. These findings suggest that by combining information from multiple data modalities, MRL-Mol can comprehend molecules better than single-modal deep learning models and identify molecular properties with better accuracy.

Yang, Yuxin↗