Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “modal model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Unsupervised physics-informed disentanglement of multimodal data

Here, we introduce physics-informed multimodal autoencoders (PIMA) - a variational inference framework for discovering shared information in multimodal datasets. Individual modalities are embedded into a shared latent space and fused through a product-of-experts formulation, enabling a Gaussian mixture prior to identify shared features. Sampling from clusters allows cross-modal generative modeling, with a mixture-of-experts decoder that imposes inductive biases from prior scientific knowledge and thereby imparts structured disentanglement of the latent space. This approach enables cross-modal inference and the discovery of features in high-dimensional heterogeneous datasets. Consequently, this approach provides a means to discover fingerprints in multimodal scientific datasets and to avoid traditional bottlenecks related to high-fidelity measurement and characterization of scientific datasets.

97 MATHEMATICS AND COMPUTING↗

The tracer-BHR4 model for subgrid mixing layers

A model for the passive evolution of turbulent subgrid-scale mixing layers is developed based on the model of tracer-BHR model of Braun & Gore. The new model, tracer-BHR4, mainly differs from the previous iteration in that it aims to replicate the behavior of BHR4, instead of BHR3.1. The coefficients from BHR4 are used and a new model for mixing layer growth is developed to allow the tracer model to reproduce the de-mixing behavior seen in BHR4. Additionally, an improved timestep size controller is introduced. The new model is tested on problems containing Rayleigh-Taylor or Richtmyer-Meshkov mixing layers, and is able to reproduce the behavior of well resolved BHR4 simulations with reasonable accuracy.

97 MATHEMATICS AND COMPUTING↗

A case study in contrastive learning information combination: Application to technical forensics of additive manufacturing filament source identification

Combination of information from disparate data sources into a single decision is a core challenge in many fields, including the field of technical forensics. Technical forensics (TF) utilizes technical characterization of questioned samples to determine properties of that sample; these properties are then used to infer information of forensic interest, such as provenance, age, or attribution. TF is utilized in traditional forensic applications, such as the attribution of material fragments from an explosive, and in nuclear forensic applications, such as the attribution of actinides which have been interdicted out of regulatory control. The challenge of combining information from disparate sources, described alternately by many terms including “Data Fusion” and “Data Integration”, is exacerbated in the technical forensics domain due to at least two factors: the challenge of interpreting each information source singularly, and the relatively small data set sizes available. Extensive literature exists attempting to combine technical forensics information sources, both in manual and automated processes. These attempts are often bespoke to the specific information sources (such as the bi-, tri-, or quad-isotope chart (Moody, Grant, and Hutcheon 2005)), with some emerging examples of simple early- and late- fusion (, respectively). Simultaneous to the information combination efforts described in the previous paragraph, the field of natural language processing attempted (and largely succeeded) in combining information from multiple non-technical information sources. The ecosystem of “multi-modal” language models, which can take text and images as input, and generate text and images as output, became large and diverse by 2025 (Khan et al. 2025). In a generalized sense, many of these methods are trained by learning neural networks which can convert raw text or images into a vector of numbers describing the text or image, hereafter called “embeddings” and the neural networks performing the conversion are called “embedders”. By using a separate embedder for text and images, finding coincident text and images (such as images with their captions), and optimizing the parameters of the embedders such that the embeddings for the text and the image are similar, the field has found a bridge between text and images (Girdhar et al. 2023). It is the contention of the authors of this report that this insight is not limited to text and images but instead can be extended to any modality which can be found coincidently. The subject of the rest of this report is the application of this method to example multi-modal technical forensic data. Some details about the data used in this report are not appropriate for this report, and are included in a companion report (PNNL-38669).

36 MATERIALS SCIENCE↗

From phase decomposition to evaporation: A multi-modal evaluation of thermally degraded model lightweight high-entropy alloy

Lightweight high-entropy alloys (LHEAs) have the potential to replace conventional lightweight materials due to their superior mechanical properties and thermal stability. However, the thermal degradation pattern of LHEAs from phase decomposition to evaporation is not clear. We develop a new Al-based dual phase (FCC + HCP) LHEA—AlTi 0.45 CuZn, and further investigate its thermal degradation behavior for potential high-temperature structural applications. Using multimodal advanced characterization techniques such as differential scanning calorimetry/thermogravimetric analysis, scanning/transmission electron microscopy, and synchrotron X-ray diffraction/pair distribution function (XRD/PDF), a sequence of thermal degradation events beyond the thermal phase stability limit—between 250 and 360 °C—is observed. These include phase decomposition at ~360 °C, Zn evaporation at ~750 °C, and LHEA melting at 880 °C which results in ~25% cumulative weight loss. The formation of Al-Ti phase off the AlTi 0.45 CuZn matrix is due to the largest negative mixing enthalpy for Al-Ti than other binary pairs. Similarly, Zn evaporation from AlTi 0.45 CuZn LHEA is due to its faster evaporation rate than other constituent elements. The high-resolution synchrotron XRD and PDF results support the aforementioned observations; in addition, they reveal local atomic arrangements, local strain, and sluggish grain growth in the LHEA. Among other LHEAs of close density range (5.55 ≤ ρ ≤ 5.85 g/cc), the investigated LHEA exhibits outstanding nano-indentation hardness values due to the coupled grain size effect and HCP phase strengthening of the FCC matrix. As the search for LHEAs for lightweight applications grows, this study shows the potential use of AlTi 0.45 CuZn LHEA for structural applications even at elevated temperatures.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Neural network surrogate models for equations of state

Equation of state (EOS) data provide necessary information for accurate multiphysics modeling, which is necessary for fields such as inertial confinement fusion. Here, we suggest a neural network surrogate model of energy and entropy and use thermodynamic relationships to derive other necessary thermodynamic EOS quantities. We incorporate phase information into the model by training a phase classifier and using phase-specific regression models, which improves the modal prediction accuracy. Our model predicts energy values to 1% relative error and entropy to 3.5% relative error in a log-transformed space. Although sound speed predictions require further improvement, the derived pressure values are accurate within 10% relative error. Our results suggest that neural network models can effectively model EOS for inertial confinement fusion simulation applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Progress on Understanding Rayleigh–Taylor Flow and Mixing Using Synergy Between Simulation, Modeling, and Experiment

Simultaneous advances in numerical methods and computing, theoretical techniques, and experimental diagnostics have all led independently to better understanding of Rayleigh–Taylor (RT) instability, turbulence, and mixing. In particular, experiments have provided significant motivation for many simulation and modeling studies, as well as validation data. Numerical simulations have also provided data that is not currently measurable or very difficult to measure accurately in RT unstable flows. Thus, simulations have also motivated new measurements in this class of buoyancy-driven flows. This overview discusses simulation and modeling studies synergistic with experiments and examples of how experiments have motivated simulations and models of RT instability, flow, and mixing. First, a brief summary of measured experimental and calculated simulation quantities, of experimental approaches, and of issues and challenges in the simulation and modeling of RT experiments is presented. Implicit large-eddy, direct numerical, and large-eddy simulations validated using RT experimental data are then discussed. This is followed by a discussion of modeling using analytical, modal, buoyancy–drag, and turbulent transport models of RT mixing experiments. The discussion will focus on three-dimensional RT mixing arising from multimode perturbations. Finally, this focused review concludes with a perspective on future simulation, modeling, and experimental directions for further research. Research in simulation and modeling of RT unstable flows, coupled with experiments, has made significant progress over the past several decades. This overview serves as an opportunity to both discuss progress and to stimulate future research on simulation and modeling of this unique class of hydrodynamically unstable turbulent flows.

42 ENGINEERING↗

pnnl/TransMED

Transfer Learning From Existing Diseases Via Hierarchical Multi-Modal BERT Models

Ham, Colby↗

MAM4xx

SAND2023-05377O The Modal Aerosol Model with 4 fixed modes (MAM4xx) is a performance-portable, C++ implementation for modeling the chemical reactions of aerosols in the atmosphere. MAM4xx is part of the Energy Exascale Earth System Model (E3SM). The E3SM project is an ongoing Earth system modeling, simulation, and prediction project that optimizes the use of DOE laboratory resources to meet the science needs of the nation and the mission needs of DOE. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Overfelt, James↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗

Small-Signal Stability Analysis of Low-Inertia Power Grids with Inverter-Based Resources and Synchronous Condensers: Preprint

With the potential environmental impacts of conventional fossil fuels and the technology advances of grid interactive power electronics, inverter-based resources (IBRs) are playing a crucial role in modern power grids. However, due to the lack of physical inertia, IBRs are vulnerable to system disturbances. Further, conventional grid-following (GFL) inverters cannot actively establish the frequency and voltage, which could not be a appropriate solution for 100% inverter-based power grids. Grid-forming (GFM) control, as an emerging inverter control function, has drawn great attention in recent years, while it is still under development and pre-mature for large-scale field deployment. A potential solution for gradually transitioning into a 100% inverter-based power grid is to combine both IBRs and synchronous machines into a mixed generation portfolio. More importantly, synchronous machines can be operated as synchronous condensers (SCs) until they are retired. It is also worth mentioning that the stability analysis is of great importance to ensure the smooth transition from existing power grids to 100% inverter-based system, which is the main focus of this work with detailed modeling and modal analysis.

100% renewable↗

Generalist multimodal AI: A review of architectures, challenges and opportunities

Multimodal models are expected to be a critical component to future advances in artificial intelligence. Here, this field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural language processing (NLP) and vision. It is widely hoped that further extending the foundation models to multiple modalities (e.g., text, image, video, sensor, time series, graph, etc.) will ultimately lead to generalist multimodal models, i.e. one model across different data modalities and tasks. However, there is little research that systematically analyzes recent multimodal models (particularly the ones that work beyond text and vision) with respect to the underling architecture proposed. Therefore, this work provides a fresh perspective on generalist multimodal models (GMMs) via a novel architecture and training configuration specific taxonomy. This includes factors such as Unifiability, Modularity, and Adaptability that are pertinent and essential to the wide adoption and application of GMMs. The review further highlights key challenges and prospects for the field and guide the researchers into the new advancements.

Artificial intelligence (AI)↗

Investigation of Best-Practices and Computationally Inexpensive Radiative Exchange Models for Discrete Element Method Modeling of Aluminosilicate Particles in Concentrating Solar Power Environments

Chemically inert, aluminosilicate based particles have been investigated as both a thermal transport and sensible energy storage medium for concentrating solar power facilities. These particles will experience a wide range of operating temperatures (300-1000 K) and handling conditions (dense to dilute falling particle curtains, dense granular flows, or dense structures), requiring specially-designed and optimized infrastructures. The relative influence of collisional and frictional interactions between particles varies based on temperature-dependent particulate properties and greatly impacts the bulk, granular flow behavior. These underlying physics are captured using discrete element method modeling tools. However, this modeling method is computationally expensive as each particle position and interaction is tracked during the simulation. These modeling methods are further complicated by introducing temperature-dependent particle properties, high-temperature radiative exchange, and directional irradiation sources experienced by granular flows in concentrating solar power environments. In this study, coupled experimental and numerical slump testing of aluminosilicate particles was performed and computationally efficient radiative exchange models were evaluated to establish best-practices for discrete element method models for concentrating solar power environments. The three particle types investigated included Carbobead HSP 30 /60, Carbobead CP 30/60, and Granusil 4030. Existing modeling limitations and computationally-efficient multi-modal heat transfer models were evaluated using Aspherix®, a commercial discrete element method software. High-temperature (< 1073 K) slump testing of aluminosilicate particles was performed to investigate the deviation between experimentally-observed and numerically-predicted angles of repose introduced by computation-time reduction practices including the relaxation of the particle elastic modulus and coarse-graining. Coarse-graining is used to use a single modeled particle that is representative of a collection of smaller particles, decreasing the computational cost at the expense of geometric accuracy. Additionally, relaxation of the elastic modulus is used to reduce computational time at the expense of an increased, modeled particle overlap. Prior studies have determined that aluminosilicate particles retain a high elastic modulus at high temperatures (< 1073 K), requiring small simulation timesteps to ensure resolved contact forces resemble appropriate solid mechanics. A parametric study was performed to evaluate the influence of computation time improvements on the deviation between experimental and modeled angle of repose across high temperatures < 1073 K. Additionally, numerical case studies were performed on candidate particle systems at varying porosities and temperatures. These studies were performed to investigate the influence of computationally-efficient radiative-exchange modeling methods coupled to Aspherix® on modeled accuracy and computation time. The recently-developed distance-based approximation was evaluated in estimating radiative exchange between particles and participating surfaces located in close proximity. The distance based approximation was developed to use tabulated estimates of the radiative distribution factor between individual particles and surfaces in close proximity (< 40 particle radii). These methods were expanded to the aluminosilicate particles of interest, including the influence of particle size distributions. To capture radiative exchange between particles and surfaces not in close proximity (> 40 particle radii) and to capture the absorption of directional irradiation from concentrating solar resources, a volumetrically-averaged radiative distribution factor was calculated between the modeled granular flow and surfaces using Monte Carlo ray-tracing for participating media. Volume-averaged absorption and scattering coefficients were predicted using a volumetric discretization of the modeled domain with monodisperse approximations based on geometric optics and experimentally-determined scattering phase functions for aluminosilicate particles.

14 SOLAR ENERGY↗

mmbo (Multi-modal Bayesian Optimization) [SWR-25-119]

This package implements Bayesian Neural Network (BNN) based surrogate models for multi-modal data. These models are fit using a custom Variational Bayes procedure leveraging conjugate posteriors in the last layer of the network, offering more accurate predictions with better-calibrated uncertainty quantification than mean-field Variational Bayes.

Taylor, Ian [National Laboratory of the Rockies (N↗

A Model for Optimally Allocating Curbside Space Among Competing Uses

The emergence of various new forms of urban mobility services in recent years is leading to new pressures on curbside space. Municipalities, the entities typically responsible for managing the curbside, are in many instances handling these growing pressures by reallocating portions of the curbside away from traditional uses (such as metered and residential parking) in favor of uses such as ridehailing, scooter and bike-share corrals. As yet, however, such actions are being undertaken on an ad-hoc basis, due to the rapidly growing complexity of the curbside and the lack of standard analytical approaches. This lack of analytical capability is due to the traditional focus of transportation network modeling being focused predominantly on the interaction of supply and demand on links and nodes, with limited focus on link edges (the curbside). In this paper we address this research need by proposing a framework for modeling inter-modal competition for curbside space, inspired by the classical Bid-Rent Model of urban land use, intended to support curb managers to move towards maximizing the aspects of economic welfare that relate to curb access. In the bi-level model, choices made by the curbside manager impact travelers’ mode choices, and vice versa. We then present a simple numerical case study to demonstrate the properties of the proposed model, showing its tractability, flexibility, and intuitive sensitivity to systematic variation in inputs. The framework demonstrates the type of adaptive and evolving approach needed to maximize benefits from increasingly dynamic curb management strategies. The paper concludes with a brief discussion of future research needs to advance this line of inquiry.

33 ADVANCED PROPULSION SYSTEMS↗

Revealing the evolution of order in materials microstructures using multi-modal computer vision

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La 1−x Sr x FeO 3 . We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

36 MATERIALS SCIENCE↗

Sensitivity Analysis of Modal Parameters of a Jacket Offshore Wind Turbine to Operational Conditions

Accurate estimation of offshore wind turbine (OWT) modal parameters has a prominent effect on the design loads, lifetime prediction, and dynamic response of the system. Modal parameters can vary during the operation of OWTs. This paper studies the variation and sensitivity analysis of an OWT’s modal parameters with respect to operational and environmental conditions. Three finite element models of a jacket-supported OWT at the Block Island Wind Farm are created within the OpenSees, SAP2000, and OpenFAST platforms and validated using experimental measurements. The OpenFAST model is used to simulate the modal parameters of the turbine under various wind speed, rotor speed, power, yaw angle, mean sea level, blade pitch angle, and soil spring values. The model-predicted modal parameters of the first fore–aft (FA) and side–side (SS) modes are compared to those identified from experimental measurements. Results from the simulations show that the first FA natural frequency and damping ratio mostly depend on the rotor speed and wind speed, respectively, while yaw angle and mean sea level do not have a visible effect. It is observed that there is about 8% stiffening in the first FA frequency and an aerodynamic damping of 7.5% during the operation of the OWT.

17 WIND ENERGY↗

Assessing modifications to the Abdul-Razzak and Ghan aerosol activation parameterization (version ARG2000) to improve simulated aerosol–cloud radiative effects in the UK Met Office Unified Model (UM version 13.0)

The representation of aerosol activation is a key source of uncertainty in global composition-climate model simulations of aerosol–cloud interactions. The Abdul-Razzak and Ghan (ARG) activation parameterization is used in several global and regional models that employ modal aerosol microphysics schemes. In this study, we investigate the ability of the ARG parameterization to reproduce simulations with a cloud parcel model and find its performance is sensitive to the geometric standard deviations (widths) of the lognormal aerosol modes. We recommend adjustments to three constant parameters in the ARG equations, which improve the performance of the parameterization for small mode widths and its ability to simulate activation in polluted conditions. For the accumulation mode width of 1.4 used in the Met Office Unified Model (UM), the modifications decrease the mean bias in the activated fraction of aerosols compared to a cloud parcel model from −6.6 % to +1.2 %. We implemented the improvements in the UM and compared simulated global cloud droplet concentrations with satellite observations. The simulated cloud radiative effect changes by −1.43 W m −2 (6 %) and aerosol indirect radiative forcing over the industrial period changes by −0.10 W m −2 (10 %).

Ghosh, Pratapaditya [Carnegie Mellon University, P↗