Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hybrid model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Physics-guided neural networks with engineering domain knowledge for hybrid process modeling

As neural networks are more frequently used to solve problems in science and engineering, the methods used to incorporate scientific knowledge into these networks are becoming increasingly complex. Here, this work breaks down these complicated techniques into a set of basic strategies which can easily be applied to diverse situations. Several novel neural networks are built using the categories laid out in this work. These networks are tested on simulated data from a continuous stirred tank reactor (CSTR) model to evaluate the advantages provided by each network. The three points demonstrated in this work are: (1) architectural hybrid models can speed up convergence and reduce the amount of data necessary to train a model; (2) adding a physics-guided loss function can improve model generalization and make models more physically consistent; (3) using physics-guided initialization and transfer learning improves accuracy and speeds up convergence, but can harm generalizability if used incorrectly.

42 ENGINEERING↗
DOE OSTI2023

Status Report on Thermal Delivery Modeling in HYBRID

This report details the modeling efforts consistent with the HYBRID repository of the Integrated Energy Systems (IES) program, motivated to develop information data tables characterizing the thermodynamic losses associated with transporting thermal energy over large distances. The described model establishes a methodology to currently characterize the impacts of certain parameters such as distance, piping geometry, and heat transfer fluid among others as well as sets up ability to interconnect the delivery model into Modelica IES simulations in the future. This report describes the modeling efforts completed and describes some of the future studies that will be done using results produced by the modeling efforts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Geothermal well testing pressure prediction by using a hybrid transformer model system: FORGE well use case

Geothermal has huge potential to become an indispensable component in achieving the goal of sustainable energy economy, given its capability to provide consistent baseload power to the electric grid. Injection tests are crucial in geothermal energy system as they naturally help to evaluate reservoir properties, understand fluid flow and even enhance reservoir performance. In this research, we developed a hybrid model system that integrates machine learning (ML) regression, a physics-based mathematical model, and transformer deep learning. Trained and validated using FORGE injection test dataset, this system can forecast the pressure variations both upward and downward over time. The pressure prediction achieved prediction accuracy within 3-6% variance of true pressure values. The system can significantly save time and reduce costs by testing only a few cycles and then using model predictions for further analysis, instead of conducting additional real injection cycle tests. The developed model system also holds promise for designing injection test processes and maintaining well production in geothermal energy. Presented at the IMAGE ‘25 Conference led by Shell.

FORGE↗
DOE OSTI2023

Corrosion of Al-Fe self-pierce riveting joints with multiphysics-based modeling and experiments

Self-piercing riveting (SPR) is an extensively used joining technique to assemble dissimilar materials. However, this joining of the dissimilar materials can generate galvanic/crevice corrosion, which can drastically impact the mechanical properties and the service life of the joint. In this study, a multiphysics-based hybrid modeling approach is developed for the galvanic corrosion of the Al-Fe SPR joints, which can consider the corrosion initiation and corrosion evaluation jointly. Experimental studies are first performed to extract information regarding the corrosion initiation sites, corrosion evolution and overall corrosion induced material loss in SPR joints. The initiation information is then passed onto the multiphysics FE model thus making it a hybrid model. This model can help understand the influences of metal microstructure on the corrosion propagation while the morphology changes can also be analyzed. Using the developed hybrid modeling approach, thorough parametric studies can be performed to explore the coupled impacts of multiple corrosion factors on the corrosion behavior of the joints. The developed hybrid model is validated on the prediction of galvanic corrosion for the SPR joints by comparing with experimental observations.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A hybrid surrogate modeling framework for the Digital Twin of a Fluoride-salt-cooled High-temperature Reactor (FHR)

While nuclear energy is a non-greenhouse-gas emitting energy source, expensive operational costs due to the high-level of safety requirements decreases their competitiveness in the sustainable energy market. Advanced reactor concepts paired with Digital Twins aim to increase the commercialization gains of nuclear energy by reducing operational costs, increasing reactor reliability and enhancing power generation. To support Digital Twin tasks such as real-time autonomous control, proactive maintenance monitoring or optimizing power demand operations, a fast and accurate virtual representation of the Nuclear Power Plant (NPP) is required. The computational cost of high-fidelity, physics-based models are unsuitable for real-time analysis or scalability. Here, in this work, a hybrid surrogate modeling framework is developed fora Fluoride-salt-cooled High-temperature Reactor (FHR) that leverages physics-inspired models for key reactor components and uses data-driven methods for rapid system state space prediction. The Xenon reactivity feedback model is integrated to inform the surrogate model about the reactor core and the homologous pump theory model is the basis for representing pump degradation. Using a detailed, two dimensional thermal hydraulics model to generate data on the FHR, we train a network of Vectorized Autoregressive Moving-Average with eXogenous input (VARMAX) models to predict the remaining state values. The result is a surrogate model that provides a detailed reactor state representation of 41 system states and a pump degradation analysis. The framework is applied to Load Follows profiles, yielding high accuracy and a speedup that is more than 4000x faster compared to the higher- fidelity thermal hydraulics model, enabling real-time operational intelligence and applications in long horizon predictions. While the surrogate model framework is demonstrated for the particular case of FHR, the hybrid physical/data-driven modeling approach including the network of surrogates and the underlying modularity has the potential to be applied to other physical asset systems.

Digital Twins↗
DOE OSTI2022

Validation of SOLPS-ITER simulations with kinetic, fluid, and hybrid neutral models for JET-ILW low-confinement mode plasmas

For JET L-mode plasmas in low-recycling conditions (electron temperature at the outer strike point, T e,ot ≳ 30 eV ), SOLPS-ITER simulations agree within the error bars for the experimental profiles at the low-field side (LFS) divertor target. The peak Balmer-α (Dα ) emission in the LFS divertor agrees within the error bars of the KS3 filterscope diagnostic, but is approximately 30% lower than the peak value of the KT1 spectrometer. Simulations have been performed with fluid, kinetic, and hybrid models for the neutrals. The large fluid-kinetic discrepancies of more than a factor 2 are successfully corrected by using a hybrid fluid-kinetic approach, for which kinetic atoms are transferred to the fluid population when the local Knudsen number of the atom becomes smaller than a user-defined transition Knudsen number Kn t . The hybrid-kinetic discrepancies are limited to a few % for Kn t ≤ 100 . When increasing the upstream density to high-recycling conditions, at the onset of detachment ( T e,ot ≈ 5 eV ), the simulations predict more than a factor 2 lower peak ion saturation current to the LFS divertor than the experiments. Also the Dα emission is underpredicted with approximately a factor 2. For these high-recycling conditions, the fluid-kinetic discrepancies are limited to maximum 50%, which are again corrected by using the hybrid approach.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

A hybrid smoothed-particle hydrodynamics model of oxide skins on molten aluminum

A computational model of aluminum melting is proposed which captures both the thermal fluid-solid phase transition and the mechanical effects of oxidation. The model hybridizes ideas from smoothed particle hydrodynamics and bonded particle models to simulate both hydrodynamic flows and solid elasticity. Oxidation is represented by dynamically adding and deleting spring-like bonds between surface fluid particles to represent the formation and rupture of the oxide skin. Various complex systems are simulated to demonstrate the adaptability of the method and to illustrate the significant impact of skin properties on material flow. As a result, initial comparison to experiments of a melting aluminum cantilever highlights that the computational model can reproduce key qualitative features of aluminum relocation.

Clemmer, Joel Thomas↗
DOE OSTI2021

Jet wake from linearized hydrodynamics

We explore how to improve the hybrid model description of the particles originating from the wake that a jet produced in a heavy ion collision leaves in the droplet of quark-gluon plasma (QGP) through which it propagates, using linearized hydrodynamics on a background Bjorken flow. Jet energy and momentum loss described by the hybrid model become currents sourcing linearized hydrodynamics. By solving the linearized hydrodynamic equations numerically, we investigate the development of the wake in the dynamically evolving droplet of QGP, study the effect of viscosity, scrutinize energy-momentum conservation, and check the validity of the linear approximation. We find that linearized hydrodynamics works better in the viscous case because diffusive modes damp the energy-momentum perturbation produced by the jet. We calculate the distribution of particles produced from the jet wake by using the Cooper-Frye prescription and find that both the transverse momentum spectrum and the distribution of particles in azimuthal angle are similar in shape in linearized hydrodynamics and in the hybrid model. Their normalizations are different because the momentum-rapidity distribution in the linearized hydrodynamics analysis is more spread out, due to sound modes. Since the Bjorken flow has no transverse expansion, we explore the effect of transverse flow by using local boosts to add it into the Cooper-Frye formula. After including the effects of transverse flow in this way, the transverse momentum spectrum becomes harder: more particles with transverse momenta bigger than 2 GeV are produced than in the hybrid model. Although we defer implementing this analysis in a jet Monte Carlo, as would be needed to make quantitative comparisons to data, we gain a qualitative sense of how the jet wake may modify jet observables by computing proxies for two example observables: the lost energy recovered in a cone of varying open angle, and the fragmentation function. We find that linearized hydrodynamics with transverse flow effects added improves the description of the jet wake in the hybrid model in just the way that comparison to data indicates is needed. Our study illuminates a path to improving the description of the wake in the hybrid model, highlighting the need to take into account the effects of both transverse flow and the broadening of the energy-momentum perturbation in spacetime rapidity on particle production.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

A novel implicit hybrid machine learning model and its application for reinforcement learning

A novel methodology to develop implicit hybrid models is presented. PyTorch is used to integrate physics-based equations with machine learning models. Automatic differentiation of the hybrid model is leveraged to solve the implicit equations. Iterative solving enables gradient based updates to the machine learning model. The novel methodology is compared to an explicit hybrid approach on a continuously stirred tank reactor (CSTR). The novel method results in a lower modelling error. Both hybrid models effectively train with noisy data. To test the implicit hybrid model, it is employed as a reinforcement learning (RL) training model. The RL algorithm trained on the hybrid model outperforms real time optimization of the CSTR and performs nearly as well as RL trained directly on the CSTR and a traditional gradient based approach. Training RL directly on the CSTR requires over 60,000 system interactions compared to 6000 historical data points for hybrid model development.

42 ENGINEERING↗
DOE OSTI2023

Charge order in the kagome lattice Holstein model: a hybrid Monte Carlo study

The Holstein model is a paradigmatic description of the electron-phonon interaction, in which electrons couple to local dispersionless phonon modes, independent of momentum. The model has been shown to host a variety of ordered ground states such as charge density wave (CDW) order and superconductivity on several geometries, including the square, honeycomb, and Lieb lattices. In this work, we study CDW formation in the Holstein model on the kagome lattice, using a recently developed hybrid Monte Carlo simulation method. We present evidence for √3 × √3 CDW order at an average electron filling of < n > = 2/3 per site, with an ordering wavevector at the K-points of the Brillouin zone. We estimate a phase transition occurring at T c ≈ t/18, where t is the nearest-neighbor hopping parameter. Our simulations find no signature of CDW order at other electron fillings or ordering momenta for temperatures T ≥ t/20.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Machine-Learning-Assisted Hybrid Earth System Modelling

We propose a novel hybrid modeling approach that combines a physics-based, numerical model of the Earth system with a machine learning model. We also envision to integrate the hybrid model training with a data assimilation cycle, so that new observations update both the state estimate used as initial conditions and the machine learning model parameters.

58 GEOSCIENCES↗
DOE OSTI2023

The Construction of Reduced Order Models for the HYBRID Repository

Reduced order models (ROMs) present an opportunity to reduce the computational burden of IES analysis using HYBRID models without significantly sacrificing data accuracy. Other applications of ROMs are digital twins, stochastic optimization studies, model exporting, and protection of proprietary information. In this paper the capability of creating ROMs of the models within the HYBRID repository will be demonstrated. Specifically, a linear regression ROM of a gas turbine and a dynamic mode decomposition with control (DMDc) ROM of a lithium-ion battery are constructed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Thermal Extraction Modeling within HYBRID: Nominal and Extraction Conditions in Advanced Reactor Systems

This document details continuing development of thermal extraction modeling within the HYBRID repository, the modeling repository of the Integrated Energy Systems program at Idaho National Laboratory. The focus of the thermal extraction work is setting up template energy conversion systems for advanced reactor systems. Based on these nominal conditions, the IES team is developing extraction capability maps that present the system thermal-to-electric efficiency of the remaining system and the mass extraction fraction capability of these systems when extracting steam at various pressures to send steam to applications at a lower given pressure. These curves are mapped on what has become termed “whale chart” due to the appearance of the results. Multiple advanced reactor systems are complete, and it is anticipated that all four of the main advanced reactor types: advanced light-water reactors, high temperature gas reactors, liquid metal fast reactors, and molten salt reactors, will be complete by the end of the fiscal year.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models

As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.

Herron, Emily [ORNL] (ORCID:0000000273008172)↗
DOE OSTI2025

Differentiable hybrid neural network approach for enhancing reactor dynamics simulations

Reactor dynamics simulations provide essential insights into the time-dependent behavior of nuclear reactors under various operating conditions. However, high-fidelity simulations can be computationally intensive, requiring significant computational resources. Here, to address this challenge, this study employs a differentiable hybrid model that utilizes neural networks as a corrector to enhance the performance of a low-fidelity simulation, aligning its predictions with those of a high-fidelity simulation. Low-fidelity and high-fidelity simulations were obtained by adjusting the mesh size in the System Dynamics Analysis Tool. The differentiable hybrid model was trained in two approaches: time-step-wise and sequence-wise. It was then applied to simulate various transients in a molten salt reactor. Its performance was evaluated by comparing its responses to transients against those of the high-fidelity simulation. An additional approach was performed using a data-driven model to correct the low-fidelity simulation. In comparison, the differentiable hybrid model showed significant improvements in transient prediction, effectively addressing the limitations of the low-fidelity simulations. The results highlighted the robustness of the differentiable hybrid model in both training approaches. It delivered simulations that were at least 3.8 times faster than high-fidelity models. In the time-step-wise approach, it achieved at least a 39% improvement in accuracy. In the sequence-wise approach, it showed at least an 81% accuracy improvement over the full transient. This approach offers a promising path for improving computational efficiency without compromising accuracy in nuclear reactor simulations, making it suitable for real-time digital twin applications.

42 - ENGINEERING↗
DOE OSTI2023

One System, Many Models: Designing a Surrogate Model for Sulfur Thermal Energy Storage: Preprint

Industrial process heating (IPH) relies primarily on thermal energy generated by fossil fuel combustion to produce, treat, and alter manufactured goods. Thermal energy storage (TES) helps reduce the carbon footprint of IPH systems by facilitating the utilization of renewable and waste heat sources. A promising new TES technology uses elemental sulfur as the heat-storage medium. The design of sulfur TES systems can be evaluated with the aid of computational fluid dynamics (CFD). However, the computational cost of such CFD efforts is prohibitive to comprehensive optimizations over design parameters. To reduce this computational cost, machine learning (ML) models can be developed to act as surrogates for CFD. In this paper, we describe the process of building and evaluating surrogate ML models for facilitating optimization of sulfur TES systems for IPH. To enforce the thermodynamic relationship between the two modeled quantities, we develop a hybrid model for sulfur temperature using both direct predictions of temperature and calculations of temperature from predictions of the heat transfer coefficient. The hybrid model enforces this constraint at the expense of the slightly reduced accuracy compared to two disjoint models. The overall high accuracy observed in our model evaluation demonstrates the usefulness of such surrogate modeling for studying TES systems. This work contributes to the field of TES surrogate modeling by offering a novel accurate hybrid approach to predicting simultaneously the heat transfer coefficient and temperature of the heat storage medium.

computational fluid dynamics↗
DOE OSTI2022

Modeling mesoscale fission gas behavior in UO2 by directly coupling the phase field method to spatially resolved cluster dynamics

Abstract Fission gas release within uranium dioxide nuclear fuel occurs as gas atoms diffuse through grains and arrive at grain boundary (GB) bubbles; these GB bubbles grow and interconnect with grain edge bubbles; and grain edge tunnels grow and connect to free surfaces. In this study, a hybrid multi-scale/multi-physics simulation approach is presented to investigate these mechanisms of fission gas release at the mesoscale. In this approach, fission gas production, diffusion, clustering to form intragranular bubbles, and re-solution within grains are included using spatially resolved cluster dynamics in the Xolotl code. GB migration and intergranular bubble growth and coalescence are included using the phase field method in the MARMOT code. This hybrid model couples Xolotl to MARMOT using the MultiApp and Transfer systems in the MOOSE framework, with Xolotl passing the arrival rate of gas atoms at GBs and intergranular bubble surfaces to MARMOT and MARMOT passing evolved GBs and bubble surface positions to Xolotl. The coupled approach performs well on the two-dimensional simulations performed in this work, producing similar results to the standard phase field model when Xolotl does not include fission gas clustering or re-solution. The hybrid model performs well computationally, with a negligible cost of coupling Xolotl and MARMOT and good parallel scalability. The hybrid model predicts that intragranular fission gas clustering and bubble formation results in up to 70% of the fission gas being trapped within grains, causing the increase in the intergranular bubble fraction to slow by a factor of six. Re-solution has a small impact on the fission gas behavior at 1800 K but it has a much larger impact at 1000 K, resulting in a twenty-times increase in the concentration of single gas atoms within grains. Due to the low diffusion rate, this increase in mobile gas atoms only results in a small acceleration in the growth of the intergranular bubble fraction. Finally, the hybrid model accounts for migrating GBs sweeping up gas atoms. This results in faster intergranular bubble growth with smaller initial grain sizes, since the additional GB migration results in more immobile gas clusters reaching GBs.

Kim, Dong-Uk↗