Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Review of heat transfer enhancement techniques for single phase flows

The thermal energy exchange between a flowing fluid and its confining channel is a ubiquitous process in modern society. To enhance the fluid-to-wall or wall-to-fluid heat transfer, several techniques have been developed to maximize the contact area between the fluid and the inner wall and/or disrupt the flow to enhance circulation or induce turbulence. Deployment of channels having features capable of enhancing heat transfer enables the reduction of heat exchanger size while maintaining performance. Reduction in equipment size is critical due to the ability to minimize the required volume of costly working fluids and to mitigate potential safety concerns associated with total system fluid volume. Here, a comprehensive review of single-phase heat transfer enhancement techniques is presented. The article provides a thorough comparison by analyzing the heat transfer rate, pressure drop, and other operational aspects. Single-phase heat transfer enhancement methods are divided into active and passive techniques. Active methods such as electrohydrodynamic (EHD), magnetohydrodynamics (MHD), or mechanical motion require external power to create enhancement. Passive methods such as dimples, fins, or tape inserts do not require external input and rely only on surface modification. Although active methods are more expensive and difficult to implement compared to passive techniques, it enables active control of heat transfer augmentation. Finally, this review develops and summarizes key learning data for design optimization enabled by additive manufacturing and machine learning algorithms, helping to inform these next-generation heat exchanger design methodologies for a plethora of modern applications such as electrification of vehicles, computing, and classical industries.

42 ENGINEERING↗

First Ever Polymer Flood Field Pilot To Enhance The Recovery Of Heavy Oils On Alaska’s North Slope - Pushing Ahead One Year Later

In June 2018 the team embarked on an ambitious project to address the slow development pace of Alaska’s 20+ billion barrels heavy oil resource via the first ever polymer flood pilot. Following the successful commencement of the pilot in August 2018, the field demonstration, supporting laboratory experiments and numerical simulation have steadily progressed. A significant amount of valuable data and lessons learned have been collected, and are reported in this paper. The ongoing pilot and the research activities is making headway toward the primary objective of validating the use of polymer flooding for extracting heavy oil in Alaska’s challenging environment. The pilot is conducted in two pre-existing pairs of horizontal injectors and producers in an isolated fault block of the Schrader Bluff heavy oil reservoir at the Milne Point Field. A customized polymer blending and pumping unit injects HPAM polymer at a concentration of 1,750 ppm to achieve a target viscosity of 45 cP. Supporting coreflood laboratory experiments have focused on quantification of polymer retention in the rock, and effect of injection water salinity, polymer, and their combinations on oil recovery. The injection and production response of the pilot flood pattern is utilized to develop a history matched reservoir simulation model for forecasting oil recovery beyond the pilot. Finally, specially designed laboratory experiments address anticipated operating concerns regarding post-polymer breakthrough such as oil-water separation efficiency and polymer induced fouling of heater tubes. Polymer has been injected continuously since startup except for two short equipment modification shutdowns, and more recently a prolonged disruption due to polymer hydration issues at the J-pad field site. Cumulatively, over 600,000 lbs. of polymer has been injected, corresponding to ~7%PV. The two producers show significant decrease in the water cut, gradually increasing oil rate, and no polymer breakthrough. Two main observations from the coreflood are a significant uncertainty in polymer retention values, and positive oil recovery response to low salinity water (2,600 mg/liter TDS). The heterogeneity in the flood pattern presents some challenges in obtaining a robust history matched simulation model. Experimental results on produced fluids treatment indicate the formation of a dense polymer deposit, at certain conditions, on heating tubes that can negatively impact the heat transfer efficiency. The scientific knowledge, including the lessons learned during unanticipated shutdowns, quality control, logistics and field data that is being acquired from this effort has referential value for other planned EOR projects. Finally, by all indications, the polymer field pilot is steadily progressing toward achieving the ultimate goal of unlocking the massive heavy oil resources on Alaska North Slope (ANS).

Dandekar, Abhijit↗

A non-intrusive framework using acoustic signals and deep learning for boiling diagnostics in visual-limited environments

Accurate monitoring of boiling heat transfer is critical for safeguarding high-power systems operating in environments where conventional optical diagnostics are hindered by radiation fields or restricted visual accessibility. This study presents a non-intrusive framework that integrates hydroacoustic sensing with deep learning to infer near-wall boiling characteristics and enable predictive thermal assessment without visual access. In a prototypical subcooled flow-boiling facility representative of the Isotope Production Facility (IPF) at Los Alamos, hydrophones capture boiling-induced acoustic emissions that are transformed into background-removed Short-Time Fourier Transform (STFT) spectrograms. A convolutional neural network (CNN) then regresses heat flux, wall superheat, and key bubble parameters directly from these spectrograms. The CNN achieved predictive accuracy under nominal conditions and demonstrated robustness and generalization under acoustic noise for Signal-to-Noise Ratios (SNRs) down to approximately 0 dB. When integrated into an ANSYS CFX wall-boiling model, the acoustically inferred parameters reproduced boiling curve and critical heat flux (CHF) values consistent with image-based benchmarks. Furthermore, the model retained reliable performance under moderate variations in bulk temperature, flow rate, and hydrophone placement, confirming its generalizability across practical boundary conditions. These results demonstrate the feasibility of hydroacoustic-based deep learning as a viable path toward real-time, radiation-tolerant boiling diagnostics and predictive thermal safety assessment in inaccessible systems such as the IPF.

42 ENGINEERING↗

Development and transferability of neural-network models for plasma-surface interactions

Plasma-surface interactions are increasingly critical to modern technologies; yet, accurate molecular dynamics simulations remain limited by the capabilities of interatomic potentials. Deep Potentials (DPs) promise to revolutionize the field by providing a systematic method for producing accurate interatomic potentials. The primary challenge of DP development is selecting a dataset, which efficiently spans the set of atomic environments one expects to encounter in the subsequent molecular dynamics simulations. The computational cost of density functional theory calculations, which are the typical basis for DP development, makes it impossible to directly verify the quality of a given DP. To address this challenge, we explore the development of a deep-learned interatomic potential, “DeepREBO,” trained to reproduce the behavior of the REBO2 empirical potential, enabling direct validation of training methodology and transferability. Using an active learning framework, we begin with a minimal dataset and iteratively expand it to train a Deep Potential-Smooth Edition model that faithfully reproduces REBO2 results for 25 eV hydrogen bombardment of diamond (001), a particularly challenging case. We show that small, carefully curated datasets can outperform large, unguided ones, with effective models requiring fewer than 15 000 snapshots. Subsequent transferability tests demonstrate that while DeepREBO generalizes well to diamond (111) surfaces, performance degrades for amorphous carbon or higher-energy impacts, highlighting the need for use-case-specific training data. We also evaluate methods to improve short-range repulsion. This study outlines best practices for training robust deep potentials and underscores the importance of dataset design for predictive plasma simulations.

Ab-initio molecular dynamics↗

Knowledge extraction and transfer in data-driven fracture mechanics

Significance Data-driven approaches have launched a new paradigm in scientific research that is bound to have an impact on all disciplines of science and engineering. However, at this juncture, the exploration of data-driven techniques in the century-old field of fracture mechanics is highly limited, and there are key challenges including accurate and intelligent knowledge extraction and transfer in a data-limited regime. Here, we propose a framework for data-driven knowledge extraction in fracture mechanics with rigorous accuracy assessment which employs active learning for optimizing data usage and for data-driven knowledge transfer that allows efficient treatment of three-dimensional fracture problems based on two-dimensional solutions.

Liu, Xing↗

Haze Mitigation in High-Resolution Satellite Imagery using Enhanced Style-Transfer Neural Network and Normalization Across Multiple GPUs

Despite recent advances in deep learning approaches, haze mitigation in large satellite images is still a challenging problem. Due to amorphous nature of haze, object detection or image segmentation approaches are not applicable. Also it is practically infeasible to obtain ground truths for training. Bounded memory capacity of GPUs is another constraint that limits the size of image to be processed. In this paper, we propose a style transfer based neural network approach to mitigate haze in a large overhead imagery. The network is trained without paired ground truths; further, perception loss is added to restore vivid colors, enhance contrast and minimize artifacts. The paper also illustrates our use of multiple GPUs in a collective way to produce a single coherent clear image where each GPU dehazes different portions of a large hazy image.

Park, Byung↗

In Silico Chemical Experiments in the Age of AI: From Quantum Chemistry to Machine Learning and Back

Computational chemistry is an indispensable tool for understanding molecules and predicting chemical properties. However, traditional computational methods face significant challenges due to the difficulty of solving the Schrödinger equations and the increasing computational cost with the size of the molecular system. In response, there has been a surge of interest in leveraging artificial intelligence (AI) and machine learning (ML) techniques to in silico experiments. Integrating AI and ML into computational chemistry increases the scalability and speed of the exploration of chemical space. However, challenges remain, particularly regarding the reproducibility and transferability of ML models. This review highlights the evolution of ML in learning from, complementing, or replacing traditional computational chemistry for energy and property predictions. Starting from models trained entirely on numerical data, a journey set forth toward the ideal model incorporating or learning the physical laws of quantum mechanics. This paper also reviews existing computational methods and ML models and their intertwining, outlines a roadmap for future research, and identifies areas for improvement and innovation. Ultimately, the goal is to develop AI architectures capable of predicting accurate and transferable solutions to the Schrödinger equation, thereby revolutionizing in silico experiments within chemistry and materials science.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhancement of operational Flexibility of Power Plants Using IN740

Headers are crucial components within diverse industries, especially in the energy sector, as they enable the efficient transfer of fluids. The selection of materials for headers is determined by their specific applications; for example, Grade 91 and Grade 92 steels are commonly utilized. In our research, we recommend the adoption of INCONEL alloy 740 due to its exceptional robustness and heat-resistant characteristics. One critical parameter in header systems is the heat transfer coefficient, which directly influences the efficiency of heat exchange processes and can thereby impact the structural integrity of the headers. This coefficient is closely linked with factors such as the Nusselt number, which is influenced by fluid flow characteristics and thermal properties. The flow direction within headers, whether unidirectional or multidirectional—significantly affects the overall dynamics of heat transfer. This research focuses on exploring the behavior of headers, a specific pipeline system component, using ANSYS simulation software. The study aims to predict heat transfer and mechanical behavior within headers under various conditions through steady-state and transient simulations (parts 1 and 2 of the report). Key parameters such as heat transfer coefficient, velocity, and temperature are examined with the goal of optimizing header design. Part 3 of the report addresses the critical yet underexplored relationship between pressure drop and heat transfer coefficients in the transient flow regime within headers, specifically focusing on smooth horizontal circular tubes. Limited experimental work has been conducted in this area, prompting the need for comprehensive analysis. By leveraging machine learning techniques, this research aims to establish a correlation between pressure drop and heat transfer across various flow conditions, including laminar, transient, quasi-turbulent, and turbulent regimes. The data utilized for this analysis were meticulously gathered from existing literature, capturing simultaneous measurements of pressure drops and heat transfer. Part 4: In the context of power plants, header pipes are essential components that significantly influence system performance by facilitating the collection and distribution of steam. This report highlights the critical role of header pipes in enhancing reliability, efficiency, and overall power plant performance. A key aspect of this investigation is shape optimization, which aims to maximize performance while minimizing material usage. By focusing on shape optimization, this research contributes to improved efficiency and a reduced environmental footprint for power plant installations. The methodology developed in this study emphasizes optimizing header shapes to decrease reliance on expensive alloy materials and lower maintenance costs. Furthermore, a case study was conducted using a header from an operational power plant to validate the proposed optimization techniques. Finally, part 5 addresses the challenges associated with flexible operations in boiler systems, the study outlines several strategies for enhancing the durability and reliability of steam headers. Key approaches include material selection, which involves utilizing advanced materials with superior high-temperature properties and enhanced fatigue resistance to extend the lifespan of steam headers. Design modifications are also recommended, focusing on implementing changes that mitigate thermal stress and cyclic loading to reduce the likelihood of failures under varying operating conditions. Additionally, the study emphasizes the importance of regular inspection and monitoring by establishing rigorous protocols to detect early signs of damage, allowing for timely maintenance and minimizing the risks of catastrophic failures. Furthermore, operational guidelines are developed to minimize the frequency and severity of thermal transients, ensuring stable and efficient operations. Collectively, these strategies provide a robust framework for overcoming the unique challenges posed by flexible operation in boiler systems, ultimately contributing to improved reliability and performance in power plant operations. Through this comprehensive approach, the study not only enhances the understanding of pressure drop and heat transfer relationships but also promotes advancements in design and operation that will benefit the entire power generation industry.

01 COAL, LIGNITE, AND PEAT↗

Conditional Generative Adversarial Networks for Solving Heat Transfer Problems

Generative Adversarial Networks (GANs) have been used as a deep learning approach to solving physics and engineering problems. Using deep learning for these problems is attractive in that reasonably accurate models can be inferred from only raw data, eliminating the need to define the exact physical equations governing a problem. We expand on previous work using GANs to generate steady-state solutions to the two-dimensional heat equation. Using a basic conditional GAN (cGAN), we generate accurate solutions for rectangular domains conditioned on four edge boundary conditions (MAE < 0.5%). For finding steady-state solutions over arbitrary two-dimensional domains (not constrained to rectangles), we use a cGAN designed for image-to-image translation. We train this GAN on various types of geometric domains (circles, squares, triangles, shapes with one circular or rectangular hole), achieving accurate results on test data made up of geometries similar to those in training (MAE < 1%). For both of these GANs, we experiment with different loss function terms, showing that a term using the gradients of solution images significantly improves the basic cGAN but not the image-to-image GAN. Lastly, we show that the image-to-image GAN performs poorly when applied to two-dimensional geometries that vary in structure from training data (MAE < 8% for shapes with multiple holes or different shaped holes). This demonstrates the cGAN's lack of generalizability. While the cGAN is an accurate and computationally efficient method when trained and tested on similarly structured data, it is a much less reliable method when applied to data that is slightly different in structure from the training data.

97 MATHEMATICS AND COMPUTING↗

Using Machine Learning to Track Objects Across Cameras

Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

RadAI

A physics-informed neural network for learning the steady-state, one-dimensional radiative transfer equation in plane-parallel geometries for stellar atmosphere applications.

Ristić, Marko [LANL]↗

REIMAGINING HEAT EXCHANGERS FOR NEXT GENERATION ENVIRONMENTAL SYSTEMS

Air-to-refrigerant heat exchangers (HXs) are essential components in space conditioning, refrigeration, and power systems, and recent efforts have focused on making these devices more compact, reducing refrigerant charge and lowering manufacturing costs. Historically, HX innovation has been limited by available computational resources, design tools, and manufacturing constraints. The best available technologies utilize tube-fin and micro- or macro-channel tubes with fins, which are not necessarily the optimal designs achievable with current technology. In this paper, we highlight the latest advancements in air-to-refrigerant HXs, specifically emphasizing innovations achieved through shape and topology optimization. A multi-scale design optimization approach is introduced, alongside similar methods in literature, which enable highly sophisticated shape-optimized tube designs with more than 50% reduction in size and 25% reduction in refrigerant charge, essential for A3 refrigerant charge limit compliance. The frameworks integrate traditional heat and mass transfer science with state-of-the-art machine learning, genetic algorithms, and adjoint algorithms to create novel designs. While many of these innovative designs may not be manufacturable using conventional methods, they allow us explore the boundaries of what is possible. These novel air-to-refrigerant HXs are key enablers for ultra-low-refrigerant charge heat pump and refrigeration systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗

Machine-learning interatomic potentials for interfaces in all-solid-state batteries: Perspectives on training data, model selection, and validation

Interfaces play a pivotal role in dictating the performance and reliability of all-solid-state batteries (ASSBs), where complex electro-chemo-mechanical phenomena at grain boundaries (GBs) and interfaces can lead to degradation and failure. Traditional atomistic simulation methods, such as first-principles calculations and classical molecular dynamics, face limitations in modeling these interfaces due to either high computational cost or insufficient transferability to the diverse atomic environments evolving at interfaces. Machine-learning interatomic potentials (MLIPs) have emerged as a transformative approach, enabling large-scale, high-accuracy simulations of disordered and chemically complex systems by leveraging the predictability of machine learning models trained on first-principles data. Recent applications of MLIPs have demonstrated their ability to capture intricate behaviors at ASSB interfaces, including ion transport, interfacial evolution, and degradation mechanisms, with accuracy and efficiency unattainable by conventional methods. This prospective paper presents comprehensive analysis and practical guidance for MLIP development for GBs and interfaces in ASSBs, with a focus on three key pillars: data generation, model selection, and validation. Here, we review the current state of MLIP applications for GBs and interfaces in both general and ASSB-specific materials, highlighting best practices and challenges in constructing diverse and representative datasets, choosing appropriate machine learning architectures, and rigorously validating model performance. We also discuss emerging strategies and opportunities for improved reliability and efficiency of MLIPs to simulate realistic interfaces in ASSBs.

Energy - Storage↗

Exploring the Feasibility of INCONEL® ALLOY 740H® for Power Plant Headers: Integrating Machine Learning with Computational Fluid Dynamics (CFD)

This keynote presentation explores the behavior of headers—essential components of pipeline systems—using ANSYS simulation software and machine learning techniques. The study aims to predict the thermal and mechanical performance of headers under diverse conditions through both steady-state and transient simulations. We investigate critical parameters such as heat transfer coefficient, fluid velocity, and temperature to optimize header design. Conducted as part of a DOE project led by NCAT in collaboration with UNC Charlotte, this research encompasses multiple key topics. The initial section focuses on the behavior of header systems under steady-state conditions using ANSYS simulation. It underscores the importance of headers in industrial infrastructure, especially in the energy sector, and examines the implications of material selection and flow direction on heat transfer dynamics. Methodologically, we employ Computational Fluid Dynamics (CFD) analysis through ANSYS, detailing the development of models, material properties, geometry specifications, boundary conditions, and meshing strategies. Our simulations explore various operational parameters, including temperature and mass flow rates, crucial for predicting heat transfer coefficients and enhancing header design. Results from the study include parametric investigations into mesh sensitivity, viscosity model evaluations, and the effects of heat transfer locations, all validated against theoretical calculations. We conclude with insights on mesh optimization, the suitability of viscosity models, and recommendations for future research aimed at improving header system efficiency and sustainability in industrial applications.

20 FOSSIL-FUELED POWER PLANTS↗

Polyalkenamers as Drop-In Additives for Ring-Opening Metathesis Polymerization: A Promising Upcycling Paradigm

Here we report a distinct strategy to upcycle waste polyalkenamers such as polybutadiene into new, performance-advantaged materials by using them as drop-in additives for ring-opening metathesis polymerization (ROMP). The polyalkenamers serve as competent chain-transfer agents in ROMPs of common classes of cyclic olefin monomers, facilitating good molecular weight control, allowing low Ru catalyst loadings, and enabling efficient incorporation of the polyalkenamer into the synthesized polymeric material. We successfully demonstrate ROMP using model polyalkenamers and translate these learnings to leverage commercial polybutadiene and acrylonitrile butadiene styrene (ABS) as chain transfer agents for ROMP copolymerizations. Critically, our strategy is shown to be highly efficient and operationally simple, quantitatively incorporating the polyalkenamer and inheriting aspects of its thermomechanical performance. Our results highlight a promising pathway for the upcycling of polyalkenamers and provide an alternative to existing deconstruction and functional upcycling strategies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Key Learnings from Hydraulic Fracturing Test Site - 2 (HFTS-2), Delaware Basin

Hydraulic fractures (HF) play a dominant role in oil and gas production from unconventional reservoirs, fracture characteristics, geometry, and extent are generally not well known and are typically inferred from various monitoring methods or subsurface models. The Hydraulic Fracturing Test Site-2 (HFTS-2) is a field-based research experiment performed in the Wolfcamp formation of the Permian (Delaware) Basin. HFTS-2, a unique joint industry program (JIP) that brings together government, academia, and industry, focused on field data acquisition and interpretation. The project has built a comprehensive HF research dataset that includes microseismic (MS), 1,500 ft of core, diagnostic formation injection tests (DFIT), fluid characterization, advanced logs, geochemistry, downhole gauges, varying completions, and permanent fiber optic (FO) cable in vertical and horizontal wells. These data were integrated and used to characterize HF geometry/dimensions and resulting depletion profiles, gain insights for completion design, and achieve a better understanding of parent well depletion effects on child well performance. The analysis and integration of the comprehensive HFTS-2 diagnostics dataset provide insights for optimal well placement and completions and improves understanding about the effects of parent well depletion. Furthermore, this dataset can be used to blind test and develop subsurface workflows for unconventional resources. Key learnings from HFTS-2 and the new technologies tested can easily be transferred to other unconventional plays.

58 GEOSCIENCES↗