Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Unraveling the transformation pathway of the 𝛽 to 𝛾 phase transition in Ga 2 ⁢O 3 from atomistic simulations

Defect spinel 𝛾−Ga 2 ⁢O 3 is the least stable polymorph of Ga 2 ⁢O 3 , so its frequent appearance as a structural defect within or on the surface of monoclinic 𝛽−Ga 2 ⁢O 3 remains a mystery. Through first-principles calculations, we explore potential pathways for the phase transition from 𝛽−Ga 2⁢ O 3 to 𝛾−Ga 2 ⁢O 3 , and examine two key driving forces: tensile strain and Ga deficiency. When configurational entropy contributions to phase energies are included, the 𝛾 phase becomes energetically competitive with the 𝛽 phase, with the free energy difference between these phases diminishing even further under Ga-deficient conditions. Notably, a stability crossover occurs at room temperature at high vacancy concentrations ([V$^{3−}_{Ga}$]>3%) . A simple model 𝛽 → 𝛾 transformation pathway is identified, comprising two primary reactions, that enables the formation of the 𝛾 phase via simultaneous migration of Ga atoms from tetrahedral lattice sites to octahedral interstitial positions. The transformation barriers are prohibitively large in pristine Ga 2 ⁢O 3 , but can be substantially reduced by: (1) the presence of Ga vacancies, (2) elongational strains along the crystallographic 𝑎-axis, and (3) when volumetric relaxations are possible during transformation. These results elucidate prior experimental observations, where 𝛾−Ga 2⁢ O 3 is seen on damaged surfaces or in highly 𝑛-type 𝛽−Ga 2⁢ O 3 environments, which support Ga deficiency and mechanical strain. The insights into the driving forces and mechanisms of 𝛾−Ga 2⁢ O 3 formation enhance understanding of how localized strain and nonequilibrium defect concentrations may facilitate its formation from the 𝛽 phase.

Defects↗
DOE OSTI2025

Physics-informed transformation toward improving the machine-learned NLTE models of ICF simulations

The integration of machine-learning techniques into inertial confinement fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By replacing the costly nonlocal thermodynamic equilibrium (NLTE) model with machine-learning models, significant reductions in calculation time have been achieved. However, determining how to optimize machine-learning-based NLTE models in order to match ICF simulation dynamics remains challenging, underscoring the need for physically relevant error metrics and strategies to enhance model accuracy with respect to these metrics. Thus, we propose novel physics-informed transformations designed to emphasize energy transport, use these transformations to establish new error metrics, and demonstrate that they yield smaller errors within reduced principal-component spaces compared to conventional transformations. Published by the American Physical Society 2025

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Thermal Design Consideration of Medium Voltage High Frequency Transformers

This paper describes a thermal design using epoxy potting for high frequency transformer (HFT) for medium voltage high power electronic applications, namely emerging solid-state transformers. To address HFT’s thermal stress problem, thermal performance of the HFT with air and epoxy potting cooling method are both simulated by magnetothermal-fluid coupling method (MTFCM). The effectiveness of the simulation analysis is verified in a 100 kW DC-DC resonant converter. Influencing factors including distance between the high frequency transformer and the metal enclosure, epoxy thermal conductivity and heat sink placements are simulated and analyzed. Finally, an optimal cooling structure is proposed for future high power HFTs.

Wang, Haoming↗
DOE OSTI2019

Modeling and Steady-State Analysis of a Rotary Transformer-Based Field Excitation System for Wound Rotor Synchronous Machine

Wound rotor synchronous motors are gaining attention as an alternative to the permanent magnet-based synchronous motors for electric vehicle traction. Rotary transformers have been proposed for the field excitation of these motors to avoid the disadvantages of the slip rings and brushes arrangement. Conventional rotary transformers use small airgap and as a result can be limited in operating speed unless costly high precision manufacturing is used. This paper proposes a novel rotary transformer-based excitation system that overcomes these disadvantages. Modeling and analysis of the proposed system is provided. Simulation results using the developed model and PLECs shows very good agreement for fundamental frequency. Furthermore, a steady state study of the field excitation system using harmonic balance technique is carried out to show dependencies of the output controlled variables on the input variables in the presence of system parameter variations. With series resonant compensations, the open-loop control of the proposed excitation system is robust against variation of field winding resistance with temperature.

Haruna, Josiah↗
DOE OSTI2020

Cooperative Routing for an Air–Ground Vehicle Team—Exact Algorithm, Transformation Method, and Heuristics

This paper considers a cooperative vehicle routing problem for an intelligence, surveillance, and reconnaissance mission in the presence of communication constraints between the vehicles. The proposed framework uses a ground vehicle and an unmanned aerial vehicle (UAV) that travel cooperatively and visit a set of targets while satisfying the communication constraints. The problem is formulated as a mixed-integer linear program, and a branch-and-cut algorithm is developed to solve the problem to optimality. Furthermore, a transformation method and a heuristic are also developed for the problem. The effectiveness of all the algorithms is corroborated through extensive computational experiments on several randomly generated instances. Furthermore, this paper is motivated by an intelligence, surveillance, and reconnaissance mission involving a single unmanned aerial vehicle (UAV) and a ground vehicle, where the vehicles must coordinate their activity in the presence of communication constraints. The combination of a small UAV and a ground vehicle is an ideal platform for such missions, since small UAVs can fly at low altitudes and can avoid obstacles or threats that would be problematic for the ground vehicle alone. This paper addresses the coordinated routing problem involving these two vehicles and presents an algorithm to obtain an optimal solution for this problem, fast heuristics to obtain good feasible solutions, and also a transformation method to transform any instance of this cooperative vehicle routing problem to an instance of the one-in-a-set traveling salesman problem.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2019

The Effect of Data Transformations on Scalar Field Topological Analysis of High-Order FEM Solutions

High-order finite element methods (HO-FEM) are gaining popularity in the simulation community due to their success in solving complex flow dynamics. There is an increasing need to analyze the data produced as output by these simulations. Simultaneously, topological analysis tools are emerging as powerful methods for investigating simulation data. Yet, most of the current approaches to topological analysis have had limited application to HO-FEM simulation data for two reasons. First, the current topological tools are designed for linear data (polynomial degree one), but the polynomial degree of the data output by these simulations is typically higher (routinely up to polynomial degree six). Second, the simulation data and derived quantities of the simulation data have discontinuities at element boundaries, and these discontinuities do not match the input requirements for the topological tools. One solution to both issues is to transform the high-order data to achieve low-order, continuous inputs for topological analysis. Nevertheless, there has been little work evaluating the possible transformation choices and their downstream effect on the topological analysis. We perform an empirical study to evaluate two commonly used data transformation methodologies along with the recently introduced L-SIAC filter for processing high-order simulation data. Our findings indicate diverse behaviors are possible. We offer some guidance about how best to consider a pipeline of topological analysis of HO-FEM simulations with the currently available implementations of topological analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Reactive flash sintering: MgO and α-Al 2 O 3 transform and sinter into single-phase polycrystals of MgAl 2 O 4

We show that flash experiments with three phase mixed-powders of yttria-stabilized zirconia (8YSZ), MgO, and α-Al 2 O 3 not only produce polycrystals of high density, but also the transformation of magnesia and alumina into single-phase spinel. The presence of zirconia facilitates the onset of the flash. The sintering experiments in the laboratory were extended to live experiments at the National Synchrotron Light Source II at Brookhaven National Laboratory in order to measure the time-dependent evolution of single-phase spinel. The phase transformation occurred in <3 seconds during Stage II. Later, during Stage III the cubic zirconia transformed partly into the monoclinic phase, which reverted back to the cubic phase when the flash was extinguished by turning off the current to the specimen. The results underpin a recent report on the synthesis of single-phase bismuth ferrite from constituent oxides in reactive flash experiments, raising the specter of flash as a method for synthesis as well as sintering of complex oxide ceramics. The role of zirconia in catalyzing the flash in the present study is discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2019

On the synchronicity of flash sintering and phase transformation

There is growing evidence that oxides of complex chemistries can be formed in one step by reactive flash sintering of their elemental constituents. We explore the temporal relationship between phase transformation and sintering by combining measurements of sintering with in situ measurements of phase transformation. The experiments are carried out under current rate, where flash is induced by injecting current and increasing it at a constant rate. We show that phase transformation of powders of magnesia and α-alumina into single-phase magnesium aluminate spinel was completed in 45 seconds, whereas sintering to full density required 60 seconds.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Image transformers for classifying acute lymphoblastic leukemia

Cancer is the leading cause of death by disease in American children. Each year, nearly 16,000 children in the United States and over 300,000 children globally are diagnosed with cancer. Leukemia is a form of blood cancer that originates in the bone marrow and accounts for one-third of pediatric cancers. This disease occurs when the bone marrow contains 20% or more immature white blood cell blasts. Acute lymphoblastic leukemia is the most prevalent leukemia type found in children, with half of all annual cases in the U.S. diagnosed for subjects under 20 years of age. To diagnose acute lymphoblastic leukemia, pathologists often conduct a morphological bone marrow assessment. This assessment determines whether the immature white blood cell blasts in bone marrow display the correct morphological characteristics, such as size and appearance of nuclei. Pathologists also use immunophenotyping via multi-channel flow cytometry to test whether certain antigens are present on the surface of blast cells; the antigens are used to identify the cell lineage of acute lymphoblastic leukemia. These manual processes require well-trained personnel and medical professionals, thus being costly in time and expenses. Computerized decision support via machine learning can accelerate the diagnosis process and reduce the cost. Training a reliable classification model to distinguish between mature and immature white blood cells is essential to the decision support system. Here, we adopted the Vision Transformer model to classify white blood cells. The Vision Transformer achieved superb classification performance compared to state-of-the-art convolutional neural networks while requiring less computational resources for training. Additionally, the latent self-attention architecture provided attention maps for a given image, providing clues as to which portion(s) of the image were significant in decision-making. We applied the Vision Transformer model and a convolutional neural network model to an acute lymphoblastic leukemia classification dataset of 12,528 samples and achieved accuracies of 88.4% and 86.2%.

Cho, Priscilla↗
DOE OSTI2015

A new stationary gridline artifact suppression method based on the 2D discrete wavelet transform

Purpose: In digital x-ray radiography, an antiscatter grid is inserted between the patient and the image receptor to reduce scattered radiation. If the antiscatter grid is used in a stationary way, gridline artifacts will appear in the final image. In most of the gridline removal image processing methods, the useful information with spatial frequencies close to that of the gridline is usually lost or degraded. In this study, a new stationary gridline suppression method is designed to preserve more of the useful information. Methods: The method is as follows. The input image is first recursively decomposed into several smaller subimages using a multiscale 2D discrete wavelet transform. The decomposition process stops when the gridline signal is found to be greater than a threshold in one or several of these subimages using a gridline detection module. An automatic Gaussian band-stop filter is then applied to the detected subimages to remove the gridline signal. Finally, the restored image is achieved using the corresponding 2D inverse discrete wavelet transform. Results: The processed images show that the proposed method can remove the gridline signal efficiently while maintaining the image details. The spectra of a 1D Fourier transform of the processed images demonstrate that, compared with some existing gridline removal methods, the proposed method has better information preservation after the removal of the gridline artifacts. Additionally, the performance speed is relatively high. Conclusions: The experimental results demonstrate the efficiency of the proposed method. Compared with some existing gridline removal methods, the proposed method can preserve more information within an acceptable execution time.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

A low-temperature, one-step synthesis for monazite can transform monazite into a readily usable advanced nuclear waste form

It has been demonstrated that monazite-type materials are excellent candidates for nuclear waste forms, and hence, their facile synthesis is of great importance for the needed sequestration of existing nuclear waste. The synthesis of monazite, LaPO 4 , requires inconveniently high temperatures near 1000°C and generally involves the conversion of the presynthesized rhabdophane, LaPO 4 •nH 2 O, to the LaPO 4 monazite phase. During this structure transformation, the rhabdophane converts irreversibly to the thermodynamically stable monoclinic monazite structure. A low-temperature (185° to 260°C) mild hydrothermal acid-promoted synthesis of monazite is described that can both transform presynthesized rhabdophane or assemble reagents to the monoclinic monazite structure. The pH dependence of this reaction is detailed, and its applicability to the LnPO 4 (Ln = La, Ce, Pr, Nd, Sm-Gd), Ca 0.5 Th 0.5 PO 4 , and Sr 0.5 Th 0.5 PO 4 systems is discussed. The crystal growth of Ca 0.5 Th 0.5 PO 4 and Sr 0.5 Th 0.5 PO 4 is described, and their crystal structures were reported. In situ x-ray diffraction studies, performed as a function of temperature, provide insight into the structure transformation process.

Biogeochemistry↗
DOE OSTI2018

Linear Transformation of Electromagnetic Wave Beams of the Electron-Cyclotron Range in Toroidal Magnetic Configurations

The field structure of quasi-optical wave beams tunneled through the evanescence region in the vicinity of the plasma cutoff in a nonuniform magnetoactive plasma is analyzed. This problem is traditionally associated with the process of linear transformation of ordinary and extraordinary waves. An approximate analytical solution is constructed for a rather general magnetic configuration applicable to spherical tokamaks, optimized stellarators, and other magnetic confinement systems with a constant plasma density on magnetic surfaces. A general technique for calculating the transformation coefficient of a finite-aperture wave beam is proposed, and the physical conditions required for the most efficient transformation are analyzed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
DOE OSTI2022

Transformer Health Monitoring Using Dissolved Gas Analysis

Power plants use transformers for supplying generated electricity to the grid. As these transformers age and degrade, they produce specific gases. These gases can be monitored and used to predict when maintenance should be completed. This code uses four complementary techniques to predict when maintenance should be performed based on gas concentrations within the transformer.

Walker, CodyM [Idaho National Laboratory (INL), Id↗
DOE OSTI2026

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗
DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗
DOE OSTI2025

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2019

Embryogenic cell suspensions for high-capacity genetic transformation and regeneration of switchgrass (Panicum virgatum L.)

Abstract Background Switchgrass ( Panicum virgatum L.), a North American prairie grassland species, is a potential lignocellulosic biofuel feedstock owing to its wide adaptability and biomass production. Production and genetic manipulation of switchgrass should be useful to improve its biomass composition and production for bioenergy applications. The goal of this project was to develop a high-throughput stable switchgrass transformation method using Agrobacterium tumefaciens with subsequent plant regeneration. Results Regenerable embryogenic cell suspension cultures were established from friable type II callus-derived inflorescences using two genotypes selected from the synthetic switchgrass variety ‘Performer’ tissue culture lines 32 and 605. The cell suspension cultures were composed of a heterogeneous fine mixture culture of single cells and aggregates. Agrobacterium tumefaciens strain GV3101 was optimum to transfer into cells the pANIC-10A vector with a hygromycin-selectable marker gene and a pporRFP orange fluorescent protein marker gene at an 85% transformation efficiency. Liquid cultures gave rise to embryogenic callus and then shoots, of which up to 94% formed roots. The resulting transgenic plants were phenotypically indistinguishable from the non-transgenic parent lines. Conclusion The new cell suspension-based protocol enables high-throughput Agrobacterium -mediated transformation and regeneration of switchgrass in which plants are recovered within 6–7 months from culture establishment.

Ondzighi-Assoume, Christine A.↗