Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transformer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Adaptive Patching for High-resolution Image Segmentation with Transformers

Attention-based models are proliferating in the space of image analytics, including segmentation. The standard method of feeding images to transformer encoders is to divide the images into patches and then feed the patches to the model as a linear sequence of tokens. For high-resolution images, e.g. microscopic pathology images, the quadratic compute and memory cost prohibits the use of an attention-based model, if we are to use smaller patch sizes that are favorable in segmentation. The solution is to either use custom complex multi-resolution models or approximate attention schemes. We take inspiration from Adapative Mesh Refinement (AMR) methods in HPC by adaptively patching the images, as a pre-processing step, based on the image details to reduce the number of patches being fed to the model, by orders of magnitude. This method has a negligible overhead, and works seamlessly with any attention-based model, i.e. it is a pre-processing step that can be adopted by any attention-based model without friction. We demonstrate superior segmentation quality over SoTA segmentation models for realworld pathology datasets while gaining a geomean speedup of 6.9× for resolutions up to 64K2, on up to 2, 048 GPUs.

Zhang, Enzhi↗
DOE OSTI2025

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗
DOE OSTI2025

Airships as Transformative Tools for Power Systems Logistics: Addressing Infrastructure Challenges and Enhancing Disaster Resilience

Airships represent a transformative advancement in logistics, particularly for the power systems industry. Their unique ability to transport heavy equipment and personnel efficiently over remote or disaster-stricken areas, while requiring minimal infrastructure, addresses critical gaps left by traditional methods. Combining adaptability with environmental sustainability, airships offer a low-carbon alternative for routine operations and emergency responses. This review presents current developments in airship technology, such as rigid airships designed for large payloads, demonstrate their potential to revolutionize supply chains.

Fuhr, Peter L. [ORNL] (ORCID:0000000211627445)↗
DOE OSTI2024

Control, Fault Management, and Grid Support Functionality of an MV AC-DC Solid State Transformer based EV Extreme Fast Charging Station

Electric vehicles (EVs) have become increasingly popular in recent times while revolutionizing the consumer and commercial transportation market. The development of charging infrastructure has become one of the priorities for increasing the adoption of EVs. Extreme fast charging (XFC) technology can reduce the so-called ’range anxiety’ of consumers as they significantly reduce the charging time. With the advent of wide band-gap (WBG) power devices and improvement in power electronic converters, medium voltage (MV) solid state transformer (SST) based XFC system has the potential to replace the traditional XFC stations because of the lower footprint, ease of installation, enhanced control feature, and better system efficiency. The control system design is one of the critical aspects of the SST development process. Careful consideration and detailed analysis are required to find out suitable control method for the SST based on its topology among different centralized and decentralized control architectures. Also, the control parameters selection and potential improvement to the transient response of the controller ought to be investigated. Another major concern of the SST is different types of internal fault which reduces the overall reliability of the XFC system. As a result, designing a robust protection system is essential. Among different fault modes, open circuit switch faults have received significant attention as an active research area because of their likelihood and severe effects on converters. Therefore, the power stages used in the XFC system require functional and accurate open circuit switch fault management methods. An equally significant aspect of this SST based XFC is its compatibility in a microgrid where there is no synchronous generator present. When the grid is not available, the XFC SSTs can provide grid forming capability and continue supplying the critical loads in islanded mode. The transition between grid connected and islanded mode, especially the grid resynchronization process has to be carefully performed for the safety of the microgrid components. The challenges posed by the aforementioned issues have inspired the work done in this dissertation. Here, a 13.2 kV, 1 MVA, AC/DC SST for the XFC system is examined and a comparative analysis is conducted to select the control architecture based on feasibility of implementation and performance. A detailed control parameter design process is demonstrated considering the sensor dynamics and delay. The selected decentralized control method is augmented by introducing a novel sensor-less load current feedforward method to provide better voltage regulation at the DC bus during a change of load. Next, in the fault management section, a hierarchical failure mode effect analysis (FMEA) is proposed to enable a systematic design of the internal fault protection of the XFC SST as there are limited examples in the literature regarding the analysis of the safety and design of the protection of a power electronic converter system. Novel open circuit switch fault management methods for the converters in the system are presented. Finally, XFC SST based MV microgrid operations in grid connected mode and islanded mode are explored. A secondary control method for grid resynchronization is presented and a design process of control parameters is shown to ensure the stability of the secondary voltage and frequency regulation.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2025

Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization

Deploying geospatial foundation models on resource-constrained edge devices demands compact architectures that maintain high downstream performance. However, their large parameter counts and the accuracy loss often induced by compression limit practical adoption.In this work, we leverage manifold-constrained optimization framework DLRT to compress large vision transformer–based geospatial foundation models during transfer learning. By enforcing structured low-dimensional parameterizations aligned with downstream objectives, this approach achieves strong compression while preserving task-specific accuracy. We show that the method outperforms of-the-shelf low-rank methods as LoRA. Experiments on diverse geospatial benchmarks confirm substantial parameter reduction with minimal accuracy loss, enabling high-performing, on-device geospatial models.

Snyder, Thomas [Yale University]↗
DOE OSTI2026

Affine Transformations to Enable Machine Learning for Semi-Quantitative EDS Analysis

Energy Dispersive X-ray Spectroscopy (EDS) is an essential technique for determining elemental concentrations and distributions within microstructures, critical for materials discovery, optimization, and qualification. However, most published EDS data is qualitative because current quantitative EDS analysis methods require extensive calibration and post-processing, limiting their practicality and widespread adoption. This work seeks to establish a framework for accelerated EDS characterization and spectrum analysis that can leverage ML to analyze correlations between various elemental compositions and resulting EDS spectra. The complex physics and data result in a high-dimensional problem that grows exponentially with the number of elements in the system and the complexity of the spectrum analysis. ML provides a way to compute and optimize the results of this highly dimensional problem in a flexible way to tailor it to the user’s specific needs and material system. However, the framework emphasizes transparency through a strictly mathematical affine transformation, so the analysis remains understandable and reviewable to facilitate adoption by the scientific community. While currently implemented methods are simplistic and unvalidated, further development and demonstration of this framework could enable high-throughput, accurate, and accessible EDS characterization.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Computing the Critical Temperature of the Affine-Transformed $D=3$ Ising Model Using Masked Autoregressive Flow

The simple Ising model provides a rich environment to build and study lattice field theories. As part of an ongoing project to construct a conformal field theory (CFT) on an arbitrarily curved manifold, in this work we develop methods to measure the critical temperature $β_c$ of the affine-transformed Ising model on the face-centered cubic (FCC) lattice. The main challenge in this endeavor is finding a computationally efficient and accurate method of interpolating and extrapolating Monte Carlo observables with respect to coupling coefficients and temperature. Herein, we compare two such methods. A traditional statistical approach uses the multiple histogram (MH) method, while a newer machine learning approach uses a masked autoregressive flow (MAF) to estimate the underlying probability density function of a set of observables. While the MH method is specifically designed to interpolate and extrapolate Monte Carlo observables, we find that MAF is a viable alternative for measuring $β_c$ with a computational cost that scales more favorably. Furthermore, we comment on additional advantages of MAF relevant to our work, such as extrapolating in system volume.

Svenson, Kai [Texas U.]↗
DOE OSTI2020

Full-Set Transformer Protection Barrier Manufacturing and Technology

This Technology Commercialization Fund (TCF) project provided the design, fabrication, and testing a full-scale prototype “Corner Unit” protective barrier to provide seamless 360° perimetrical protection for highly expensive power generation or transmission infrastructure. The Corner Unit will seamlessly match up to the existing A-Frame design to form the 360° protection desired from industry. This TCF project also demonstrated how commercial industry could fabricate and deliver the full-scale barriers to remote locations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Micropolar Elastoplasticity Using a Fast Fourier Transform‐Based Solver

ABSTRACT This work presents a micromechanical spectral formulation for obtaining the full‐field and homogenized response of elastoplastic micropolar composites. A closed‐form radial‐return mapping is derived from thermodynamics‐based micropolar elastoplastic constitutive equations to determine the increment of plastic strain necessary to return the generalized stress state to the yield surface, and the algorithm implementation is verified using the method of numerically manufactured solutions. Then, size‐dependent material response and micro‐plasticity are shown as features that may be efficiently simulated in this micropolar elastoplastic framework. The computational efficiency of the formulation enables the generation of large datasets in reasonable computing times.

42 ENGINEERING↗
DOE OSTI2020

An On-Chip Superconducting Kinetic Inductance Fourier Transform Spectrometer for Millimeter-Wave Astronomy

An on-chip FTS consists of two waveguides coupled to long superconducting transmission lines (STLs) (similar to 620 mm) using two coupling probes. The signal propagating on one of the STLs is phase-shifted with respect to the other line with a bias current that affects the nonlinear dependence of kinetic inductance, Lk(I)of the STL material. Here we describe the design and simulation of a superconducting on-chip FTS coupled to a dual polarization W-band (90-110 GHz) waveguide. These devices have applications in ground-based and space-based millimeter-wave spectral surveys.

Fourier transform spectrometer↗
DOE OSTI2023

Transmission electron microscopy investigation of phase transformation and fuel constituent redistribution in neutron irradiated U-10wt.%Zr fuel

Uranium-10wt.%zirconium (U-10wt.%Zr) is a primary candidate for fast reactor nuclear fuels. However, there is a lack of data characterizing neutron irradiated crystallographic phases and chemistry. In the current study, the microstructural evolution of a U-10wt.%Zr fuel neutron irradiated to a burnup of 5.7 at.% was investigated by scanning transmission electron microscopy, energy dispersive spectroscopy, and selected area electron diffraction to determine the major phases, alterations in microstructure, and variations in local chemical composition at different localities of a fuel cross-section. The current study revealed that the irradiated U-10wt.%Zr fuel was comprised of various major phases, including a-U, ß-U, and d-UZr2, as well as amorphous and crystalline solid fission product (FP) precipitates within different regions of the fuel cross-section. Regions A and A/B in the center of the fuel were comprised of U-rich, U-intermediate, and U-lean localities with a-U and d-UZr 2 composing the major phases. Regions B and C in the intermediate and peripheral fuel localities, respectively, were comprised of a-U grains, U-rich (ß-U) grains with Zr-rich precipitates, U-intermediate grains (d-UZr2), and solid FP precipitates. The major phases identified were associated with the nanoscopic chemical concentrations, the phase diagram, and the as-characterized specimen temperature, with the exception of the non-equilibrium ß-U phase identified in region B. The U-lean localities in regions A, A/B, B, and C were Zr-enriched pathways along subgrain/grain boundaries. This phenomenon suggests that Zr is susceptible to radiation-induced segregation in U-Zr fuels and indicates a new mechanism for constituent redistribution.

36 MATERIALS SCIENCE↗