Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformative”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Performance Profile of Transformer Fine-Tuning in Multi-GPU Cloud Environments

The study presented here focuses on performance characteristics and trade-offs associated with running machine-learning tasks in multi-GPU environments on both on-site cloud computing resources and commercial cloud services (Azure). Specifically, this study examines these tradeoffs by examining the performance of training and fine-tuning of transformer-based deep-learning (DL) networks on clinical notes and data, a task of critical importance in the medical domain. To this end, we perform DL-related experiments on the widely deployed NVIDIA V100 GPUs and on the newer A100 GPUs connected via NVLink or PCIe. This study analyzes the execution time of major operations to train DL models and investigate popular options to optimize each of them. We examine and present the findings on the impacts that various operations (e.g. data loading into GPUs, training, fine-tuning), optimizations, and system configurations (single vs. multi-GPU, NVLink vs. PCIe) have on the overall training performance.

Begoli, Edmon↗
DOE OSTI2024

Power System Resilience Considering Hurricane Storms and Generator Step-up Transformers

Power system resilience describes the system’s ability to withstand and recover quickly from unexpected power outages due to extreme events. As society’s electrification continues at a rapid rate, it is imperative electric infrastructure is designed and operated with extra security. This work studies the impact of severe hurricane storms on the power system located along the United States’ Eastern Seaboard. Specific focus is designated to steady state system operation and loss of large generation step up power transformers. A series of phasor domain power system simulations are conducted to determine the critical point at which the system loses steady state operability. Additionally, active power load shedding and generator dispatching are studied as mitigation and recovery strategies. Results indicate generator dispatching as an effective proactive mitigation strategy and load shedding as an effective recovery strategy.

Liu, Yilu↗
DOE OSTI2020

Model-less Source Location for Forced Oscillation based on Synchrophasor and Moving Fast Fourier Transformation

Forced oscillations in power systems occur when the grid is driven by an external and periodic force. To quickly detect and locate the source of the forced oscillation is critical in terms of ensuring the reliability of an interconnected power grid. This paper explores the electromechanical wave propagation theory and the Fast Fourier Transformation to analyze the forced oscillations. It proposes a model-less, adaptive, fast, and accurate source location algorithm. The proposed algorithm is extensively evaluated through simulation data from a 70k-bus U.S. Eastern Interconnection test system and field-collected synchrophasor data from the distribution-level wide-area monitoring system, FNET/GridEye. The evaluation results demonstrate the correctness and effectiveness of the proposed model-less forced oscillation source location algorithm.

Wang, Weikang↗
DOE OSTI2025

Intercell Power Transformer for Power Balancing of Polyphase Wireless Power Transfer Systems

Polyphase wireless power transfer (PWPT) systems experience receiver side imbalances in misaligned conditions. This paper proposes a method for power balancing in PWPT systems, specifically addressing the challenges caused by receivers coil unequal coupling. An intercell power transformer (IPT) is introduced at the receiver side to mitigate the effects of coil mismatch. Simulations of the PWPT system incorporating IPT demonstrate its effectiveness in enhancing power distribution. For voltage-fed rectifiers (VFR), the IPT increases the conduction angle, resulting in higher output power. In current- fed rectifiers (CFR), the IPT promotes uniform power sharing among rectifiers, thereby reducing electrical stress on semiconductor devices and passive components. Simulation results indicate that, under coil misalignment, the IPT improves output power by approximately 49% for VFRs and 44% for CFRs compared to conventional PWPT systems without IPT.

Wojda, Rafal [ORNL] (ORCID:0000000286609268)↗
DOE OSTI2025

Advanced Photovoltaic Module Characterization: Using Image Transformers for Current–Voltage Curve Prediction From Electroluminescence Images

Individual photovoltaic (PV) module health monitoring can be a daunting task for operation and maintenance of solar farms. Modules can be inspected through luminescence, thermal imaging, and current–voltage (I–V) curve analyzes for identification of damage and power loss. I–V curves provide easily interpretable data to determine module health as they directly provide electrical performance metrics. However, in order to obtain these curves, modules must be disconnected from the array and either removed to a solar simulator or characterized in situ with corrections for module temperature, the incident solar spectrum, and intensity. Luminescence or thermal images of a module are relatively easy to acquire in situ. Electroluminescence (EL) images highlight physical defects in the modules but do not provide easily interpretable features to correlate with electrical performance. This work presents a SWin transformer network to predict I–V curves for PV modules from their corresponding EL images. The predicted I–V curves allow the accurate prediction of the maximum power point (MPP), short-circuit current I sc , and open-circuit voltage V oc with a mean error less of than 1%. Comparing single diode model (SDM) parameters extracted from the predicted curves to those extracted from the true curves, the series resistance R s demonstrates a mean error of 5.19%, and the photocurrent I a mean error of 0.197%. The shunt resistance R sh and dark current Io parameters are predicted with larger errors because of their sensitivity to small changes in the I–V curve.

Byford, Brandon K. [New Mexico State Univ., Las Cr↗
DOE OSTI2025

Toward Mixed Analog-Digital Quantum Signal Processing: Quantum AD/DA Conversion and the Fourier Transform

Signal processing stands as a pillar of classical computation and modern information technology, applicable to both analog and digital signals. Recently, advancements in quantum information science have suggested that quantum signal processing (QSP) can enable more powerful signal processing capabilities. However, the developments in QSP have primarily leveraged digital quantum resources, such as discrete-variable (DV) systems like qubits, rather than analog quantum resources, such as continuous-variable (CV) systems like quantum oscillators. Consequently, there remains a gap in understanding how signal processing can be performed on hybrid CV-DV quantum computers. Here we address this gap by developing a new paradigm of mixed analog-digital QSP. We demonstrate the utility of this paradigm by showcasing how it naturally enables analog-digital conversion of quantum signals—specifically, the transfer of states between DV and CV quantum systems. We then show that such quantum analog-digital conversion enables new implementations of quantum algorithms on CV-DV hardware. This is exemplified by realizing the quantum Fourier transform of a state encoded on qubits via the free-evolution of a quantum oscillator, albeit with a runtime exponential in the number of qubits due to information theoretic arguments. Collectively, this work marks a significant step forward in hybrid CV-DV quantum computation, providing a foundation for scalable analog-digital signal processing on quantum processors.

42 ENGINEERING↗
DOE OSTI2023

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

Unpaired image-to-image translation has broad applications in art, design, and scientific simulations. One early breakthrough was CycleGAN that emphasizes one-to-one mappings between two unpaired image domains via generative-adversarial networks (GAN) coupled with the cycle-consistency constraint, while more recent works promote one-to-many mapping to boost diversity of the translated images. Motivated by scientific simulation and one-to-one needs, this work revisits the classic CycleGAN framework and boosts its performance to outperform more contemporary models without relaxing the cycle-consistency constraint. To achieve this, we equip the generator with a Vision Transformer (ViT) and employ necessary training and regularization techniques. Compared to previous best-performing models, our model performs better and retains a strong correlation between the original and translated image. An accompanying ablation study shows that both the gradient penalty and self-supervised pre-training are crucial to the improvement. To promote reproducibility and open science, the source code, hyperparameter configurations, and pre-trained model are available at https: //github.com/LS4GAN/uvcgan.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Low-intensity frequent fires in coniferous forests transform soil organic matter in ways that may offset ecosystem carbon losses

The impact of shifting disturbance regimes on soil carbon (C) storage is a key uncertainty in global change research. Wildfires in coniferous forests are becoming more frequent in many regions, potentially causing large C emissions. Repeated low-intensity prescribed fires can mitigate wildfire severity, but repeated combustion may decrease soil C unless compensatory responses stabilize soil organic matter. Here, we tested how 30 years of decadal prescribed burning affected C and nitrogen (N) in plants, detritus, and soils in coniferous forests in the Sierra Nevada mountains, USA. Tree basal area and litter stocks were resilient to fire, but fire reduced forest floor C by 77% (-36.4 Mg C/ha). In mineral soils, fire reduced C that was free from minerals by 41% (-4.4 Mg C/ha) but not C associated with minerals, and only in depths ≤ 5 cm. Fire also transformed the properties of remaining mineral soil organic matter by increasing the proportion of C in a pyrogenic form (from 3.2% to 7.5%) and associated with minerals (from 46% to 58%), suggesting the remaining soil C is more resistant to decomposition. Laboratory assays illustrated that fire reduced microbial CO2 respiration rates by 55% and the activity of eight extracellular enzymes that degrade cellulosic and aromatic compounds by 40–66%. Lower decomposition was correlated with lower inorganic N (-49%), especially ammonium, suggesting N availability is coupled with decomposition. The relative increase in forms of soil organic matter that are resistant to decay or stabilized onto mineral surfaces, and the associated decline in decomposition suggest that low-intensity fires may promote mineral soil C storage in pools with long mean residence times in coniferous forests.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Study of electron-induced chemical transformations in polymers

In extreme ultraviolet (EUV) photoresist exposure, the primary and secondary electrons drive chemistry rather than the EUV photons themselves. These electrons have a wide range of energies below approximately 80 eV, which are capable of complex network of reactions during exposure. To better understand the ability of electrons of different energies within the EUV primary and secondary electron range, we want to characterize and compare the chemistry induced in pure polymer films by direct exposure to electrons. Thin films of poly(tert-butyl methacrylate), poly(methyl methacrylate), and poly(4-hydroxystyrene) were exposed to a 20 to 80 eV electron beam. Outgassing during exposure was characterized in-situ using a quadrupole residual gas analyzer. The thickness changes were measured using ellipsometry and chemical bond structure data were collected using Fourier-transform infrared spectroscopy (FTIR) after exposure to compare different exposure conditions. Poly(4-hydroxystyrene) demonstrated stability during electron exposures. Exposures of the other two materials led to outgassing of protecting groups, the intensity of which decayed in time. Outgassing, FTIR, and thickness loss data exhibited approximately linear relationships to each other.

Mueller, Maximillian↗
DOE OSTI2026

Towards Generalizable and Efficient Circuit Topology Design: A Graph-Transformer-based Surrogate Model with Curriculum Learning

Unlike circuit parameter and sizing optimizations, the automated design of analog circuit topologies poses significant challenges for learning-based approaches. One challenge arises from the combinatorial growth of the topology space with circuit size, which limits the topology optimization efficiency. Moreover, traditional circuit evaluation methods are time-consuming, while the presence of data discontinuity in the topology space makes the accurate prediction of circuit performance exceptionally difficult for unseen topologies. To tackle these challenges, we design a novel Graph-Transformer-based Network (GTN) as the surrogate model for circuit evaluation, offering a substantial acceleration in the speed of circuit topology optimization without sacrificing performance. Our GTN model architecture is designed to embed voltage changes in circuit loops and current flows in connected devices, enabling accurate performance predictions for circuits with unseen topologies. To address the cold start problem when scaling GTN to large-scale circuits, we further introduce a curriculum learning strategy that progressively trains GTN from small-scale to large-scale circuits. This approach enables the model to first learn fundamental physical principles from simpler topologies and gradually adapt to complex configurations, effectively bridging the circuit complexity gap and improving prediction accuracy. Taking the power converter circuit design as an experimental task, our GTN model significantly outperforms an analytical approach and baseline methods directly utilizing graph neural networks. Furthermore, GTN achieves less than 5% relative error and 196× speed-up compared with high-fidelity simulation. Notably, our GTN surrogate model empowers an automatic circuit design framework to discover circuits of comparable quality to those identified through high-fidelity simulation while reducing the time required by up to 98.2%. With curriculum learning, the enhanced GTN achieves a 51% improvement for performance prediction of large-scale circuits compared to the GTN model without this strategy. These advancements establish GTN as a scalable framework for automated analog circuit design across varying circuit complexity levels.

Lu, Haoshu [New Jersey Institute of Technology (NJ↗
DOE OSTI2021

An In-Depth Analysis of the Transformation of Tin Foil Anodes during Electrochemical Cycling in Lithium-Ion Batteries

Tin foils have an impressive lithium-storage capacity more than triple that of graphite anodes, and their adoption could facilitate a drastic improvement in battery energy density. However, implementation of a dense foil electrode architecture represents a significant departure from the standard blade-cast geometry with a distinct electrochemical environment, and this has led to confusion with regards to the first cycle efficiency of the system. In this work, we investigate the unique behavior of a tin active material in a foil architecture to understand its performance as an anode. We find shallow cycling of the foil results in an irreversible formation (< 40%) due to diffusional trapping, but intermediate and complete utilization allows for a remarkably reversible formation reaction (> 90%). This striking nonlinearity stems from an in situ transformation from bulk metal to porous electrode that occurs during formation cycles and defines electrode-level lithium-transport on subsequent cycles. As a result, an alternative cycling procedure for assessing the stability of foils is proposed to account for this chemomechanical effect.

25 ENERGY STORAGE↗
DOE OSTI2020

Software for Transformative Remedial Action Scheme Tool (TRAST)

The transformative remedial action scheme tool (TRAST) can be applied to improve and validate the power system remedial action scheme (RAS), and further improve the performance of power system operation and control. This tool provides a full suite of advanced functionalities, which are given as follows: 1. Advanced statistical data analysis; 2. OPF-based automated power flow case generation; 3. Customized dynamic simulation in HPC/cloud platform; 4. Machine learning based RAS coefficient prediction; 5. A reliable RAS validation strategy in multiple commercial platforms.

Fan, Xiaoyuan↗
DOE OSTI2024

Hyperparameter Studies for Vision Transformers Trained on High-Fidelity Simulations

This library is a collection of python modules that define, train, and analyze vision-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The training data for these models is hydrodynamic simulation output in the form of numpy arrays. This library contains code to train these ViT models on the hydrodynamic simulation output with a variety of hyperparameters, and to compare the results of such models. Furthermore, the library contains definitions of simple convolutional neural network (CNN) machine learning architectures which can be trained on the same hydrodynamic simulation output. These are included as a reference point to compare the ViT models to. Additionally, the library includes trained ViT and CNN models and example input data for demonstration purposes. The code is based on the PyTorch python library.

Callis, Skylar↗
DOE OSTI2025

Spatio-temporal Fourier Transformer for Long-term Dynamics Prediction (StFT) v1.0

We propose a novel machine learning model spatio-temporal Fourier transformer (StFT) to emulate long-term dynamics of multi-scale and multi-physics systems. Our method StFT overcomes the limitations of rapid error accumulation, particularly in long-term forecasting of systems characterized by complex and coupled dynamics. StFT achieves outstanding accuracy and computational efficiency by effectively capturing multi-scale interactions, and quantify the uncertainties inherent in the predictions. Our model leverages a structured hierarchy of StFT blocks, and explicitly captures dynamics across both macro- and micro- spatial scales. Evaluations conducted on three benchmark datasets (plasma, fluid, and atmospheric dynamics) demonstrate the advantages of our approach over state-of-the-art ML methods.

Bai, Zhe [Lawrence Berkeley National Laboratory (L↗
DOE OSTI2026

Transform-Your-World

Machine learning library for developing scientific transformer models, particularly chemical language models, at scale

Salij, Andrew↗
DOE OSTI2022

Surface Water Mass Transformation in the Southern Ocean: The Role of Eddies Revisited

The water mass transformation (WMT) framework describes how water of one class, such as a discrete interval of density, is converted into another class via air–sea fluxes or interior mixing processes. Here, this paper investigates how this process is modified at the surface when mesoscale ocean eddies are present, using a state-of-the-art high-resolution climate model with reasonable fidelity in the Southern Ocean. The method employed is to coarse-grain the high-resolution model fields to remove eddy signatures, and compare the results with those from the full model fields. This method shows that eddies reduced the WMT by 2–4 Sv (10%–20%; 1 Sv ≡ 10 6 m 3 s −1 ) over a wide range of densities, from typical values of 20 Sv in the smoothed case. The corresponding water mass formation was reduced by 40% at one particular density increment, namely, between 1026.4 and 1026.5 kg m −3 , which corresponds to the lighter end of the range of Indian Ocean Mode Water in the model. The effect of eddies on surface WMT is decomposed into three terms: direct modulation of the density outcrops, then indirectly, by modifying the air–sea density flux, and the combined effect of the two, akin to a covariance. It is found that the first and third terms dominate, i.e., smoothing the outcrops alone has a significant effect, as does the combination of smoothing both outcrops and density flux distributions, but smoothing density flux fields alone has little effect. Results from the coarse-graining method are compared to an alternative approach of temporally averaging the data. Implications for climate model resolution are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Chapter 4: "Waste"-to-Energy for Decarbonization - Transforming Nut Shells Into Carbon-Negative Electricity

This chapter presents a study demonstrating waste pistachio nut shells as a renewable feedstock for climate-friendly electricity generation via industrial gasification technology. The study includes biomass feedstock characterization (i.e., pistachio waste critical material attributes), process variability (i.e., bulk material handling), and overall operational reliability and conversion performance through extended testing. Additionally, techno-economic analysis (TEA) and life cycle assessment (LCA) were performed to assess the economic feasibility and environmental impact of the technology to transform agricultural waste to biopower. For processing pistachio waste material, among critical material attributes, fines content in the biomass (<1/4") had the largest potential to reduce the operating time of the gasifiers due to plugging. Pelletizing fines and co-feeding them with the mixed pistachio waste increased the average feed density, feed rate, and biochar production. Compared to pine wood chips, mixed pistachio waste yielded higher biochar quantity but slightly reduced quality. In general, a systematic Quality by Design methodology is the preferred approach for designing preprocessing and material conveyance systems, where a downstream technology (end user) for the produced intermediate is specified at the outset. TEA results show that the biochar production rate and selling price had an overwhelming impact on the modeled Minimum Electricity Selling Price (MESP), which ranged from 35.5 to 39.9 cents/kWh for the cases studied (16 h/day operational basis). Moreover, LCA results show that the valorization of pistachio shells for biopower generation is a "carbon negative" process that can help decarbonize the U.S. electricity grid. The specific carbon intensity was -0.29 to -0.71 kg CO2e/kWh, compared to 0.45 kg CO2e/kWh for the average U.S. electricity mix. Biochar production from pistachio waste as a potential means for carbon sequestration was a significant driver for the LCA. The highly stable biochar permanently sequesters a considerable fraction of biochar carbon in the ground, more than enough to offset the life cycle emissions, and can be a complementary climate change mitigation strategy.

bio-char↗
DOE OSTI2022

Data for Transformation and Gene Editing in the Bioenergy Grass Miscanthus

Miscanthus, a C4 member of the family Poaceae, is a promising perennial crop for bioenergy, renewable bioproducts, and carbon sequestration. Species of interest include nothospecies Miscanthus x giganteus and its parental species M. sacchariflorus and M. sinensis . Use of biotechnology-based procedures to genetically improve miscanthus, to date, have only included plant transformation procedures for introduction of exogenous genes into the host genome at random, non-targeted sites.

Biomass Analytics↗