Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Far-infrared absorption of undoped and Br-doped carbon nanofiber powder in stacked-cup cone configuration

In this study, we performed room-temperature far-infrared (40–650cm –1 ) transmission measurements on undoped and bromine-doped powder samples of carbon nanofibers in stacked-cup cone geometry. The transmission spectra show enhanced transmittance after bromine doping and all spectra were fit to a Drude-Lorentz (DL) model. A decreased metallic conductivity along with a redshift of the lowest semiconducting gap was found with doped samples. A significant decrease in the scattering rate upon heavy doping has been qualitatively explained as partial ordering of intercalated dopant ions. Absorption spectra were derived from the transmission spectra under the assumption of nondispersive reflectance and subsequently compared with DL-model-derived spectra. The free-carrier density of the n -type powder and the electronic mean free path were estimated and compared with reported values for single-walled nanotubes and pyrolytic graphite.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Predictive Direct DC-Link Control for 7.2 kV Three-Port Low-Inertia Solid-State Transformer With Active Power Decoupling

Promising for applications including renewable energy and electric vehicle fast charging, a medium-voltage (MV) solid-state transformer (SST) typically has multiple modules series stacked, which requires the modules to be single phase. One critical issue of the single-phase SST is the double-line-frequency power ripple. Traditionally, large passives are used to buffer the ripple, resulting in significantly increased volume and cost. This article for the first time proposes active power decoupling (APD) for the SST and a predictive direct DC-link control method, using a current-source single-stage SST as an example. An electrolytic capacitor-less buffer port is used to absorb the ripple, which tolerates up to a 30% voltage ripple for small capacitance. The APD SST control is challenging. First, the current-source SST realizes isolation, DC link, and multiport in a single stage. Second, different from conventional SSTs or APD converters, the low-inertia DC link in this SST has a 40% switching ripple, which is difficult to stabilize. To address the control challenge, a direct DC-link control architecture and a predictive control method are proposed. Simulation and experimental results verify the proposed control method on an MV SiC modular soft-switching solid-state transformer (M-S4T) prototype. Here, the proposed APD reduces the SST volume by 53.8%. Importantly, the proposed concept is not limited to the M-S4T but is generic to other SSTs or APD converters.

14 SOLAR ENERGY↗
DOE OSTI2025

ABLE Workflow Copier

A copier template for generating a snakemake workflow with an associated python package for implementing dataset transformation, feature extraction, and modeling.

Pathak, Maharshi [Northeastern Univ., Boston, MA (↗
DOE OSTI2024

Vistransformers Explained

The Vistransformers Explained library is a collection of python notebooks that demonstrate the internal mechanics and uses of visual-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The value added by this code is in-depth explanations of the mathematics behind the sub-modules of the ViT models, including original figures. Additionally, the library contains the code necessary to implement and train the ViT models. The library does not include example training data for the models; instead, it would rely on users generating their own datasets. The code is based on the PyTorch python library. It does not include any files other than python scripts, modules, or notebooks.

Callis, Skylar↗
DOE OSTI2024

Hyperparameter Studies for Vision Transformers Trained on High-Fidelity Simulations

This library is a collection of python modules that define, train, and analyze vision-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The training data for these models is hydrodynamic simulation output in the form of numpy arrays. This library contains code to train these ViT models on the hydrodynamic simulation output with a variety of hyperparameters, and to compare the results of such models. Furthermore, the library contains definitions of simple convolutional neural network (CNN) machine learning architectures which can be trained on the same hydrodynamic simulation output. These are included as a reference point to compare the ViT models to. Additionally, the library includes trained ViT and CNN models and example input data for demonstration purposes. The code is based on the PyTorch python library.

Callis, Skylar↗
DOE OSTI2024

pnnl/SuperSAM

Our SuperSAM approach transforms the Segment Anything Model (SAM) into an `elastic' supernetwork, enabling the derivation of subnetworks with varying architectures tailored to a wide range of resource constraints.

Tallent, Nathan↗
DOE OSTI2025

pnnl/battery-degradation-prognosis

This is a tool for long term prognosis of redox flow battery parameter degradation which uses Transformer-based deep learning models for time series forecasting which was developed as part of the ROVI project.

Saldanha, Emily [Pacific Northwest National Labora↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗
DOE OSTI2024

MENT-Flow: maximum-entropy phase space tomography using normalizing flows

Generative models can be trained to reproduce low-dimensional projections of high-dimensional phase space distributions. Normalizing flows are generative models that parameterize invertible transformations, allowing exact probability density evaluation and sampling. Consequently, flows are unbiased entropy estimators and could be used to solve the high-dimensional maximum-entropy tomography (MENT) problem. In this work, we evaluate a flow-based MENT solver (MENT-Flow) against exact maximum-entropy solutions and Minerbo's iterative MENT algorithm in two dimensions.

Hoover, Austin↗
DOE OSTI2025

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Mineral Database and Dashboard

The scarcity of water resources, the need for beneficial water reuse, and the challenges of wastewater treatment are becoming increasingly pressing in economic, social, and environmental domains. Addressing these concerns requires effective treatment strategies to manage wastewater streams and tackle environmental and economic issues. Furthermore, the recovery of critical minerals from the waste streams associated with energy production holds the promise of offsetting treatment costs and securing local sources of valuable minerals. However, relevant data on these waste streams are dispersed and challenging to locate. The process of ingesting such data into modeling software often involves multiple steps, requiring data restructuring to meet software-input requirements. The non-standardized reporting of water data makes data aggregation and reformatting a time-consuming process. Additionally, essential attributes necessary for modeling water treatment and mineral scale formation are frequently missing. Moreover, data gaps vary depending on the region of interest. Consequently, there is a pressing need for high-quality energy-water composition data that can be easily imported into water chemistry modeling software. To address this need, the National Energy Technology Laboratory has created the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard—a free online tool catering to community leaders and water researchers. NEWTS facilitates a comprehensive understanding of the composition of energy-related wastewater streams in the United States. The datasets provide detailed concentrations and speciation of major and minor aqueous compounds in energy-related wastewater streams, including power plant leachate, acid mine drainage, brackish water, and oil and gas produced water across the United States. Many of the aqueous species are critical minerals (Li, REEs) in high demand to modernize the world’s energy infrastructure. Many of the datasets also contain volumetric flow-rates needed to model the treatment and reuse scenarios in advanced aqueous chemistry software programs. The NEWTS Database and Dashboard offer public access to hitherto challenging-to-access datasets, presented in a standardized format that is tailored for easy input into aqueous chemistry modeling software. By performing the work needed to transform dispersed, disparate data sources into unified, model-ready datasets, NEWTS serves as an essential resource in advancing water treatment research and sustainable water resource management.

produced water management↗
DOE OSTI2020

Low-Temperature Crystal Structure and Mean-Field Modeling of Er x Dy 1- x Al 2 Intermetallics

Low-temperature crystal structure of the Er x Dy 1-x Al 2 alloys with x = 0.45, 0.67, 0.90 was examined using temperature-dependent powder X-ray diffraction. The Er-rich sample, Er 0.9 Dy 0.1 Al 2 , exhibits a rhombohedral distortion associated with the magnetic ordering that occurs around 20 K. The rhombohedral distortion is suppressed in Er 0.67 Dy 0.33 Al 2 , while a weak low-temperature tetragonal distortion is observed in Er 0.45 Dy 0.55 Al 2 . The mean-field theory supports the correlation between the type of structural distortion and the variable easy magnetization axis in Er x Dy 1-x Al 2 intermetallics.

36 MATERIALS SCIENCE↗
NASA NTRS1973

Acoustic radiation from plates excited by flow noise.

Theoretical formulation of noise radiation from thin, rectangular, flexible plates excited by turbulent wall pressure fluctuations. An extensive parametric study including surface roughness and both plate and flow parameters is presented. From the results, presented graphically, it is possible to predict the spectrum of the total radiated power provided that the power spectral density of the wall-pressure fluctuations, the flow velocity, the plate dimensions and the plate modal damping parameters are known. Along with the parametric study, an estimate of the dependence of the noise radiation on plate boundary conditions based on a consideration of the wavenumber-frequency selectivity of the plate is presented. The parametric study is based on the assumption that the wave number/frequency spectrum of the wall-pressure fluctuations can be described by a Fourier transform of a Corcos model of the cross spectral density. The results indicate that at frequencies above the hydrodynamic-coincidence frequency the radiated power is dependent on the low-wave-number spectrum of the excitation. The dependence on the high-wave-number spectrum, however, is limited to a narrow band of frequencies below the hydrodynamic-coincidence frequency.

Aupperle, F. A.↗
NASA NTRS1978

Optimum thermal infrared bands for mapping general rock type and temperature from space

A study was carried out to determine quantitatively the number and locations of spectral bands required to perform general rock-type discrimination from spaceborne imaging sensors using only thermal infrared measurements. Beginning with laboratory spectra collected under idealized conditions from relatively well characterized, homogeneous samples, a radiative transfer model was employed to transform ground exitance values into the corresponding spectral radiance at the top of the atmosphere. Taking sensor noise into account analysis of these data revealed that three 1 micrometer wide spectral bands would permit independent estimators of rock-type and sample temperature from a satellite infrared multispectral scanner. This study, indicates that the location of three spectral bands at 8.1-9.1 micrometers, 9.5-10.5 micrometers and 11.0-12.0 micrometers, and the employment of appropriate preprocessing to minimize atmospheric effects makes it possible to predict general rock-type and temperature for a variety of atmospheric states and temperatures.

Holmes, Q. A.↗