Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformative”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Sensing Service Transformer Secondary Currents using Planar Magnetic Pick-up Coils

The rapid deployment of distributed energy resources (DERs) is creating stresses on utility assets in the distribution networks. The service transformer, which is the most commonly used utility asset is often not monitored, since the cost of available sensing solutions is as high as the transformer itself. This paper presents a method to use an array of printed circuit board coils to intelligently monitor North American pole top service transformers. The approach, uses a novel, self-calibrating algorithm to infer the fixed geometry of the installation, by recording data over an extended period of time. The proposed method can enable rapid installation of a non-intrusive sensor that can be used to monitor loading levels of the distribution transformer. Furthermore, these sensors can help in planning, prognostics and advanced situational awareness for utilities.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

A Novel Low-Profile High-Efficiency Three-Phase Matrix Transformer

High step-down isolated DC-DC conversion from an 800 V DC bus to low-voltage, high-current outputs is required in automotive auxiliary converters and data center power supplies. In such applications, conventional transformer-based converters require large turns ratios, which increase winding resistance, leakage inductance, and magnetic height. This paper proposes a novel low-profile three-phase matrix transformer that realizes a large effective voltage ratio through flux division among multiple secondary legs, without increasing the physical turns count of each winding. As a result, the proposed structure reduces copper usage and transformer height while preserving the voltage conversion capability of a conventional three-phase transformer. Finite element analysis shows that the proposed design reduces magnetic height by 27%, ferrite volume by 34%, and copper volume by 28%. Circuit-level simulations of an 800 V/12 V,3 kW CLLLC dual-active-bridge converter further show that the lower winding resistance reduces total system loss by 91% and increases DC-DC efficiency from 82.6% to 97.6% at 3 kW output.

Inoue, Shuntaro [ORNL] (ORCID:0000000262637627)↗
DOE OSTI2024

Transformer Masked Autoencoders for RF Device Fingerprinting

Machine learning methods for RF device fingerprinting typically rely on CNN-based models. Transformer-based models have outperformed CNNs for modulation classification tasks, but there are few implementations for device fingerprinting. We train a transformer for device fingerprinting with the largest device count to date and explore several variations of the architecture. Additionally, we demonstrate that pre-training an RF transformer as a Masked Autoencoder improves classification accuracy, as has been observed for CNN fingerprinting models and vision transformers.

artificial intelligence↗
DOE OSTI2024

Cascading Transformer Failure Probability Model Under Geomagnetic Disturbances

This paper develops a probabilistic model to assess the cascading failure of transformers in an electric power grid experiencing geomagnetic disturbances caused by a solar storm. We propose a model in which the probability of failure is a function of the intensity of the solar storm, the physical properties of the transformer, the geographical location of the transformer, and the flow of electrical power. We demonstrate the proposed model using the IEEE 14-bus system and several notional solar storms. The model quickly computes the initial and cascading failure probabilities of the transformers in the system as a first step towards quantifying the risks posed by future solar storms.

Shukla, Pratishtha↗
DOE OSTI2020

Soft crystal martensites: An in situ resonant soft x-ray scattering study of a liquid crystal martensitic transformation

Liquid crystal blue phases (BPs) are three-dimensional soft crystals with unit cell sizes orders of magnitude larger than those of classic, atomic crystals. The directed self-assembly of BPs on chemically patterned surfaces uniquely enables detailed in situ resonant soft x-ray scattering measurements of martensitic phase transformations in these systems. The formation of twin lamellae is explicitly identified during the BPII-to-BPI transformation, further corroborating the martensitic nature of this transformation and broadening the analogy between soft and atomic crystal diffusionless phase transformations to include their strain-release mechanisms.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration library is intended to aid in the explorability and explainability of transformer classification networks, or transformer language models with sequence classification heads. The basic function of this library is to take a trained transformer and test/train dataset and produce an ipywidget dashboard which can be displayed in a jupyter notebook or in jupyter lab.

Martindale, Nathan [Oak Ridge National Lab. (ORNL)↗
DOE OSTI2024

Path-BigBird: An AI-Driven Transformer Approach to Classification of Cancer Pathology Reports

PURPOSE Surgical pathology reports are critical for cancer diagnosis and management. To accurately extract information about tumor characteristics from pathology reports in near real time, we explore the impact of using domain-specific transformer models that understand cancer pathology reports. METHODS We built a pathology transformer model, Path-BigBird, by using 2.7 million pathology reports from six SEER cancer registries. We then compare different variations of Path-BigBird with two less computationally intensive methods: Hierarchical Self-Attention Network (HiSAN) classification model and an offthe-shelf clinical transformer model (Clinical BigBird). We use five pathology information extraction tasks for evaluation: site, subsite, laterality, histology, and behavior. Model performance is evaluated by using macro and micro F 1 scores. RESULTS We found that Path-BigBird and Clinical BigBird outperformed the HiSAN in all tasks. Clinical BigBird performed better on the site and laterality tasks. Versions of the Path-BigBird model performed best on the two most difficult tasks: subsite (micro F 1 score of 72.53, macro F 1 score of 35.76) and histology (micro F 1 score of 80.96, macro F 1 score of 37.94). The largest performance gains over the HiSAN model were for histology, for which a Path-BigBird model increased the micro F 1 score by 1.44 points and the macro F 1 score by 3.55 points. Overall, the results suggest that a Path-BigBird model with a vocabulary derived from wellcurated and deidentified data is the best-performing model. CONCLUSION The Path-BigBird pathology transformer model improves automated information extraction from pathology reports. Although Path-BigBird outperforms Clinical BigBird and HiSAN, these less computationally expensive models still have utility when resources are constrained.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Exactly unitary discrete representations of the metaplectic transform for linear-time algorithms

The metaplectic transform (MT), a generalization of the Fourier transform sometimes called the linear canonical transform, is a tool used ubiquitously in modern optics, for example, when calculating the transformations of light beams in paraxial optical systems. The MT is also an essential ingredient of the geometrical-optics modeling of caustics that we recently proposed. In particular, this application relies on the near-identity MT (NIMT); however, the NIMT approximation used so far is not exactly unitary and leads to numerical instability. Here, we develop a discrete MT that is exactly unitary, and approximate it to obtain a discrete NIMT that is also unitary and can be computed in linear time. We prove that the discrete NIMT converges to the discrete MT when iterated, thereby allowing the NIMT to compute MTs that are not necessarily near-identity. Finally, we then demonstrate the new algorithms with a series of examples.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

TX$^2$: Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration (Martindale & Stewart, 2021), or TX 2 software package, is a library designed for artificial intelligence researchers to better understand the performance of transformer models (Vaswani et al., 2017) used for sequence classification. The tool is capable of integrating with a trained transformer model and a dataset split into training and testing populations to produce an ipywidget (Project Jupyter Contributors, 2021) dashboard with a number of visualizations to understand model performance with an emphasis on explainability and interpretability. The TX 2 package is primarily intended to integrate into a workflow centered around Jupyter Notebooks (Kluyver et al., 2016), and currently assumes the use of PyTorch (Paszke et al., 2019) and Hugging Face transformers library (Wolf et al., 2020). The dashboard includes visualization and data exploration features to aid researchers, including an interactive UMAP embedding graph (McInnes et al., 2018) to understand classification clusters, a word salience map that can be updated as researchers alter textual entries in near real time, a set of tools to understand word frequency and importance based on the clusters in the UMAP embedding graph, and a set of traditional confusion matrix analysis tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Basic Research Needs for Transformative Manufacturing (Brochure)

Manufacturing is central to the nation’s prosperity and security. Manufacturing currently represents about 12% of the gross domestic product, provides nearly 13 million jobs, and accounts for about 25% of energy use. The nation’s economy relies heavily on wide-ranging manufacturing sectors - all of which share common challenges including data issues, lack of physics and chemistry-based models across scales, and resource constraints in a global environment. Furthermore, there are many hurdles that must be overcome to move basic science innovations to market. Addressing broad-ranging challenges demands a basic-science strategy that underpins applied research activities. This strategy would accelerate innovation and transform manufacturing. A Basic Research Needs workshop for Transformative Manufacturing was held in March 2020. The focus of the workshop was to identify the basic science research priorities that could accelerate innovation to transform manufacturing in the future. This was the first workshop of its kind to examine how basic energy science can drive manufacturing forward and innovate new ways to manufacture goods. Five Priority Research Directions were identified that address these science challenges: (1) innovative synthetic approaches to enable scalable assembly of matter, (2) computational methods and theoretical models to transform how manufacturing processes are controlled, (3) new characterization tools that can handle the necessary complexity, scales, and processing speeds to meet manufacturing needs, (4) new science to address opportunities relevant to sustainable and energy-efficient manufacturing, and (5) foundational approaches to co-design of materials, process, and products.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Modeling Failure of Electrical Transformers due to Effects of a HEMP Event

Understanding the effect of a high-altitude electromagnetic pulse (HEMP) on the equipment in the United States electrical power grid is important to national security. A present challenge to this understanding is evaluating the vulnerability of transformers to a HEMP. Evaluating vulnerability by direct testing is cost-prohibitive, due to the wide variation in transformers, their high cost, and the large number of tests required to establish vulnerability with confidence. Alternatively, material and component testing can be performed to quantify a model for transformer failure, and the model can be used to assess vulnerability of a wide variety of transformers. This project develops a model of the probability of equipment failure due to effects of a HEMP. Potential failure modes are cataloged, and a model structure is presented which can be quantified by the results of small-scale coupon tests.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

HEMP Transformer Defense Through Power Electronics

High altitude electromagnetic pulses and geo-magnetic disturbances have the potential to severely impact the electric power grid by damaging large power transformers and causing severe power quality issues. This impact comes as a result of a quasi-static bias induced on transmission lines by geomagnetically induced currents which saturate magnetic components in the electric power system. This paper introduces the concept of utilizing a h-bridge inverter on the neutral of a LPT to inject a DC bias equivalent voltage onto the neutral side of the transformer windings. This biasing floats the transformer windings, eliminating the effect of the DC current and keeping the transformer from saturating. Schematic diagrams will be presented, along with simulation model data using Typhoon and PLECS, and finally test results from a benchtop hardware test.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Thermal Process Intensification: Transforming the Way Industry Uses Thermal Process Energy (Workshop Report)

The US Department of Energy’s (DOE’s) Advanced Manufacturing Office held the virtual workshop entitled “Thermal Process Intensification: Transforming the Way Industry Uses Thermal Process Energy” in November and December 2020. The workshop brought together participants from universities/laboratories, industries, equipment manufacturers, technology vendors, nongovernmental organizations, and subject-matter experts to discuss transformative technologies and strategies to substantially improve the performance (e.g., energy productivity, thermal efficiency, reduced greenhouse gas [GHG] emissions, reduced number of process steps) of thermal processing systems in the industrial sector. The US industrial sector accounts for 32% of the nation’s primary energy use (including feedstocks), and refining, chemicals, pulp and paper, iron and steel, and food products represent the top energy-consuming sectors. Thermal processing or process heating represents the largest energy use category; it accounts for 63% of all energy use in manufacturing. Additionally, thermal processing is the largest contributor of carbon dioxide (CO2) generation, resulting from combustion of fuels and process related chemical reactions, such as in the case of cement and lime production. The challenge of achieving net-zero industrial GHG emissions is colossal considering the established industrial base that depends mainly on carbon-based processes and energy sources; the time frame and cost to replace carbon-based energy sources and feedstocks; and the long-term outlook for development with large-scale adaptation of alternative non carbon–based technologies. The goals of the DOE Advanced Manufacturing Office Thermal Process Intensification Workshop were as follows: (1) Identify R&D gaps and opportunities to facilitate transformative improvement in industrial thermal processes beyond current technologies and allow for entirely new methods for processing materials; (2) Gain insight into new and innovative approaches to thermally intensify processes, reduce heat demand, harness waste heat, and use fuels and hydrocarbon feedstocks more efficiently; (3) Identify the R&D pathways to thermal process intensification (TPI) with the highest potential for impact and adoption by the industrial sector; (4) Define areas of research, development, and demonstration (RD&D) activities to accelerate development and application of emerging and transformative technologies to intensify thermal processes in industry. The scope and focus of the workshop were defined to meet these goals. Based on the available data for energy use and GHG emissions, the industries that collectively use more than 80% of the total process heating energy consumption were selected as primary focus areas. The chosen industries were combined into the following four groups based on similarities in their thermal processes: high-temperature metal processing (iron and steel industry, alumina-aluminum industry); high-temperature nonmetal and mineral processing (cement and glass industry); medium- to low-temperature thermal processing (food processing and pulp and paper industry as part of forest products sector); and hydrocarbon processing (petroleum refining and chemical industry). Furthermore, all potential TPI technologies associated with the processes defined were considered as part of the workshop. Different types of TPI technologies possible in industrial in the document.

42 ENGINEERING↗
DOE OSTI2024

Vision Transformers Explained Series

Since their introduction in 2017 with Attention is All You Need¹, transformers have established themselves as the state of the art for natural language processing (NLP). In 2021, An Image is Worth 16x16 Words successfully adapted transformers for computer vision tasks. Since then, numerous transformer-based architectures have been proposed for computer vision. This article walks through the Vision Transformer (ViT) as laid out in An Image is Worth 16x16 Words.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Overcoming Barriers in Plant Transformation: A Focus on Bioenergy Crops

Although 2023 marked the 40th anniversary of the first transgenic plant, routine transformation of most plant genotypes remains elusive. Rapid systems to overexpress, interfere, or knock out genes— collectively defined in this report as “transformation and editing technologies”—are needed to understand plant gene function. This understanding in turn is crucial for efficiently developing new, sustainable, high-yielding, and climate-resilient crops to meet the growing demand for food, feed, fiber, and fuel. In particular, the ability to apply transformation and editing technologies to bioenergy crops has remained largely unrealized. To address this opportunity, the U.S. Department of Energy (DOE) Biological and Environmental Research Program convened a workshop on September 18–20, 2023, to define transformation and editing needs and barriers focused on bioenergy crops. The main conclusions are summarized below.

09 BIOMASS FUELS↗
DOE OSTI2024

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Transformative Pathways for U.S. Industry: Unlocking American Innovation

The United States (U.S.) is undergoing an energy transformation that will depend on continued U.S. innovation. Although U.S. industry has been foundational to the nation’s economic growth and prosperity, it has also given rise to decades’ worth of industrial pollutants in our air and water, which acutely impact the most vulnerable communities, as well as greenhouse gas (GHG) emissions contributing to climate risk. At the same time, U.S. industry is facing growing competitive pressures. Global investors and financial regulations are increasingly focusing on emissions footprints, governments are developing emissions-based trade adjustments and procurement specifications, and downstream demand for low-carbon products is emerging. Developing cost-competitive solutions to meet these needs provides an opportunity to fundamentally transform U.S. industry and sharpen its competitive edge, while reducing the GHG emissions and adverse environmental and health impacts (see Figure ES-1). Innovation is central to this transformation. Pathways to Commercial Liftoff: Industrial Decarbonization, which provides a descriptive fact base on what is needed to reach commercial scale in the marketplace, estimates that over 60% of emissions reduction for the industrial sector will need to come from technologies that are still nascent today. This report, Transformative Pathways for U.S. Industry,3 focuses on the pathways that rely on the nascent and innovative technologies that were too early for consideration in the Pathways to Commercial Liftoff report. Targeted and sustained public and private investment in research, development, demonstration, and deployment is required to catalyze innovation and meet this moment.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

AC to AC Solid State Transformer with Bidirectional Switches

This report details the work of the 3-year project for the AC-to-AC Solid State Transformer with Bidirectional Switches project devoted to developing and demonstrated a Type I Solid State Transformer. This report details the design, fabrication, and evaluation of both three-phase and single-phase versions of this solid state transformer operating as a single module, modules in parallel, and modules in cascade. Additionally, this report details the fabrication and evaluation of custom Silicon Carbide bidirectional switches to enable this topology with a comparison between monolithically integrated bidirectional switches as well as co-packaged back-to-back unidirectional devices. Finally, results for custom-fabricated Fe 4 N/ferrite laminated toroidal cores for high frequency transformers are present.

42 ENGINEERING↗