Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

POWER DATA PIPELINE

SF-25-081 Utility software for creating high-performance data pipelines to extract, load, and transform raw electric power systems measurements. For use with anomaly detection models training workflows. The software supports the project: Adaptive Cybersecurity for DER: A Game-Theoretic and Machine Learning approach for Real-Time Threat Detection and Mitigation

Plathottam, Silby Jose [Argonne National Laborator↗

Transverse mode analysis for free-space laser beams using Bayesian analysis

Reliable and rapid assessment of the transverse mode quality of a free-space laser beam has a wide range of applications in laser development, research, and utilization. It has become even more important with recent advances in developing orbital angular momentum photon beams across a broad spectral region. In this work, a general modal analysis method for a free-space multimode laser beam has been developed based on Bayesian analysis. After transforming mode decomposition into a linear system problem, a Gaussian probabilistic model is used to find a closed-form solution. The method is found to be robust with the presence of Gaussian noise. Prior knowledge about the mode content can be incorporated into the method to improve the solution for situations when coherent disturbances or contamination are present in the laser beam. This method can be used to analyze the mode content for laser beams in different bases, such as Hermite–Gaussian (HG) modes and Laguerre–Gaussian (LG) modes. Three applications of this method are presented: a detailed modal analysis of the beam image from the incoherent intensity addition of HG modes and two examples of mode decomposition using the complex wavefront from the coherent superposition of HG and LG modes. The feasibility of this method is demonstrated using various simulation results. Based on digital images of a laser beam recorded without complex wavelength-limiting optics, in principle, this method can be used in a wide wavelength range from infrared to ultraviolet, and possibly x ray.

Liu, Peifan (ORCID:0000000273816153)↗

HEMP Transformer Defense Through Power Electronics

High altitude electromagnetic pulses and geo-magnetic disturbances have the potential to severely impact the electric power grid by damaging large power transformers and causing severe power quality issues. This impact comes as a result of a quasi-static bias induced on transmission lines by geomagnetically induced currents which saturate magnetic components in the electric power system. This paper introduces the concept of utilizing a h-bridge inverter on the neutral of a LPT to inject a DC bias equivalent voltage onto the neutral side of the transformer windings. This biasing floats the transformer windings, eliminating the effect of the DC current and keeping the transformer from saturating. Schematic diagrams will be presented, along with simulation model data using Typhoon and PLECS, and finally test results from a benchtop hardware test.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Regulators’ Financial Toolbox: Leveraging Software as a Service, Cloud Computing, and Artificial Intelligence in Electric Utilities

The rapid evolution of Software as a Service (SaaS), cloud computing, and artificial intelligence (AI) is transforming the electric utility industry, reshaping operations, customer engagement, and financial models. This webinar introduced how utilities can deploy advanced software solutions and AI-driven analytics to improve grid efficiency, optimize asset management, and accurately forecast demand.

Bartlett, Phillip↗

A Portable Miniature Cryogenic Environment for In Situ Neutron Diffraction

Neutron diffraction instruments offer a platform for materials science and engineering studies at extended temperature ranges far from ambient. As one of the widely used neutron sample environment types, cryogenic furnaces are usually bulky and complex, and they may need hours of beamtime overhead for installation, configuration, cooling, and sample change, etc. To reduce the overhead time and expedite experiments at the state-of-the-art high-flux neutron source, we developed a low-cost, miniature, and easy-to-use cryogenic environment (77–473 K) for in situ neutron diffraction. A travel-size mug serves for the environment where the samples sit inside. Immediate cooling and an isothermal dwell at 77 K are realized on the sample by direct contact with liquid N 2 in the mug. The designed Al inserts serve as the holder of samples and heating elements, alleviate the thermal gradient, and clear neutron pathways. Both a single-sample continuous measurement and multi-sample high-throughput measurements are demonstrated in this environment. High-quality and refinable in situ neutron diffraction patterns are acquired on model materials. The results quantify the orthorhombic-to-cubic phase transformation process in LiMn 2 O 4 and differentiate the anisotropic lattice thermal expansions and bond length evolutions between rhombohedral perovskite oxides with composition variation.

47 OTHER INSTRUMENTATION↗

OPTIMIZATION OF A NUCLEAR VESSEL OUTLET FOR INCIDENT MONITORING

Classical nuclear core fluidic design techniques require improvement to better align with modern technological innovations. The US Department of Energy’s Office of Nuclear Energy (DOE-NE) Transformational Challenge Reactor (TCR) program is deploying additive manufacturing and advanced modeling and simulation to reimagine these designs. With the aid of modern computing power, computerized design optimization can be implemented to remove unwanted pressure drop while simultaneously optimizing flow structures, resulting in new opportunities to enable advanced instrumentation and monitoring capabilities.Previous development of geometric specifications for the TCR pressure vessel’s outlet plenum used design optimization to (1) limit pressure losses below 3.5 kPa (~0.5 psi) and (2) create a fluidic plane in which the temperature variation would not exceed ±5°C. This significant limit of the allowable pressure drop stems from the overarching goal of the TCR program to apply cutting edge techniques and unconventional thinking to demonstrate potential opportunities in additive manufacturing (AM).This paper expands the previous work by optimizing thermowell locations for robust measurements by explicitly modeling them and the resulting flow impacts. Additionally, a single core coolant channel was chosen to represent an event that causes an increased bulk flow temperature increase of 100°C.High fidelity unsteady Reynolds-averaged Navier-Stokes (URANS) simulations of the conjugate heat transfer problem were run in Siemen’s Star-CCM+ for this study. Next, the bulk flow temperature of a single coolant channel was increased by 100°C and was allowed to converge again. Finally, statistical analysis using a sequential probability ratio test (SPRT) was used to determine the elapsed time the thermocouples took to discover the increased bulk flow temperature.

See, Nate↗

TRANSSFORM Workshop Empowering the US manufacturing industry proceedings report

The U.S. Department of Energy (DOE), Office of Energy Efficiency and Renewable Energy, and Advanced Manufacturing Office (AMO) hosted the TRANSSFORM (Transformative, Resilient, Adaptive, Nimble, Sustainable, Smart, Flexible, Optimal, Robust, and Model-based1 – A Bold Vision for the Future of U.S. Manufacturing) Workshop on September 8–10, 2021. The objective of the workshop was to hear from stakeholders about how manufacturing digitalization can improve manufacturing competitiveness and reduce energy consumption and emissions production from U.S. manufacturing, and what research, development, and demonstrations are needed to have the desired impact.

manufacturing digitalization, decarbonization, IoT↗

Sustainable Manufacturing and the Circular Economy

The manufacturing industry predominantly follows a linear model of production in which raw materials are mined or grown, transformed into manufactured goods, used for a period, and then discarded. However, this once-through flow of materials to manufactured products is not sustainable. Many high-grade ore bodies have been consumed, increasing the energy and material impacts per ton of mined material. At the other end of the cycle, there are challenges with the efficiency and effectiveness of our waste disposal system.

life cycle, ReX↗

Effects of input gradient regularization on neural networks time-series forecasting of thermal power systems

This study proposes using neural networks, specifically gated recurrent unit (GRU), long-short-term memory (LSTM), and transformer networks, to improve control strategies in a 450 MW coal-fired power plant. However, neural networks face issues of becoming overly dependent on just a few variables to make predictions, which negatively impacts control decisions that rely on the model to determine the value of all manipulated variables. The paper introduces regularization techniques, including noise injection and input gradient regularization, during the training phase. Here, the work presents novel contributions in adapting neural networks to control industrial systems and applying regularization techniques from computer vision to industrial process control. Results demonstrate the effectiveness of input gradient regularization in reducing model dependence on subsets of variables, emphasizing the balance between fidelity and controllability. Further exploration is recommended, including the development of recurrent transformers, closed-loop control testing, and a sensitivity analysis on computer models to provide further insight.

20 FOSSIL-FUELED POWER PLANTS↗

A Data-Agnostic, Continuous Machine Learning Framework for Application in High Energy Physics and Beyond: Phase 1 Final Scientific/Technical Report

This Phase 1 effort has focused on the development of continual learning frameworks for use in machine learning, specifically in the applied context of High Energy Physics (HEP). Machine learning (ML) is a transformative technology by which computers, typically through the use of neural networks, are able to perform tasks with proficiency that rivals or surpasses that of human users. Model Degradation & Catastrophic Forgetting are two undesired phenomena which can occur in ML where the performance of a model degrades when either deployed on novel data streams, or trained on novel data which are sufficiently different than the data the models were initially trained on. A natural example where these sorts of effects can be observed is in the performance of detectors in harsh environments, where the detector signature may change over the lifetime of the detector as it ages and deteriorates — precisely what occurs in the experiments conducted in HEP. Real world HEP data is therefore an excellent test-ground and use-case for Continual Learning paradigms, which are techniques used in ML to counteract these problems. Ensemble learning is one such technique, where multiple smaller models are trained on subsets of the overall data and are ensembled together during inference. The intuition behind this technique is that, although there are shifts in the distributions which govern the incoming data streams, these shifts are not expected to be homogeneous or global. If a sufficient diversity in solutions within the various sub-models has been achieved, then at least one sub-model is expected to retain its performance within the overall ensemble. One further strength of this approach is that the architectures of the various models do not need to be identical, and in fact even different modalities of data can naturally be combined in this way. This work focused on applying ensemble learning techniques to derive results using two main datasets, anomaly detection in HEP data & time-series forecasting in semiconductor manufacturing data. Semiconductor manufacturing involves data with surprising similarity to that of HEP (e.g. wafer maps look very similar to digi-occupancy maps) and Cerium Lab’s prominence within the semiconductor industry makes semiconductor manufacturing a natural opportunity for commercialization of this work. Our efforts have led to two strong results. The first is that we evaluated the proposed ensembling techniques using previously proposed machine learning architectures for use in anomaly detection, namely AutoEncoder based models and their derivatives. We also developed new architectures which have not been evaluated in this context before. In fact, this work marks the first use of Vision Transformers for anomaly detection in HEP. Second, we demonstrated that ensemble learning significantly improves model performance in scenarios prone to degradation, validating its effectiveness across both HEP and semiconductor datasets. These results further support ensemble learning as a powerful strategy for mitigating catastrophic forgetting and maintaining robust performance in evolving data environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The melt memory effects in polymer crystallization

This paper presents a systematic review of the literature on the melt memory effects observed in polymers, an area that has engendered considerable debate for over 50 years. Recent advances in experimental techniques have provided fresh insights into how a polymer's thermal history influences its recrystallization behavior. It has been observed that given other conditions unchanged, the crystallization temperature during recrystallization decreases with an increase in the melt temperature T s above the melting point T m until a critical melt temperature is attained. This phenomenon also extends to the half-time of crystallization and the secondary structures, such as lamellar thickness, of semi-crystalline polymers. Despite these findings, a comprehensive constitutive model that encapsulates polymer melt memory effects remains elusive. Cutting-edge instrumentation, including in situ small and wide-angle X-ray scattering, temperature-controlled Fourier transform infrared spectroscopy, and flash differential scanning calorimetry, have posed significant challenges to the traditional nucleation and growth models established in the 1970s. These models are foundational to our understanding of polymer crystallization, which is an integral part of polymer processing and production. In this review, the historical contours of this discourse are traced, with an examination of both the recent experimental breakthroughs and theoretical advancements pertinent to polymer melt memory effects. In conclusion, this paper delves into the prevailing theories of polymer nucleation and crystallization and engages with theoretical discussions and numerical simulations that attempt to elucidate and rationalize these melt memory phenomena.

36 MATERIALS SCIENCE↗

PyOECP: A flexible open-source software library for estimating and modeling the complex permittivity based on the open-ended coaxial probe (OECP) technique

Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.

97 MATHEMATICS AND COMPUTING↗

Scaling similarities and quasinormal modes of D0 black hole solutions

We study the gravity solution dual to the D0 brane quantum mechanics, or BFSS matrix model, in the ’t Hooft limit. The classical physics described by this gravity solution is invariant under a scaling transformation, which changes the action with a specific critical exponent, sometimes called the hyperscaling violating exponent. We present an argument for this critical exponent from the matrix model side, which leads to an explanation for the peculiar temperature dependence of the entropy in this theory, S ∝ T 9/5 . We also present a similar argument for all other Dp-brane geometries. We then compute the black hole quasinormal modes. This involves perturbing the finite temperature geometry. These perturbations can be easily obtained by a mathematical trick where we view the solution as the dimensional reduction of an Ad S2+9/5 × S 8 geometry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Modelling populations of kilonovae

Abstract The 2017 detection of a kilonova coincident with gravitational-wave emission has identified neutron star mergers as the major source of the heaviest elements and dramatically constrained alternative theories of gravity. Observing a population of such sources has the potential to transform cosmology, nuclear physics, and astrophysics. However, with only one confident multi-messenger detection currently available, modelling the diversity of signals expected from such a population requires improved theoretical understanding. In particular, models that are quick to evaluate and are calibrated with more detailed multi-physics simulations are needed to design observational strategies for kilonovae detection and to obtain rapid-response interpretations of new observations. We use grey-opacity models to construct populations of kilonovae, spanning ejecta parameters predicted by numerical simulations. Our modelling focuses on wavelengths relevant for upcoming optical surveys, such as the Rubin Observatory Legacy Survey of Space and Time (LSST). In these simulations, we implement heating rates that are based on nuclear reaction network calculations. We create a Gaussian-process emulator for kilonova grey opacities, calibrated with detailed radiative transfer simulations. Using recent fits to numerical relativity simulations, we predict how the ejecta parameters from binary neutron star (BNS) mergers shape the population of kilonovae, accounting for the viewing-angle dependence. Our simulated population of BNS mergers produce peak i-band absolute magnitudes of −20 ≤ Mi ≤ −11. A comparison with detailed radiative transfer calculations indicates that further improvements are needed to accurately reproduce spectral shapes over the full light curve evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

High-Performance Integrated Window and Façade Solutions for California

The researchers developed a new generation of high-performance façade systems and supporting design and management tools to support industry in meeting California’s greenhouse gas reduction targets, reduce energy consumption, and enable an adaptable response to minimize real-time demands on the electricity grid. The project resulted in five outcomes: (1) The research team developed an R-5, 1-inch thick, triplepane, insulating glass unit with a novel low-conductance aluminum frame. This technology can help significantly reduce residential cooling and heating loads, particularly during the evening. (2) The team developed a prototype of a windowintegrated local ventilation and energy recovery device that provides clean, dry fresh air through the façade with minimal energy requirements. (3) A daylight-redirecting louver system was prototyped to redirect sunlight 15–40 feet from the window. Simulations estimated that lighting energy use could be reduced by 35–54 percent without glare. (4) A control system incorporating physics-based equations and a mathematical solver was prototyped and field tested to demonstrate feasibility. Simulations estimated that total electricity costs could be reduced by 9-28 percent on sunny summer days through adaptive control of operable shading and daylighting components and the thermostat compared to state-of-the-art automatic façade controls in commercial building perimeter zones. (5) Supporting models and tools needed by industry for technology R&D and market transformation activities were validated. Attaining California’s clean energy goals require making a fundamental shift from today’s ad-hoc assemblages of static components to turnkey, intelligent, responsive, integrated building façade systems. These systems offered significant reductions in energy use, peak demand, and operating cost in California.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ELM‐MOSART‐DOC: A Large‐Scale Riverine Dissolved Organic Carbon Model and Its Application Over the United States

Riverine dissolved organic carbon (DOC), primarily sourced from soil organic carbon (SOC), plays a crucial role in regional and global carbon cycles. However, the complexities of the underlying mechanisms and limited observations present significant challenges for predictive understanding of DOC at regional or larger scales. Recently, we developed a machine learning‐based (ML) map of DOC transformation rates, bridging the gap between SOC and DOC leaching flux and simplifying terrestrial DOC representation. Building on this advancement, we introduce ELM‐MOSART‐DOC, a DOC module integrated into the riverine component of the Energy Exascale Earth System Model (E3SM)—the Model for Scale Adaptive River Transport (MOSART). ELM‐MOSART‐DOC simulates DOC transport and transformation across both headwater streams and river networks, including those managed. Model validation demonstrates the ability of ELM‐MOSART‐DOC to accurately capture long‐term average DOC concentrations, with Kling‐Gupta Efficiency (KGE) scores of 0.58 and 0.76 at large and local stations, respectively. We further assess the impact of reservoirs through different simulation schemes, revealing that reservoirs significantly alter DOC fluxes by regulating streamflow patterns and promoting DOC mineralization. Model simulations indicate that reservoirs reduce total DOC flux from the Mississippi River into the ocean by 7.5%, with the long‐term average annual export decreasing from 3.34 to 3.14 teragrams (Tg) per year. ELM‐MOSART‐DOC integrates process‐based modeling with ML parameterization to enhance the predictive understanding of riverine biogeochemical processes. This approach reduces uncertainties in modeling regional and global carbon cycle ESMs and provides new insights into carbon cycling and its implications for global environmental change.

Li, Lingbo [Univ. of Houston, TX (United States); ↗

Maximized Information Gain of Next Generation Pulsed Power Using Optimized Design of Z-Machine Experiments

This project develops a Bayesian optimization approach to extracting insights from Z Machine experimental data to determine if and how these insights can be used to extrapolate to a larger facility. The primary goal is to address the scientific challenge of informing how confidently experimental conditions can be predicted on a next generation facility, the design of which requires the reliable extrapolation of current high energy density technologies to regimes yet unobserved, except by costly high-fidelity computational models. Maximizing the use of presently available data and understanding how it informs future endeavors is critically important to enable transformative pulsed power and the science of extreme conditions. We explore a Bayesian optimization approach to experimental design which combines information theory, experimental data, and computational modeling to explore how information gain can be maximized.

97 MATHEMATICS AND COMPUTING↗

Pathways to High-Performance Salt Hydrate Thermochemical Energy Storage Materials and Systems

Thermochemical materials (TCMs) based on salt hydrates are promising for thermal energy storage as they combine high energy densities with low reaction temperatures. However, their adoption is hindered by poor structural integrity and degradation under hygrothermal cycling. Storage performance is governed not only by the chemical reaction, but also by the coupled thermo-chemo-mechanical behavior that evolves with cycling. Understanding and controlling this coupling across length scales (material-to-reactor) is necessary to improve TCM stability and lifetime. In this perspective, we discuss the shortcomings of current characterization approaches and emphasize the need for measuring transport properties and structural transformations using in situ techniques that capture the dynamic evolution of these materials. We also outline opportunities for multiscale modeling frameworks that link thermodynamics and mechanics, enabling predictive evaluation of composite architectures designed for cycling stability. We conclude by identifying research questions that must be addressed to transform TCMs into viable energy storage technologies.

Composites↗