Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Low-latency Jet Tagging for HL-LHC Using Transformer Architectures

Transformers are the state-of-the-art model architectures and widely used in application areas of machine learning. However the performance of such architectures is less well explored in the ultra-low latency domains where deployment on FPGAs or ASICs is required. Such domains include the trigger and data acquisition systems of the LHC experiments. We present a transformer-based algorithm for jet tagging built with the HGQ2 framework, which is able to produce a model with heterogeneous bitwidths for fast inference on FPGAs, as required in the trigger systems at the LHC experiments. The bitwidths are acquired during training by minimizing the total bit operations as an additional parameter. By allowing a bitwidth of zero, the model is pruned in-situ during training. Using this quantization-aware approach, our algorithm achieves state-of-the-art performance while also retaining permutation invariance which is a key property for particle physics applications. Due to the strength of transformers in representation learning, our work also serves as a stepping stone for the development of a larger foundation model for trigger applications.

Laatu, Lauri [Imperial Coll., London]↗

Natural transformation as a tool in Acinetobacter baylyi : Evolution by amplification of gene copy number

For many years, the natural competency of Acinetobacter baylyi ADP1 facilitated studies of bacterial metabolism, biochemistry, and physiology. With the advent of synthetic biology, new opportunities arise to exploit the remarkable transformability and chromosomal plasticity of this model organism. In this chapter, we describe a recently developed method, “Evolution by Amplification and Synthetic Biology” (EASy). EASy allows the targeted amplification of chromosomal segments that give rise to new phenotypes. Increased gene dosage regulates protein expression in a rudimentary fashion by establishing a chromosomal array in which copy number adjusts via recombination between repeated DNA sequences. Selective conditions enrich for cells within the population that confer a growth advantage. Under continuous selective pressure, beneficial mutations may accumulate in any genomic region. Such mutations favor decreases in the average copy number of the target region. Thus, the genetic flexibility afforded by transient copy number variation helps accelerate the selection of engineered strains with desired traits during laboratory evolution. As a result, thanks to the extremely simple genetic manipulation of Acinetobacter baylyi ADP1, the EASy method can be readily implemented by researchers without the need for advanced instrumentation or complex cloning techniques.

59 BASIC BIOLOGICAL SCIENCES↗

Planar Transformer With Asymmetric Integrated Leakage Inductance Using Horizontal Air Gap

This article presents a novel planar-based transformer winding and core structure with controllable leakage inductance generation for integrated magnetics applications. As a result of limitations in integrated magnetics from the literature, a new approach is proposed utilizing semi-interleaved windings and controllable leakage via a leakage flux core leg featuring a horizontal air gap. Here, the proposed transformer design is analyzed via detailed reluctance modeling to determine closed-form equations for the magnetizing and asymmetrically distributed leakage inductances. Next, a genetic-algorithm-based multiobjective design optimization problem is developed, seeking to minimize the core and winding losses of the proposed transformer subject to a set of parametric and geometric constraints in a dc-ac dual-active-bridge topology for microinverter applications. The optimization was extended to include other integrated magnetic structures from the literature, where it is determined that the proposed transformer is superior from the perspectives of efficiency, footprint area, and parasitic capacitance. Based on the results of the optimization analysis, two designs with theoretical transformer California Energy Commission (CEC) efficiency drops (i.e., CEC efficiency reduction specifically due to the transformer loss mechanisms) of 1.19% and 0.83% were fabricated and evaluated for electrical and thermal performance in the proposed 40 V, 400 W microinverter.

42 ENGINEERING↗

Real-Time Health Monitoring for Gas Turbine Components Using Online Learning and High-Dimensional Data

Capital-intensive turbomachinery, such as gas turbines and combined cycle plants, are constantly being monitored for performance anomalies, faults, and physical degradation. Although these power-generating assets are equipped with hundreds of sensors, existing monitoring tools can only handle moderate-sized data. As a result, only a handful of aggregate metrics are used to monitor machine health. At the same time, developing advanced tools suitable for large datasets have been restricted by the lack of appropriate data. The objective of this proposal was to demonstrate a Big Data analytics framework for fault detection and diagnosis in gas turbine applications. We develop a predictive analytics framework methodology guided by these experimental data, industrial data from our collaborators, and physics-based models with engineering domain knowledge. Our analytics framework consists of four key components (1) a data curation process that addresses data storage, data quality assessments, and integrity checks, (2) a feature engineering component that utilizes statistical methods and transformation algorithms guided by physics-based models to extract high-fidelity fault features that can be leveraged for fault detection and classifying fault severities, (3) a Machine Learning-based fault detection and diagnostics algorithms for detecting operational and hardware faults in the combustion and the turbines section. We utilize two industry-class gas turbine component test rigs to generate first of its kind data for critical gas turbine faults with varying severity levels. Advanced gas turbine test facilities will be interrogated using state-of-the-art instrumentation techniques to build fault signatures and data trends for key combustor and turbine faults. Data generated from a combustor test rig (Georgia Tech) and a turbine test rig (Penn State) during both normal operation and with seeded faults serve as the basis for the Big Data sets. The test conditions in the two test facilities include common, critical events that occur in the operation. Utilizing the combustor test rig, we examine two common combustor faults: lean blowout and centerbody degradation. For the turbine section we develop analytic models for monitoring cooling faults in the gas turbine

03 NATURAL GAS↗

Real-Time Health Monitoring for Gas Turbine Components Using Online Learning and High-Dimensional Data (Final Report)

Capital-intensive turbomachinery, such as gas turbines and combined cycle plants, are constantly being monitored for performance anomalies, faults, and physical degradation. Although these power-generating assets are equipped with hundreds of sensors, existing monitoring tools can only handle moderate-sized data. As a result, only a handful of aggregate metrics are used to monitor machine health. At the same time, developing advanced tools suitable for large datasets have been restricted by the lack of appropriate data. The objective of this proposal was to demonstrate a Big Data analytics framework for fault detection and diagnosis in gas turbine applications. We develop a predictive analytics framework methodology guided by these experimental data, industrial data from our collaborators, and physics-based models with engineering domain knowledge. Our analytics framework consists of four key components: (1) a data curation process that addresses data storage, data quality assessments, and integrity checks, (2) a feature engineering component that utilizes statistical methods and transformation algorithms guided by physics-based models to extract high-fidelity fault features that can be leveraged for fault detection and classifying fault severities, (3) a Machine Learning-based fault detection and diagnostics algorithms for detecting operational and hardware faults in the combustion and the turbines section. We utilize two industry-class gas turbine component test rigs to generate first of its kind data for critical gas turbine faults with varying severity levels. Advanced gas turbine test facilities will be interrogated using state-of-the-art instrumentation techniques to build fault signatures and data trends for key combustor and turbine faults. Data generated from a combustor test rig (Georgia Tech) and a turbine test rig (Penn State) during both normal operation and with seeded faults serve as the basis for the Big Data sets. The test conditions in the two test facilities include common, critical events that occur in the operation. Utilizing the combustor test rig, we examine two common combustor faults: lean blowout and centerbody degradation. For the turbine section we develop analytic models for monitoring cooling faults in the gas turbine.

20 FOSSIL-FUELED POWER PLANTS↗

Development of Scalable Reactive Transport Framework for PFAS

Research on PFAS chemicals is extensive and covers all aspects, including analytical quantification, determination of properties, toxicology, ex situ treatment, and in situ remediation. PFAS chemicals are very stable and thus persistent/recalcitrant in the environment. Although there are many unknowns about PFAS chemicals, degradation pathways, reaction rates, etc., many different sorption, oxidation, reduction, biological, and innovative treatment approaches are being developed. Sorption with activated carbon is currently the only fully available in situ treatment technology for PFAS-impacted groundwater. Given the wide array of PFAS chemicals and transformation products, remediation may need multi-step treatment trains to fully address the PFAS contamination. The work here provides kinetic reaction modules that represent an initial cut at functionality representing PFAS migration and reaction in groundwater aquifer flow and transport models. One reaction kinetics module provides a method to model kinetically limited adsorption using a mass transfer model. The second reaction module represents biological transformation of 8:2 FTOH and daughter species, illustrating how a complex reaction pathway network can be represented. Both reaction modules allow for spatially variable parameter values so that a variety of remediation approaches (e.g., a PRB or volumetric treatment or variations in geochemical conditions) can be simulated. The intent with these PFAS reaction modules is to provide tools for practitioners to aid in the selection, design, and assessment of potential in situ PFAS remediation strategies. It is anticipated that, as PFAS remediation technologies and scientific understanding advances, these modules would be refined or replaced to match new knowledge.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Universal Stripe Symmetry of Short-Range Charge Density Waves in Cuprate Superconductors

The omnipresence of charge density waves (CDWs) across almost all cuprate families underpins a common organizing principle. However, a longstanding debate of whether its spatial symmetry is stripe or checkerboard remains unresolved. While CDWs in lanthanum- and yttrium-based cuprates possess a stripe symmetry, distinguishing these two scenarios is challenging for the short-range CDW in bismuth-based cuprates. Here, high-resolution resonant inelastic x-ray scattering is employed to uncover the spatial symmetry of the CDW in Bi 2 Sr 2-x La x CuO 6 + δ . Across a wide range of doping and temperature, anisotropic CDW peaks with elliptical shapes are found in reciprocal space. Based on Fourier transform analysis of real-space models, the results are interpreted as evidence of unidirectional charge stripes, hosted by mutually 90°-rotated anisotropic domains. This work paves the way for a unified symmetry and microscopic description of CDW order in cuprates.

36 MATERIALS SCIENCE↗

Robustness of the Ensemble Score Filter to the Type of Assimilated Observation Networks

Recent advances in data assimilation (DA) have focused on developing more flexible approaches that can better accommodate nonlinearities in models and observations. However, it remains unclear how the performance of these advanced methods depends on the observation network characteristics. In this study, we present initial experiments with the surface quasi‐geostrophic model, in which we compare a recently developed ensemble filter using score‐based diffusion models with the standard Local Ensemble Transform Kalman Filter (LETKF). Our results show that the analysis solutions respond differently to the number, spatial distribution, and nonlinear fraction of assimilated observations. We also find notable changes in the multiscale characteristics of the analysis errors. Given that standard DA techniques will eventually be replaced by more advanced methods, we hope this study sets the ground for future efforts to reassess the value of Earth observing systems in the context of newly emerging algorithms.

97 MATHEMATICS AND COMPUTING↗

Micromechanical Fields Associated with Irregular Deformation Twins in Magnesium

Understanding and controlling the development of deformation twins is paramount for engineering strong and stable hexagonal close-packed (HCP) Mg alloys. Actual twins are often irregular in boundary morphology and twin crystallography, deviating from the classical picture commonly used in theory and simulation. In this work, the elastic strains and stresses around irregular twins are examined both experimentally and computationally to gain insight into how twins develop and the microstructural features that influence their development. A nanoprecession electron diffraction (N-PED) technique is used to measure the elastic strains within and around a $\left\{ {10\overline{1}2} \right\}$ tensile twin in AZ31B Mg alloy with nm scale resolution. A full-field elasto-viscoplastic fast Fourier transform (EVP-FFT) crystal plasticity model of the same sub-grain and irregular twin structure is employed to understand and interpret the measured elastic strain fields. The calculations predict spatially resolved elastic strain fields in good agreement with the measurement, as well as all the stress components and the dislocation density fields generated by the twin, which are not easily obtainable from the experiment. The model calculations find that neighboring twins, several twin thicknesses apart, have little influence on the twin-tip micromechanical fields. Furthermore, this work reveals that irregularity in the twin-tip shape has a negligible effect on the development of the elastic strains around and inside the twin. Importantly, the major contributor to these micromechanical fields is the alignment of the twinning shear direction with the twin boundary.

36 MATERIALS SCIENCE↗

Structural complexity of γ-Al 2 O 3 : The nature of vacancy ordering and the structure of complex antiphase boundaries

The structure of γ-Al2O3 remains largely undetermined despite decades of research. This is due to the high degree of disorder, which poses significant challenges for structural analysis using conventional crystallographic approaches. Herein, we study the structure of γ-Al2O3 with Scanning Transmission Electron Microscopy (STEM) and ab-initio calculations to provide a complete structural description. We show that the microstructure can be understood in terms of two key structural features of nanoscale spinel domains and finite thickness segments termed as complex antiphase boundaries (cAPB) that provide the domain interconnectivity. The spinel domains have a distinctive preference for vacancy ordering, which can be rationalized in terms of a structure with a stacking disorder. Tetragonal P4 1 2 1 2 or monoclinic P2 1 models, all based on the identical motif, can be considered as representative ordered forms. Individual spinel domains are interconnected via cAPBs, which adopt a distinct non-spinel bonding environment of δ-Al 2 O 3 . The most common cAPB consists of a single delta motif with thickness of just 0.6 nm on (001), with the resulting displacement a/4 [101]. Remarkably, the cAPBs are shown to energetically stabilize the spinel domains of γ-Al 2 O 3 explaining their high abundance. We demonstrate how the tetragonal distortions naturally arise in this intricate microstructure and place the proposed model in the context of phase transformations to high temperature transition aluminas.

36 MATERIALS SCIENCE↗

Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by projecting it onto a Grassmann manifold. This point-wise linear dimensionality reduction harnesses the structural information to assess the similarity between solutions at different points in the input parameter space. The method utilizes a solution clustering approach in order to identify regions of the parameter space over which solutions are sufficiently similarly such that they can be interpolated on the Grassmannian. In this clustering, the reduced-order solutions are partitioned into disjoint clusters on the Grassmann manifold using the eigen-structure of properly defined Grassmannian kernels and, the Karcher mean of each cluster is estimated. Then, the points in each cluster are projected onto the tangent space with origin at the corresponding Karcher mean using the exponential mapping. For each cluster, a Gaussian process regression model is trained that maps the input parameters of the system to the reduced solution points of the corresponding cluster projected onto the tangent space. Using this Gaussian process model, the full-field solution can be efficiently predicted at any new point in the parameter space. In certain cases, the solution clusters will span disjoint regions of the parameter space. In such cases, for each of the solution clusters we utilize a second, density-based spatial clustering to group their corresponding input parameter points in the Euclidean space. The proposed method is applied to two numerical examples. Here, the first is a nonlinear stochastic ordinary differential equation with uncertain initial conditions where the surrogate is used to predict the time history solution. The second involves modeling of plastic deformation in a model amorphous solid using the Shear Transformation Zone theory of plasticity, where the proposed surrogate is used to predict the full strain field of a material specimen under large shear strains.

42 ENGINEERING↗

Characterization of thermally heat-treated polyacrylonitrile carbon fibers

This study investigates the graphitization process of polyacrylonitrile (PAN) carbon fibers by subjecting commercial fibers to thermal heat treatment at temperatures ranging from 1400 to 2100 °C in 100 °C increments, using either argon or nitrogen gas atmospheres. Changes in crystallinity, surface morphology, and lattice parameters were analyzed for two commercial carbon fibers using X-ray diffraction, scanning electron microscopy, and Raman spectroscopy. Results indicated minimal changes in surface morphology with increasing heat-treatment temperature; however, crystallinity significantly increased. Crystallinity changes were more strongly dependent on temperature rather than gas atmosphere or fiber type. At intermediate heat-treatment temperatures (1600–1800 °C), fibers treated in argon showed a slight preference for graphitization. The highest level of graphitization was measured at 2100 °C. Crystallite size increased as the intensity ratio of the D1 to G Raman peaks increased, reaching a peak around ~1800 °C, after which the ratio started to decrease. This behavior aligns with Ferrari's three-stage model of carbon crystallization and is consistent with both the Marie-Mering degree of graphitization and Brubaker's Integrated Absolute Differential models, all of which describe the transformation from an amorphous to a more graphitic structure. At the higher heat-treatment temperatures, the changes between atmospheres and fiber types were measured to converge to similar levels of graphitization. In conclusion, this study evaluates the progressive change in commercial grade carbon fibers when heat-treated.

Characterization↗

Evolution of glass structure during femtosecond laser assisted crystallization of LaBGeO 5 in glass

Single crystal LaBGeO 5 architecture formed in La 2 O 3 -B 2 O 3 -2GeO 2 glass serves as a model system for understanding of the transformation from glass to single crystal under fs laser irradiation. This transformation is highly sensitive to glass composition, raising the need to understand how the glass structure and composition evolve during crystallization. In this work, micro X-ray absorption spectroscopy and X-ray fluorescence mapping were used to study the glass structure and composition preceding LaBGeO5 crystallization in the region surrounding the single crystal growth front. The results show precipitation of germanium nanoparticles, as well as anisotropic segregation of Ge and La prior to LaBGeO5 crystallization, which are explained assuming electromigration in high fields within the plasma formed by the fs laser irradiation. However, these nanoparticles do not serve as sites for heterogeneous nucleation. Furthermore, the similarity of local structure around Ge in the starting glass and the ultimate crystal appears to enhance the crystallization process.

36 MATERIALS SCIENCE↗

Accelerating nuclear fuel development and qualification: Modeling and simulation integrated with separate-effects testing

In this work, an approach to transform and accelerate nuclear fuel development and qualification is outlined. The approach exploits advanced modeling and simulation at the outset to inform constituent and system selection and to enable integral fuel performance analyses. Analyses using these tools identify and prioritize the most important fuel performance parameters and phenomena for subsequent targeted characterization with separate-effects tests. Separate-effects testing spans out-of-pile and in-pile tests and is meant to iterate with and inform engineering-scale integral fuel performance analyses throughout the development process. Exercising this cycle in an agile fashion will increase confidence in the integral fuel performance predictions while reducing uncertainties. This process sets the stage for executing a much more limited set of well-defined integral irradiation tests designed to validate engineering-scale fuel performance codes and to confirm the performance and safety of the fuel system under prototypic conditions. This approach will reduce the time for development and qualification of a new fuel system, and it will also reduce associated costs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Alkali Metal Control of Triplet-Mediated C–H Activation in Iron-Mediated Coupling of Dinitrogen and Benzene

Direct coupling of N 2 with abundant feedstocks like benzene to form N-containing organic compounds is a promising strategy for N 2 fixation pathways. The challenge of coupling N 2 activation and C–H bond oxidative addition was recently solved by introducing a reversible benzene C–H bond activation process mediated by a low-valent Fe(0) complex, which gave an organometallic product that could couple with partially reduced N 2 . Interestingly, the energetics of the C–H oxidative addition/reductive elimination step depends on the choice of alkali metal. However, the reason why the alkali metal influences the C–H bond activation remained elusive. In this work, we present a comprehensive study on this Fe(0)-mediated reversible C–H activation. Through density functional theory combined with high-level coupled cluster calculations, we discovered that the intermediate-spin triplet (S = 1) controls the energy of the transition state for C–H cleavage, while the high-spin quintet (S = 2) controls the position of the equilibrium. Na + drives the equilibrium toward oxidative addition due to an electrostatic effect, while K + and Rb + are dominated by a steric effect that favors the iron(0) species. The key role played by nonbonding interactions in the Fe-mediated C–H activation provides a conceptual model for alkali control over organometallic transformations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhanced Oxygen Activation Achieved by Robust Single Chromium Atom-Derived Catalysts in Aerobic Oxidative Desulfurization

Oxidative desulfurization (ODS) plays critical roles in the production of high-quality sulfur impurity-free fuels, especially procedures using molecular oxygen as the sole oxidant. However, the state-of-the-art systems still rely on noble metal nanocatalysts, with deactivation issues caused by coking and sintering still present. In this work, leveraging the merits of single-atom catalysts (SACs) with earth-abundant metal cores and robust nanoporous supports, a series of catalysts composed of homogeneously distributed single chromium atoms anchored on multiwalled carbon nanotubes were fabricated and deployed to catalyze the aerobic ODS transformation. Adopting aromatic sulfur compound (ASC)-containing alkanes as a model system with molecular oxygen as the oxidant, efficient oxygen-to-active O 2 •– transformation and subsequent ASCs-to-sulfone conversion have been achieved, with the former benefiting from the chromium-active sites and the latter arising from the robust, nanoporous, and π-conjugated architecture of the supports. The attractive catalytic performance and cycling stability of the chromium-based SACs make them promising candidates in practical sulfur species removal from liquid fuels, supplying an alternative guidance on the catalyst design toward cost-effective and energy-efficient ODS procedures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Revolutionizing Energy Storage: AI, Automation, and Advanced Modeling as Catalysts for Next-Generation Breakthroughs

The Presidential Symposium (PRES) at the 2025 Fall Meeting, hosted by the President’s Office and Energy and Fuels Division, American Chemical Society (ACS) in Washington, DC, brought together a diverse group of chemists, engineers, and materials scientists working in battery materials & systems, automation and artificial intelligence from academia, industry, and national laboratories. The accelerating demand for high-performance, scalable, and sustainable energy storage has catalyzed a paradigm shift in how materials are dis-covered, devices are engineered, and systems are optimized. This Presidential Symposium, entitled “Revolutionizing Energy Storage: AI, Automation, and Advanced Modeling Driving Next-Gen Breakthroughs”, brings together global leaders to unveil transformative strategies anchored in the AAA framework: Artificial Intelligence, Automation, and Advanced Modeling. Artificial Intelligence is redefining the frontiers of energy storage by enabling predictive design, real-time optimization, and intelligent control across diverse chemistries and architectures. Automation is streamlining the synthesis, characterization, and testing of battery materials, dramatically accelerating innovation cycles and unlocking scalable solutions for grid and mobility applications. Advanced Modeling, spanning atomic to system-level scales, provides unprecedented insight into electrochemical dynamics, degradation pathways, and thermal behavior, particularly when coupled with physics-informed machine learning and digital twin technologies. Digital twins, in turn, leverage the AAA framework by integrating real-time data, physics-based models, and AI predictions into dynamic virtual replicas, enabling proactive diagnostics, optimization, and system resilience. Together, these synergistic pillars are not only re-shaping the scientific landscape but also forging a new era of reproducible, data-driven, and resilient energy storage innovation. In conclusion, this symposium marks a pivotal moment in the convergence of computational intelligence and experimental rigor, charting the course for next-generation breakthroughs in lithium-ion, solid-state, and flow battery technologies.

Artificial Intelligence (AI)↗

Comparing Gravity Waves in a Kilometer‐Scale Run of the IFS to AIRS Satellite Observations and ERA5

Abstract Atmospheric gravity waves (GWs) impact the circulation and variability of the atmosphere. Sub‐grid scale GWs, which are too small to be resolved, are parameterized in weather and climate models. However, some models are now available at resolutions at which these waves become resolved and it is important to test whether these models do this correctly. In this study, a GW resolving run of the European Center for Medium‐Range Weather Forecasts (ECMWF) Integrated Forecasting System (IFS), run with a 1.4 km average grid spacing (TCo7999 resolution), is compared to observations from the Atmospheric Infrared Sounder (AIRS) instrument, on NASA's Aqua satellite, to test how well the model resolves GWs that AIRS can observe. In this analysis, nighttime data are used from the first 10 days of November 2018 over part of Asia and surrounding regions. The IFS run is resampled with AIRS's observational filter using two different methods for comparison. The ECMWF ERA5 reanalysis is also resampled as AIRS, to allow for comparison of how the high resolution IFS run resolves GWs compared to a lower resolution model that uses GW drag parametrizations. Wave properties are found in AIRS and the resampled models using a multi‐dimensional S‐Transform method. Orographic GWs can be seen in similar locations at similar times in all three data sets. However, wave amplitudes and momentum fluxes in the resampled IFS run are found to be significantly lower than in the observations. This could be a result of horizontal and vertical wavelengths in the IFS run being underestimated.

Meteorology & Atmospheric Sciences↗