Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Data and Code for Understanding Generative AI Content with Embedding Models

This repository contains code for the experiments in the paper "Understanding Generative AI Content with Embedding Models". Constructing high-quality features is critical to any quantitative data analysis. While feature engineering was historically addressed by carefully hand-crafting data representations based on domain expertise, deep neural networks (DNNs) now offer a radically different approach. DNNs implicitly engineer features by transforming their input data into hidden feature vectors called embeddings. For embedding vectors produced by foundation models -- which are trained to be useful across many contexts -- we demonstrate that simple and well-studied dimensionality-reduction techniques such as Principal Component Analysis uncover inherent heterogeneity in input data concordant with human-understandable explanations. Of the many applications for this framework, we find empirical evidence that there is intrinsic separability between real samples and those generated by artificial intelligence (AI).

Vargas, Max [Pacific Northwest National Laboratory↗
DOE OSTI2020

Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems

In this work, we present Lift & Learn, a physics-informed method for learning low-dimensional models for large-scale dynamical systems. The method exploits knowledge of a system’s governing equations to identify a coordinate transformation in which the system dynamics have quadratic structure. This transformation is called a lifting map because it often adds auxiliary variables to the system state. The lifting map is applied to data obtained by evaluating a model for the original nonlinear system. This lifted data is projected onto its leading principal components, and low-dimensional linear and quadratic matrix operators are fit to the lifted reduced data using a least-squares operator inference procedure. Analysis of our method shows that the Lift & Learn models are able to capture the system physics in the lifted coordinates at least as accurately as traditional intrusive model reduction approaches. This preservation of system physics makes the Lift & Learn models robust to changes in inputs. Numerical experiments on the FitzHugh–Nagumo neuron activation model and the compressible Euler equations demonstrate the generalizability of our model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Transformer Health Monitoring via Synchrophasors

Traditional transformer protection schemes such as differential protection operate once the transformer is in a critical state. Proactive means of transformer health evaluation such as Sweep Frequency Response Analysis, can only be performed periodically with the transformer out-of-service. This work presents a framework where the health and structural integrity of transformers is monitored via synchrophasors in real-time. Synchrophasors and subspace estimation techniques are used to build reduced-order models which are then analyzed across multiple domains. A diagnostics algorithm is developed and tested via Matlab simulations. Test results are promising, opening up new prospects in transformer protection research.

cyber-physical security↗
DOE OSTI2020

Competing Interactions between Mesoscale Length-Scales, Order-Disorder, and Martensitic Transformation in Ferromagnetic Shape Memory Alloys

In the present study, the effects of composition and heat treatments and the resulting microstructural changes on the martensitic transformation and ferromagnetic transition have been investigated in NiCoMnIn metamagnetic shape memory alloys. In this shape memory alloy system, it is observed that upon heat treatments at a wide temperature range, the onset temperature of the martensitic transformation follows a non-monotonic behavior with respect to heat treatment time, and the nature of the non-monotonic behavior is also a function of composition. This behavior cannot be attributed to well-known factors such as precipitation, change in local composition due to the precipitation and/or global degree of order. In this work, a systematic investigation through synthesis, thermal processing and characterization via thermo-physical measurements, transmission electron microscopy and in-situ synchrotron x-ray diffraction experiments has been used to correlate the non-monotonic dependence of the martensitic transformation and ferromagnetic transition temperatures to the evolution of L2 1 domains arising from a order/disorder phase transition. A thermodynamic model for the magneto-structural transition is combined with classical nucleation theory to further ascertain the role of microstructural length-scales on the onset of the martensitic transformation. This work thus provides understanding of the thermodynamic and kinetic factors that can be controlled to tune the coupled magneto-structural transformations in NiCoMnIn metamagnetic shape memory alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Koopman Operators for Generalized Persistence of Excitation Conditions for Nonlinear Systems

It is hard to identify nonlinear biological models strictly from data, with results that are often sensitive to experimental conditions. Automated experimental workflows and liquid handling enables unprecedented throughput, as well as the capacity to generate extremely large datasets. We seek to develop generalized identifiability conditions for informing the design of automated experiments to discover predictive nonlinear biological models. For linear systems, identifiability is characterized by persistence of excitation conditions. For nonlinear systems, no such persistence of excitation conditions exist. We use the input-Koopman operator method to model nonlinear systems and derive identifiability conditions for openloop systems initialized from a single initial condition. We show that nonlinear identifiability is intrinsically tied to the rank of a given dataset’s power spectral density, transformed through the lifted Koopman observable space. We illustrate these identifiability conditions with a simulated synthetic gene circuit model, the repressilator. We illustrate how rank degeneracy in datasets results in overfitted nonlinear models of the repressilator, resulting in poor predictive accuracy. Our findings provide novel experimental design criteria for discovery of globally predictive nonlinear models of biological phenomena.

Boddupalli, Nibodh↗
DOE OSTI2025

Wave-Optics Simulation Framework of Fourier Transform Holography with XMCD

We present a wave-optics simulation framework, implemented within the SRW, for modeling FTH with XMCD contrast. The framework propagates coherent, circularly polarized X-ray wavefronts from an undulator source through the sample and optics to the detector, reconstructing real-space images from the resulting holograms. Three principal extensions are introduced: (i) incorporation of polarization-dependent refractive indices in the sample plane, enabling direct simulation of XMCD contrast, (ii) a memory-efficient wavefront-splitting propagation scheme that treats individual apertures independently and coherently combines their fields at detector, and (iii) an integrated reconstruction module that delivers holographic images within the same framework. Together, these advances establish a versatile tool for quantitative exploration of coherence, aperture geometry, and detector sampling, and for the design and interpretation of XMCD-FTH experiments at synchrotron beamlines.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

Fault isolation and fault-tolerant control for Takagi-Sugeno fuzzy time-varying delay stochastic distribution systems

A fault isolation, estimation, and fault-tolerant control (FTC) scheme for nonlinear time-varying delay stochastic distribution control systems was presented in this paper. The Takagi-Sugeno fuzzy model was adopted to approach the nonlinear dynamics of time-varying delay systems. According to the output equivalence principle and Laplace transformation, an augmented state vector was given to solve the time-varying delay problem. When multiple actuator faults and interference occur simultaneously, fault detection, isolation and fault estimation was designed to obtained the fault information. To decouple faults and obtain the value and location information of the fault, the system was separated into two parts through the designed multiple conversion matrices, in which one subsystem was only affected by one actuator fault. This has simplified the design of fault isolation and estimation. A adaptive observer for fault estimation was given. Then, fault information such as the time, location, and size was determined. The observer gain matrices were calculated using linear matrix inequality (LMI). When a fault was detected and diagnosed, a FTC algorithm was devised using the proportional-integral control scheme to compensate the fault as much as possible. It has been shown that even if multiple faults actuator occurred simultaneously, the FTC controller still ensured the output probability density function of the system traced the desired probability density function when a fault occurred. Finally, the expected results were obtained through the simulation example, which confirmed the effectiveness of the method.

42 ENGINEERING↗
DOE OSTI2025

Pd–Methyl Bond Energy─Property Correlations, Noncorrelations, Machine Learning Models, and Application to Polymerization Catalysis

Metal–carbon bonds are a key intermediate in a variety of homogeneous organometallic transformations and often determine the critical thermodynamics and kinetics of catalytic processes. Surprisingly, the influence of different ligands on metal–carbon bond strengths has been largely overlooked. Here, in this study, we evaluated nearly 700 experimental Pd–methyl complexes by calculating their bond dissociation energies using density functional theory (DFT) and compared these bond strengths to several fundamental molecular properties, and this revealed several surprising correlations and noncorrelations. Most surprising was that several fundamental properties, such as the bond length, bond force constant, and bond electron density, have no correlation with bond strength, despite these correlations often holding for main-group compounds. We were indeed able to identify key ligand-dependent chemical features/descriptors that provided a highly accurate machine learning model and provided insight into the general factors that control the Pd–carbon bond strength, such as radical delocalization and nucleophilicity. Insights gained from the Pd–Me bond energy analysis were then applied to CO migratory insertion steps that are part of copolymerization reactions.

binding energy↗
DOE OSTI2022

Unveiling the Emergent Traits of Chiral Spin Textures in Magnetic Multilayers

Abstract Magnetic skyrmions are topologically wound nanoscale textures of spins whose ambient stability and electrical manipulation in multilayer films have led to an explosion of research activities. While past efforts focused predominantly on isolated skyrmions, recently ensembles of chiral spin textures, consisting of skyrmions and magnetic stripes, are shown to possess rich interactions with potential for device applications. However, several fundamental aspects of chiral spin texture phenomenology remain to be elucidated, including their domain wall (DW) structure, thermodynamic stability, and morphological transitions. Here the evolution of these textural characteristics are unveiled on a tunable multilayer platform—wherein chiral interactions governing spin texture energetics can be widely varied—using a combination of full‐field electron and soft X‐ray microscopies with numerical simulations. With increasing chiral interactions, the emergence of Néel helicity, followed by a marked reduction in domain compressibility, and finally a transformation in the skyrmion formation mechanism are demonstrated. Together with an analytical model, these experiments establish a comprehensive microscopic framework for investigating and tailoring chiral spin texture character in multilayer films.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Investigating the impacts of solid phase extraction on dissolved organic matter optical signatures and the pairing with high‐resolution mass spectrometry data across a freshwater stream network

Abstract Advancing our understanding of dissolved organic matter (DOM) chemistry in aquatic systems necessitates the integration of data streams from multiple analytical platforms. Some measurements require pretreatment with solid phase extraction (SPE), while others are performed directly on whole water samples. Evidence has suggested that SPE will be biased against select DOM fractions, leading to concerns over the ability to establish data linkages across platforms with variable needs for SPE pretreatment, such as those from optical measurements and those that provide high‐resolution molecular information. Here, we directly addressed this concern by assessing the impact of SPE on DOM optical properties through excitation–emission matrices with parallel factor analysis (PARAFAC) for 47 samples across a stream network within a single watershed reflective of variable DOM sources. PARAFAC data was further paired with molecular information obtained by Fourier transform ion cyclotron resonance mass spectrometry (FTICR‐MS). A comparison of PARAFAC models first revealed no systematic qualitative differences in major components between whole water DOM and DOM isolated by SPE (SPE‐DOM); however, quantitative biases against select components were observed. Further linkages with FTICR‐MS data revealed that the molecular fingerprint associated with each PARAFAC component was consistent between the whole water DOM and SPE‐DOM. Our results suggest that bulk scale linkages across these analytical platforms could be inferred irrespective of the observed quantitative biases resulting from SPE for samples within this example watershed. This work represents a key step toward the systematic evaluation of linkages between optical and high‐resolution mass spectrometry datasets in freshwater lotic environments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

On amplitudes and field redefinitions

We derive an off-shell recursion relation for correlators that holds at all loop orders. This allows us to prove how generalized amplitudes transform under generic field redefinitions, starting from an assumed behavior of the one-particle-irreducible effective action. The form of the recursion relation resembles the operation of raising the rank of a tensor by acting with a covariant derivative. This inspires a geometric interpretation, whose features and flaws we investigate.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Good practices for documenting AI-based studies on energy and buildings

Artificial intelligence has transformed building science research over the past decade, with applications spanning energy modeling, energy prediction, HVAC optimization and controls, fault detection, and occupancy modeling. However, many studies lack adequate documentation of datasets, algorithms, training procedures, and validation methods. Building science research faces additional challenges including inconsistent evaluation metrics, limited generalizability across building types, climates, and significant gaps between experimental studies and deployed systems. This communication provides practical guidance for good practices in documenting and publishing AI-based research following established standards from the computer science and machine learning communities. By adopting frameworks such as Datasheets for Datasets, Model Cards, and standardized reproducibility checklists, researchers can ensure their work meets the rigorous documentation standards necessary for reproducible, comparable, and impactful building science research.

Hong, Tianzhen [Lawrence Berkeley National Laborat↗
DOE OSTI2023

A tool and a methodology to use macros for abstracting variations in code for different computational demands

Scientific software used on high-performance computing platforms is in a phase of transformation because of the combined increase in the heterogeneity and complexity of models and hardware platforms. Having separate implementations for different platforms can easily lead to combinatorial explosions; therefore, the computational science community has been looking for mechanisms to express code through abstractions that can be specialized for different platforms. Most existing approaches use template meta-programming in C++, and are, therefore language specific. Here, we have developed a tool that uses customized expansion of macros to mimic some of C++ behavior in other languages. It enables unification of any code variants that may be necessary to run efficiently on different target architectures and different computational environments through use of macros with multiple alternative definitions and ability to arbitrate on definition selection for expansion. Combined with two other tools, a custom runtime, and a user specified recipe translator, our custom macroprocessor becomes a part of an overall performance portability solution that does not depend on any specific programming language. We also use macros as code-shorthand that lets code snippets become building blocks that allow variations in control flow to explore performance options. We demonstrate use of macros in Flash-X, a multiphysics multicomponent code with many Fortran legacy components derived from an earlier community code FLASH.

Heterogenous computing↗
DOE OSTI2022

Power-transfer and fixed-point analysis of sawtooth simulations of a current-carrying stellarator

Power-transfer and fixed-point analysis of previous NIMROD simulations (Roberds et al. , Phys. Plasmas , vol. 23, issue 9, 2016, 092513) improved the understanding of the effect of 3D (non-axisymmetric equilibrium) magnetic fields on sawtooth oscillations in the Compact Toroidal Hybrid (CTH) experiment. Computing the locations of order-1 fixed points, their Greene's residues, and local values for the rotational transform results in a description of CTH sawteeth consistent with Kadomtsev's model. A power-transfer analysis quantifies the distribution of energy among toroidal Fourier modes and their nonlinear interactions. The Lorentz power transfer drives sawtooth growth, and it is unambiguously interpreted as the flow of energy from toroidal mode $n'$ to mode $n$ , catalysed by $\boldsymbol {B}_{n-n'}$ . It has been reported previously that the CTH sawtooth frequency increases with the 3D field strength. This is attributed to an increased growth rate of the internal kink that drives sawtooth oscillations. Here, 3D fields remove energy from the kink, eliminating the possibility that these fields are an additional energy source that drives growth. Instead, 3D fields catalyse energy transfer from large-to-small scales, where magnetic reconnection is stronger. It is proposed that this energy transfer increases the reconnection rate at small scales, which is consistent with the increased growth rate observed at higher 3D field strengths.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Selecting the Optimal Fluorinated Ether Co-Solvent for Lithium Metal Batteries

To guide the selection of a suitable fluorinated ether (FE) co -solvent for lithium metal batteries, it is crucial to understand the relationship between the organic structures of the FEs and the electrochemical performance of an FE-containing electrolyte. In this work, 1,1,2,2-tetrafluoro-1-(2,2,2-trifluoroethoxy)ethane (FEE), 1,1,2,2-tetrafluoro-3-(1,1,2,2-tetrafluoroethoxy)-propane (TTE), and 1,2-bis(1,1,2,2-tetrafluoroethoxy)ethane (OFDEE) were chosen as representative FE co-solvents because of their distinct structural properties. The structure-activity relationship between the FEs and the electrochemical performance of Li||LiNi 0.6 Mn 0.2 Co 0.2 O 2 (Li||NMC622) cells was correlated and quantified by Fourier-transform infrared and multi-dimensional nuclear magnetic resonance techniques. Sand's model was also employed to assess the extent of lithium dendrite formation in the cells using various FE electrolytes. The cycling performance of Li||NMC622 cells using different FE co-solvents follows the order FEE > TTE > OFDEE. Further, since the direct measurement of Sand's time is difficult, we introduced relative Sand's time to probe the diffusion behavior of each electrolyte, and the results showed that the best performance was obtained in the electrolyte with the longest relative Sand's time. Moreover, the lithium metal cell using the electrolyte with FEE co-solvent showed similar capacity retention compared with the baseline electrolyte at room temperature, but it demonstrated significantly improved low-temperature performance. The results indicate that FEE is a promising co-solvent candidate for improving the low-temperature performance of lithium metal batteries because it possesses not only non-solvating behavior but also very low viscosity and non-flammability. The advanced electrolyte LiPF 6 -FEC-DMC-FEE enables very stable cycling of lithium metal batteries at various temperatures.

25 ENERGY STORAGE↗
DOE OSTI2026

Grand Challenges and Opportunities in Stimulated Dynamic and Resonant Catalysis

Traditional heterogeneous catalysis is constrained by kinetic and thermodynamic limits, such as the Sabatier principle and reaction equilibrium. Dynamic and resonant catalysts hold promise to overcome these limitations by actively oscillating a catalyst’s physical or electronic structure at the time scale of the catalytic cycle, allowing programmable control over reaction pathways, and leading to improved rate and selectivity. External stimuli such as temperature swing, mechanical strain, electric charge, and light can perturb catalyst surfaces in different ways, altering adsorbate coverage, binding energies, and transition states beyond what steady-state catalysis allows. This work surveys the current state of dynamic catalysis, introduces the concept of “ stimulando ” characterization for observing transient dynamics, and outlines key modeling, mechanistic, and benchmarking strategies to advance the field toward improved chemical transformation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Metal–organic framework (MOF) materials as polymerization catalysts: a review and recent advances

Synthetic polymers are ubiquitous across both the industrial and consumer segments of the world economy. Catalysts enable rapid, efficient, selective, and even stereoselective, formation of desired polymers from any of a host of candidate monomers. While numerous molecular catalysts have been shown to be effective for these reactions, separation of the catalysts from reaction products is typically difficult – a potentially problematic complication that suggests instead the use of heterogeneous catalysts. Many of the most effective heterogeneous catalysts, however, comprise supported collections of reaction centres that are decidedly nonuniform in their composition, siting, and activity. Nonuniformity complicates atomic-scale evaluation of the basis for catalytic activity and thus impedes scientific hypothesis-driven understanding and development of superior catalysts. In view of the fundamental desirability of structural and chemical uniformity at the meso, nano, and even atomic scale, crystallographically well-defined, high-porosity metal–organic frameworks (MOFs) have attracted attention as model catalysts and/or catalyst-supports for a wide variety of chemical transformations. In the realm of synthetic polymers, catalyst-functionalized MOFs have been studied for reactions ranging from coordination-mediated polymerization of ethylene to visible-light initiated radical polymerizations. Nevertheless, many polymerization reactions remain to be explored – and, no doubt, will be explored, given the remarkable structural and compositional diversity of attainable MOFs. Noteworthy emerging studies include work directed toward more sophisticated catalytic schemes such as polymer templating using MOF pore architectures and tandem copolymerizations using MOF-supported reaction centres. Finally, it is appropriate to recognize that MOFs themselves are synthetic polymers – albeit, uncoventional ones.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Theory and modeling of molecular modes in the NMR relaxation of fluids

Traditional theories of the nuclear magnetic resonance (NMR) autocorrelation function for intra-molecular dipole pairs assume a single-exponential decay, yet the calculated autocorrelation of realistic systems displays a rich, multi-exponential behavior, resulting in anomalous NMR relaxation dispersion (i.e., frequency dependence). We develop an approach to model and interpret the multi-exponential intra-molecular autocorrelation using simple, physical models within a rigorous statistical mechanical development that encompasses both rotational diffusion and translational diffusion in the same framework. Here, we recast the problem of evaluating the autocorrelation in terms of averaging over a diffusion propagator whose evolution is described by a Fokker–Planck equation. The time-independent part admits an eigenfunction expansion, allowing us to write the propagator as a sum over modes. Each mode has a spatial part that depends on the specified eigenfunction and a temporal part that depends on the corresponding eigenvalue (i.e., correlation time) with a simple, exponential decay. The spatial part is a probability distribution of the dipole pair, analogous to the stationary states of a quantum harmonic oscillator. Drawing inspiration from the idea of inherent structures in liquids, we interpret each of the spatial contributions as a specific molecular mode. These modes can be used to model and predict the NMR dipole–dipole relaxation dispersion of fluids by incorporating phenomena on the molecular level. We validate our statistical mechanical description of the distribution in molecular modes with molecular dynamics simulations interpreted without any relaxation models or adjustable parameters: the most important poles in the Padé–Laplace transform of the simulated autocorrelation agree with the eigenvalues predicted by the theory

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗