Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

scPlantAnnotate: an accurate and robust transformer-based model for plant cell type annotation

Accurate cell type annotation remains a major bottleneck in plant single-cell RNA sequencing (scRNA-seq), where existing tools are often adapted from animal studies and perform sub-optimally on plant data. The lack of plant-specific computational frameworks limits the construction of plant cell atlases and downstream biological discovery. We develop and evaluate scPlantAnnotate, a Transformer-based reference annotation framework tailored for plant scRNA-seq data, and benchmark it against state-of-the-art deep learning and conventional methods across multiple plant species. Species-specific scPlantAnnotate models were trained using curated datasets from Arabidopsis thaliana, Zea mays, Oryza sativa, and Glycine max. We compared scPlantAnnotate with leading baselines under both standard random-split evaluation and a more stringent leave-one-dataset-out setting, which tests robustness to completely unseen datasets and tissue types. scPlantAnnotate consistently outperforms existing approaches across all four species under random-split evaluation. In the leave-one-dataset-out setting for A. thaliana, where performance drops markedly for all methods due to strong batch effects and dataset heterogeneity, scPlantAnnotate nonetheless achieves the highest Accuracy, Macro-F1, Balanced Accuracy, and Macro-AUROC on average and ranks first on most held-out datasets. These results demonstrate improved robustness to dataset shifts, a critical yet underexplored challenge in plant scRNA-seq analysis. A freely accessible web server enables users to annotate their own datasets using pretrained models. scPlantAnnotate provides a plant-specific, Transformer-based framework for single-cell annotation that delivers state-of-the-art performance and enhanced robustness to unseen datasets. By addressing limitations of existing tools and enabling scalable reference-based annotation, scPlantAnnotate supports the development of comprehensive plant cell atlases and facilitates broader use of single-cell genomics in plant biology.

Bioinformatics↗

Hidden transformations in entropy-stabilized oxides

We report entropy-stabilized oxides (ESO) display a reversible entropy-driven phase transformation that can be leveraged to produce a continuum of metastable phase states, allowing for property optimization and novel functionalities. X-ray absorption spectroscopy reveals that entropic stabilization extends to the electronic structure (valence state and cation coordination) in sintered (Co,Cu,Mg,Ni,Zn)O, manifesting as a tunable lattice distortion in the entropy-stabilized phase. Co, Cu, and Zn ions reversibly transform from six-fold to four-fold coordinated structures and from low to high valence states due to the competition between electronic structures that are equilibrium and enthalpy-driven or metastable and entropy-driven. The segregation of a Cu-rich tenorite phase and a Co-rich spinel phase influences the electronic structure evolution. ESOs can adjust their electronic structures through heat treatment, providing a powerful tool for developing functional properties. These results indicate that the definition of entropy stabilization should include entropy-stabilized electronic structures, providing motivation to reassess previously studied HEO materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Systematic and statistical uncertainties of the hilbert-transform based high-precision FID frequency extraction method

Pulsed nuclear magnetic resonance (NMR) is widely used in high-precision magnetic field measurements. The absolute value of the magnetic field is determined from the precession frequency of nuclear magnetic moments. The Hilbert transform is widely used to extract the phase function from the observed free induction decay (FID) signal and then its frequency. In this paper, a detailed implementation of a Hilbert-transform based FID frequency extraction method is described. How artifacts and noise level in the FID signal affect the extracted phase function are derived analytically. A method of mitigating the artifacts in the extracted phase function of an FID is discussed. Correlations between noises of the phase function samples are studied for different noise spectra. We discovered that the error covariance matrix for the extracted phase function is nearly singular and improper for constructing the $\chi^2$ used in the fitting routine. A down-sampling method for fixing the singular covariance matrix has been developed, so that the minimum $\chi^2$-fit yields properly the statistical uncertainty of the extracted frequency. Other practical methods of obtaining the statistical uncertainty are also discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Strain rate sensitivity, microstructure variations, and stress-assisted β → α" phase transformation investigation on the mechanical behavior of dual-phase titanium alloys

In this study, the microstructures of three widely used dual-phase titanium alloys: Ti-6Al-4V, Ti-6Al-2Sn-4Zr-2Mo, and Ti-6Al-2Sn-4Zr-6Mo are characterized using backscatter electron imaging and the deformation behaviors in their individual α and β phases are investigated using in situ high-energy X-ray diffraction during uniaxial tension experiments. This is accompanied by calculation of the strain rate sensitivity (SRS) in these alloys, as a function of applied loading. The results of the calculated SRS and the mechanical response (in terms of lattice strains and hardening behaviors) are rationalized based on the local microstructure, composition, and texture of the alloy. A stress-induced β (BCC) to α" (orthorhombic) phase transformation is observed during the in-situ diffraction experiment, which permitted analysis of the lattice strain evolution during the phase transformation. Results from this study provide insights into the relationship between microstructure, composition, applied loading, and the deformation behavior, including effects on loading with time holds. Specifically, the results show that the microstructure, and not necessarily the chemical composition (Mo content), along with the applied loading have a dominant role in the observed SRS variation in titanium alloys. Further, the evolution of the α" (orthorhombic) phase is observed for the first time during deformation of an industrially relevant titanium alloy, Ti-6246.

36 MATERIALS SCIENCE↗

Underlying mechanism of structural transformation between GaSb and GaAs response to intense electronic excitation

Ion irradiation of semiconductors has emerged as a promising approach for fabricating self-organized nanosystems with high atomic precision, despite often being accompanied by undesirable phenomena. Exploring the mechanisms underlying structural transformations is crucial for assessing nanostructure array types under complex irradiation environments. By quantitatively calculating the thermodynamically driven processes and analyzing the impact of intrinsic structural parameters, distinct structural transformations in response to intense electronic excitation are systematically investigated in gallium antimonide (GaSb) and gallium arsenide (GaAs) systems. In high-energy regimes, the nanofibers layer of GaSb exhibits intriguing structural discrepancy, characterized by partial nanofibers with coherent boundaries, interspersed nanopores accompanied by antisite defects and Ga precipitates, distinguishing to a series of discontinuous latent tracks that emerged within cylindrical trajectories in GaAs. Furthermore, significant diffusion behaviors of the nanohillocks are discovered in GaAs, with higher average roughness than GaSb, driven by the gradient stress distribution influenced by the free-surface effects. The deposition energy for melting phase formation, Gibbs free energy, and Ga diffusion coefficients contribute to the distinctive structural features, evidencing relatively stable morphological configurations and higher irradiation resistance in GaAs. Consequently, special optoelectronic properties associated with structural discrepancies facilitate the design and optimization of material functionalities by irradiation technologies.

36 MATERIALS SCIENCE↗

In-situ neutron diffraction investigation of two-stage martensitic transformation in a 13%Mn steel with serrated deformation

Two stage austenite →ε-martensite →α-martensite phase transformation, phase-specific lattice strain evolution and load sharing during tensile deformation of a 13%Mn hot-rolled austenitic steel are revealed by in-situ neutron diffraction. In conclusion, direct evidence is provided that serrated deformation behavior is attributed to discontinuous martensitic transformation.

Austenitic steel↗

The effects of Fe and Al on the phase transformations and mechanical behavior of β-Ti alloy Ti-11at.%Cr

Alloy composition is important for developing desired microstructures in beta-titanium (β-Ti) alloys during thermomechanical processing. In this work, the relatively low-cost alloying elements iron (Fe) and aluminum (Al) were added to a base Ti-11at%chromium (Cr) alloy and in-situ and ex-situ examination of the microstructural evolution and mechanical properties during tension, hardness, elevated temperature X-ray diffraction (XRD) and resonance ultrasound spectroscopy (RUS) were performed. The 400 °C XRD revealed that Ti-11at%Cr underwent β-to-ω and β-to-α transformations. Adding 0.85at% Fe reduced the volume fraction of the ω- and α-phases, and adding 5.3at% Al inhibited the β-to-ω transformation. The 400 °C RUS showed that the alloys containing the ω phase exhibited an increase in shear modulus (G) of ~140%, while the ω-free alloys exhibited an increase of only ~102%. The hardness and strength values of the ω-containing Ti-11Cr and Ti-11Cr-0.85Fe increased with increased ω-phase volume fraction when the ω/α ratio was greater than 0.25. The relationship between ω/α volume ratios and mechanical properties is discussed.

36 MATERIALS SCIENCE↗

TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformers

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various applications. Such temporal graphs exhibit heterogeneous transient dynamics, varying time intervals, and highly evolving node features throughout their evolution. Hence, incorporating long-range dependencies from the historical graph context plays a crucial role in accurately learning their temporal dynamics. In this paper, we develop a graph embedding model with uncertainty quantification, TransformerG2G, by exploiting the advanced transformer encoder to first learn intermediate node representations from its current state (t) and previous context (over timestamps [t–1,t–l], l is the length of context). Moreover, we employ two projection layers to generate lower-dimensional multivariate Gaussian distributions as each node's latent embedding at timestamp t. We consider diverse benchmarks with varying levels of "novelty" as measured by the TEA (Temporal Edge Appearance) plots. Here, our experiments demonstrate that the proposed TransformerG2G model outperforms conventional multi-step methods and our prior work (DynG2G) in terms of both link prediction accuracy and computational efficiency, especially for high degree of novelty. Furthermore, the learned time-dependent attention weights across multiple graph snapshots reveal the development of an automatic adaptive time stepping enabled by the transformer. Importantly, by examining the attention weights, we can uncover temporal dependencies, identify influential elements, and gain insights into the complex interactions within the graph structure. For example, we identified a strong correlation between attention weights and node degree at the various stages of the graph topology evolution.

97 MATHEMATICS AND COMPUTING↗

Transformational faulting in Mn 2 GeO 4 from olivine to wadsleyite structure: Implications for physical mechanism of deep-focus earthquakes

High-pressure and temperature deformation experiments interfaced with acoustic emission (AE) monitoring have been conducted to study transformational faulting in Mn 2 GeO 4 olivine, which transforms to the β phase, isostructural to wadsleyite. Metastable Mn 2 GeO 4 olivine exhibits a marked embrittlement behavior at temperatures between 800 and 1100 K, emitting numerous AEs. At each temperature, brittle deformation is characterized by a two-stage process: (1) a “preparation” stage with numerous diffusedly located low-magnitude AEs and large b values (>2), and (2) a failure stage where larger-magnitude AEs form a planar distribution with b values about 1. Microstructure analysis reveals extensive kink band development in olivine grains in the recovered samples. Kink band boundaries (KBBs), with a typical thickness of ∼100 nm, are filled with a nanometric β-Mn 2 GeO 4 “gouge”. A dense array of secondary shear localizations is often present within the kink bands, suggesting significant shear deformation therein. The combined observations suggest that faulting in metastable Mn 2 GeO 4 olivine is a self-similar process, from grain-scale to the sample-scale. Both observed embrittlement behavior and the microstructure of metastable Mn 2 GeO 4 olivine are essentially identical to those in Mg 2 GeO 4 olivine we have reported previously, indicating that the physical mechanism of faulting in metastable olivine is insensitive to the specific crystallographic structure of the high-pressure phase. The low b values (about 1) observed in the faulting process in our experiments are similar to those of deep focus earthquakes in cold subduction zones. Our observed mechanism explains deep focus seismicity in cold metastable mantle wedges, provided that the self-similarity assumption holds to geological scales.

58 GEOSCIENCES↗

Self-Assembled Periodic Nanostructures Using Martensitic Phase Transformations

We describe a novel approach for the rational design and synthesis of self-assembled periodic nanostructures using martensitic phase transformations. We demonstrate this approach in a thin film of perovskite SrSnO 3 with reconfigurable periodic nanostructures consisting of regularly spaced regions of sharply contrasted dielectric properties. The films can be designed to have different periodicities and relative phase fractions via chemical doping or strain engineering. The dielectric contrast within a single film can be tuned using temperature and laser wavelength, effectively creating a variable photonic crystal. Our results show the realistic possibility of designing large-area self-assembled periodic structures using martensitic phase transformations with the potential of implementing "built-to-order" nanostructures for tailored optoelectronic functionalities.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Exsolution-Driven Surface Transformation in the Host Oxide

Exsolution synthesizes self-assembled metal nanoparticle catalysts via phase precipitation. An overlooked aspect in this method thus far is how exsolution affects the host oxide surface chemistry and structure. Such information is critical as the oxide itself can also contribute to the overall catalytic activity. Here, combining X-ray and electron probes, we investigated the surface transformation of thin-film SrTi 0.65 Fe 0.35 O 3 during Fe 0 exsolution. We found that exsolution generates a highly Fe-deficient near-surface layer of about 2 nm thick. Moreover, the originally single-crystalline oxide near-surface region became partially polycrystalline after exsolution. Such drastic transformations at the surface of the oxide are important because the exsolution-induced nonstoichiometry and grain boundaries can alter the oxide ion transport and oxygen exchange kinetics and, hence, the catalytic activity toward water splitting or hydrogen oxidation reactions. These findings highlight the need to consider the exsolved oxide surface, in addition to the metal nanoparticles, in designing the exsolved nanocatalysts.

36 MATERIALS SCIENCE↗

Theoretical Insights into Reaction-Induced Transformation and Tuning of Catalytic Behavior in Heterogenous Catalysis

Reaction-induced transformations in heterogenous catalysis represent diverse phenomena that challenge traditional views of static catalyst surfaces. From surface adsorbate dynamics, atomic rearrangements, to composition and phase transitions, these processes reveal the profound differences between idealized model systems under ultrahigh vacuum and the complex, evolving interfaces that govern real catalytic behaviors under reaction conditions. Here, this perspective reviews recent theoretical efforts to provide atomic-level mechanistic insights into significant reaction-induced transformations and their impact on catalytic activity and selectivity. It underscores the need for an integrated framework that combines predictive simulations with operando characterization to uncover active sites and mechanisms under realistic operating conditions. Achieving this requires accelerating existing simulations to fully capture diverse reaction-induced surface dynamics, enabling scalable and accurate modeling of catalysts as condition-dependent, dynamically evolving systems. Such approaches are critical to bridge the gap between theory and practice, offering a pathway to more impactful and predictive catalyst design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Real-Time In Situ Observation of CsPbBr 3 Perovskite Nanoplatelets Transforming into Nanosheets

The manipulation of nano-objects through heating is an effective strategy for inducing structural modifications and therefore changing the optoelectronic properties of semiconducting materials. Despite its potential, the underlying mechanism of the structural transformations remains elusive, largely due to the challenges associated with their in situ observations. To address these issues, we synthesize temperature-sensitive CsPbBr 3 perovskite nanoplatelets and investigate their structural evolution at the nanoscale using in situ heating transmission electron microscopy. We observe the morphological changes that start from the self-assembly of the nanoplatelets into ribbons on a substrate. We identify several paths of merging nanoplates within ribbons that ultimately lead to the formation of nanosheets dispersed randomly on the substrate. These observations are supported by molecular dynamics simulations. We correlate the various paths for merging to the random orientation of the initial ribbons along with the ligand mobility (especially from the edges of the nanoplatelets). This leads to the preferential growth of individual nanosheets and the merging of neighboring ones. These processes enable the creation of structures with tunable emission, ranging from blue to green, all from a single material. Our real-time observations of the transformation of perovskite 2D nanocrystals reveal a route to achieve large-area nanosheets by controlling the initial orientation of the self-assembled objects with potential for large-scale applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Pressure induced irreversible phase transformation in an ordered high-entropy alloy

We report on a pressure induced irreversible phase transformation in an ordered eutectic high-entropy alloy (EHEA) AlCoCrFeNi2.1. The suction cast sample was synthesized by arc melting of raw elements resulting in an ordered B2 and FCC phase mixture for eutectic AlCoCrFeNi2.1 alloy. This phase mixture was confirmed by transmission electron microscopy (TEM) where superlattice reflections corresponding to ordered B2 phase were observed while the FCC phase remains disordered. The B2 phase was observed to be enriched in Nickel and Aluminum while the surrounding FCC phase is enriched in Fe, Cr and Co. The suction-cast EHEA sample was studied by X-ray diffraction under high pressure in a diamond anvil cell with platinum pressure marker to 73 GPa at ambient temperature. The B2 to FCC phase transformation is completed by 3 GPa in sharp contrast to BCC to FCC phase transition of 21 GPa in additively manufactured EHEA samples. The X-ray diffraction and TEM studies of pressure recovered samples show presence of only FCC grains without any specific orientation with respect to starting sample. These results are consistent with molecular dynamics simulations that the presence of B2 phase aids in the formation of the B2 to FCC phase transition under high pressures.

36 MATERIALS SCIENCE↗

Origin for electrochemically driven phase transformation in the oxygen electrode for a solid oxide cell

The next generation of fuel cells, electrolyzers, and batteries requires higher power, faster kinetics, and larger energy density, which necessitate the use of compositionally complex oxides to achieve multifunctionalities and activity. These compositionally complex oxides may change their phases and structures during an electrochemical process—a so-called “electrochemically driven phase transformation.” The origin for such a phase change has remained obscure. The aim of this paper is to present an experimental study and a theoretical analysis of phase evolution in praseodymium nickelates. Nickelate-based electrodes show up to 60 times greater phase transformation during operation when compared with thermally annealed ones. Theoretical analysis suggests that the presence of a reduced oxygen partial pressure at the interface between the oxygen electrode and the electrolyte is the origin for the phase change in an oxygen electrode. Guided by the theory, the addition of the electronic conduction in the interface layer leads to the significant suppression of phase change while improving cell performance and performance stability.

25 ENERGY STORAGE↗

A Monte Carlo Laplace Transform Estimator for Radiation Transport

This work formulates and implements a Laplace transform estimator in a simple Monte Carlo radiation transport code. The estimator maps flux-based quantities of interest, like reaction rates, from a desired phase-space dimension to the complex Laplace domain. This on-the-fly Monte Carlo integration technique enables the spectral analysis of arbitrary nuclear systems via the Laplace transform. A simple code tests the estimator in neutron slowing-down problems across various infinite media, and the results compare well with Ganapol’s uninverted analytical solution of the neutron slowing-down equation.

97 MATHEMATICS AND COMPUTING↗

Transformer coupled toroidal wave-heated remote plasma sources operating in Ar/NF 3 mixtures

Remote plasmas are used in semiconductor device manufacturing as sources of radicals for chamber cleaning and isotropic etching. In these applications, large fluxes of neutral radicals (e.g. F, O, Cl, H) are desired with there being negligible fluxes of potentially damaging ions and photons. One remote plasma source (RPS) design employs toroidal, transformer coupling using ferrite cores to dissociate high flows of moderately high pressure (up to several Torr) electronegative gases. In this paper, results are discussed from a computational investigation of moderate pressure, toroidal transformer coupled RPS sustained in Ar and Ar/NF 3 mixtures. Operation of the RPS in 1 Torr (133 Pa) of argon with a power of 1.0 kW at 0.5 MHz and a single core produces a continuous toroidal plasma loop with current continuity being maintained dominantly by conduction current. Operation with dual cores introduces azimuthal asymmetries with local maxima in plasma density. Current continuity is maintained by a mix of conduction and displacement current. Operation in NF 3 for the same conditions produces essentially complete NF 3 dissociation. Electron depletion as a result of dissociative attachment of NF 3 and NF x fragments significantly alters the discharge topology, confining the electron density to the downstream portion of the source where the NFx density has been lowered by this dissociation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Faster Johnson–Lindenstrauss transforms via Kronecker products

The Kronecker product is an important matrix operation with a wide range of applications in signal processing, graph theory, quantum computing and deep learning. In this work, we introduce a generalization of the fast Johnson–Lindenstrauss projection for embedding vectors with Kronecker product structure, the Kronecker fast Johnson–Lindenstrauss transform (KFJLT). The KFJLT reduces the embedding cost by an exponential factor of the standard fast Johnson–Lindenstrauss transform’s cost when applied to vectors with Kronecker structure, by avoiding explicitly forming the full Kronecker products. Here, we prove that this computational gain comes with only a small price in embedding power: consider a finite set of $p$ points in a tensor product of $d$ constituent Euclidean spaces $\bigotimes _{k=d}^{1}{\mathbb{R}}^{n_k}$, and let $N = \prod _{k=1}^{d}n_k$. With high probability, a random KFJLT matrix of dimension $m \times N$ embeds the set of points up to multiplicative distortion $(1\pm \varepsilon )$ provided $m \gtrsim \varepsilon ^{-2} \, \log ^{2d - 1} (p) \, \log N$. We conclude by describing a direct application of the KFJLT to the efficient solution of large-scale Kronecker-structured least squares problems for fitting the CP tensor decomposition.

Kronecker structure↗