Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Origin of enhanced performance when Mn-rich rocksalt cathodes transform to δ -DRX

Most Mn-rich cathodes are known to undergo phase transformation into structures resembling spinel-like ordering upon electrochemical cycling. Recently, the irreversible transformation of Ti-containing Mn-rich disordered rock-salt cathodes into a phase — named δ — with nanoscale spinel-like domains has been shown to increase energy density, capacity retention, and rate capability. However, the nature of the boundaries between domains and their relationship with composition and electrochemistry are not well understood. In this work, we discuss how the transformation into the multi-domain structure results in eight variants of Spinel domains, which is crucial for explaining the nanoscale domain formation in the δ -phase. We study the energetics of crystallographically unique boundaries and the possibility of Li-percolation across them with a fine-tuned CHGNet machine learning interatomic potential. Energetics of 16 d vacancies reveal a strong affinity to segregate to the boundaries, thereby opening Li-pathways at the boundary to enhance long-range Li-percolation in the δ structure. Defect calculations of the relatively low-mobility Ti show how it can influence the extent of Spinel ordering, domain morphology and size significantly; leading to guidelines for engineering electrochemical performance through changes in composition.

Anand, Shashwat

Jordan–Wigner Transformation for the Description of Strong Correlation in Fermionic Systems

Seniority is a useful way of organizing Hilbert space for strongly correlated systems. The exact zero-seniority wave function, doubly occupied configuration interaction (DOCI), provides accurate results (given the right orbitals) for many strongly correlated electronic systems but has a combinatorial computational cost. In many cases, pair coupled cluster doubles provide a polynomial-cost approximation that closely reproduces the energies of DOCI, but it breaks down in some cases and, as shown herein, it does not provide particularly good density matrices. In this article, we demonstrate that by using the Jordan–Wigner transformation to turn the seniority zero problem back into a Fermionic one, we can provide mean-field variational results of DOCI quality for the Hubbard model and a few small molecular dissociation examples, with polynomial cost, both for the energies and for density matrices, all while being protected from collapse. This success is rooted in the proof we provide, showing that the Hartree–Fock wave function on the Jordan–Wigner-transformed Hamiltonian transforms back to variational coupled cluster doubles in the seniority zero representation, but restricted to have determinant rather than permanent amplitude coefficients, without compromising its overall accuracy.

74 ATOMIC AND MOLECULAR PHYSICS

Severe Strain‐Induced Olivine‐Ringwoodite Transformation at Room Temperature: Key to Enigmas of Deep‐Focus Earthquake

Deep‐focus earthquakes at 350–660 km are presumably caused by olivine‐spinel phase transformation (PT). This cannot, however, explain the observed high seismic strain rate, which requires PT to complete within seconds, while metastable olivine does not transform for over a million years. Recent theory quantitatively describes how severe plastic deformations (SPD) can solve this dilemma but lacking experimental proof. Here, we introduce dynamic rotational diamond anvil cell with rough diamond anvils to impose SPD on San Carlos olivine. While olivine never transformed to spinel at room temperature, we obtained reversible olivine‐ringwoodite PT under SPD at 15–28 GPa within tens of seconds. The PT pressure reduces with increasing dislocation density, microstrain, plastic strain, and decreasing crystallite size. Results demonstrate a new strain‐induced PT mechanism compared to a pressure/temperature‐induced one. Combined with SPD during olivine subduction, this mechanism can accelerate olivine‐ringwoodite PT from millions of years to timescales relevant to earthquakes.

Lin, F. [Iowa State Univ., Ames, IA (United States

Dual‐Transformer Deep Learning Framework for Seasonal Forecasting of Great Lakes Water Levels

Abstract The Great Lakes of North America form one of the largest freshwater systems on Earth, and their lake‐wide average water levels (lake levels) can fluctuate by more than 0.5 m on a seasonal scale. These fluctuations pose substantial challenges for coastal resilience, flood risk management, and navigation planning. Accurate seasonal forecasting of lake levels using traditional mechanistic models is challenging due to the complex physical mechanisms and coupled hydroclimatic processes involved. Recently, deep learning has gained prominence in geoscience applications for its ability to recognize intricate patterns within multiphysical data sets. Here, we introduce a novel Dual‐Transformer deep learning framework, tested on the Great Lakes. This architecture integrates two modified Transformer models: the Prophet, which predicts underlying trends, and the Critic, which refines the Prophet's predictions. The final lake level prediction is derived by weighting the outputs of both models through a multi‐layer perceptron, jointly trained with the Prophet and Critic to enhance overall accuracy. Our results demonstrate that the innovative learning framework achieves the highest prediction accuracy compared to established deep learning models when using identical input features. It attains a root mean square error of 4–7 cm in predicting lake levels up to 6 months in advance across the lakes. Additionally, the Dual‐Transformer model runs six orders of magnitude faster than conventional mechanistic models, producing results in less than one second on a typical personal computer. These findings suggest that our deep learning framework has strong potential to advance lake level prediction and carries important implications for water management and disaster mitigation, thereby enhancing the quality of life in coastal regions.

Chen, Yi [Great Lakes Research Center Michigan Tec

Subpolar North Atlantic Water Mass Transformation and Overturning in Eddying and Non‐Eddying Simulations

Buoyancy forcing in the subpolar North Atlantic Ocean (SPNA) is an important driver of the Atlantic Meridional Overturning Circulation (AMOC). To advance understanding of the mechanisms connecting the two processes and their relative importance in sub-basins within the SPNA, we apply the Water Mass Transformation Framework to a matched-pair of forced, ocean-sea ice simulations configured at eddying and non-eddying resolution. Within the first decade of simulation, the non-eddying simulation produces a weak AMOC, ~11 Sv at 26.5 ° N, while the AMOC in the eddying simulation is more realistic and is thus analyzed for comparison. Surface water mass transformation and boundary transport are calculated in both density and temperature–salinity coordinates in three separate deep water formation regions, the Iceland Basin, the Irminger Sea and Labrador Sea, during the first decade of both simulations. We identify strong surface freshening in the Irminger and Labrador seas in the non-eddying simulation during the AMOC decline. This freshening significantly reduces the density of the surface outcrops where surface water mass formation occurs, essentially removing this contribution to deep water formation. Concurrently, boundary transports in these two regions are warmer and saltier in the non-eddying simulation compared to the eddying simulation where the density of surface water mass formation is stable. The warming and salinification of boundary transports in the non-eddying simulation is interpreted as an obstacle to deep water formation. Labrador Sea surface water mass transformation is important, despite its small contribution to buoyancy overturning.

54 ENVIRONMENTAL SCIENCES

Binary vector copy number engineering improves Agrobacterium -mediated transformation

The copy number of a plasmid is linked to its functionality, yet there have been few attempts to optimize higher-copy-number mutants for use across diverse origins of replication in different hosts. We use a high-throughput growth-coupled selection assay and a directed evolution approach to rapidly identify origin of replication mutations that influence copy number and screen for mutants that improve Agrobacterium-mediated transformation (AMT) efficiency. By introducing these mutations into binary vectors within the plasmid backbone used for AMT, we observe improved transient transformation of Nicotiana benthamiana in four diverse tested origins (pVS1, RK2, pSa and BBR1). For the best-performing origin, pVS1, we isolate higher-copy-number variants that increase stable transformation efficiencies by 60–100% in Arabidopsis thaliana and 390% in the oleaginous yeast Rhodosporidium toruloides. Our work provides an easily deployable framework to generate plasmid copy number variants that will enable greater precision in prokaryotic genetic engineering, in addition to improving AMT efficiency.

59 BASIC BIOLOGICAL SCIENCES

Formation and transformation of iron oxy-hydroxide precursor clusters to ferrihydrite

Iron (Fe) oxy-hydroxide minerals such as ferrihydrite (Fh) are ubiquitous in Earth-surface environments and important in biogeochemical element cycling. Recent research has suggested that their formation is preceded by the precipitation of ultrasmall (~1 nm) Keggin-like Fe oxy-hydroxide clusters. However, relatively little is understood about the structure of the precursor clusters and the impacts of pH and time on their growth and transformation to more stable phases. Here, we used a new method that involves mixed flow reactors (MFR) to synthesize these Fe oxy-hydroxide precursor clusters at pH 1.0, 1.5, 2.5, and 4.5. In situ and ex situ synchrotron scattering measurements and laboratory small-angle X-ray scattering (SAXS) were used to study the structure and size of Fe oxy-hydroxide clusters and their transformation products, respectively. Results show that with increasing pH, the particle size and structural order of samples increase, forming solids that resemble 2-line Fh at pH 4.5. The experimental data were compared with X-ray pair distribution functions (PDF) calculated for a range of Fe(III) oxyhydroxide clusters, including Fe 13 Keggin isomers computed previously using density functional theory (DFT), which yielded at best only partial agreement at short range (<5 Å). Aging of the clusters synthesized at pH 1.5 and 2.5 results in growth and transformation via Ostwald ripening to mixtures of goethite (Gt) and lepidocrocite (Lp). This process was inhibited by immediately reacting the early-formed clusters with phosphate (PO 4 3– ), suggesting that oxyanion surface complexes can stabilize the initial clusters by preventing growth and crystallization to more stable phases.

58 GEOSCIENCES

ATAT: Astronomical Transformer for time series and Tabular data

Context. The advent of next-generation survey instruments, such as theVera C. RubinObservatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. Aims. Our aim is to develop a next-generation model for the classification of variable astronomical objects. We describe ATAT, the Astronomical Transformer for time series And Tabular data, a classification model conceived by the ALeRCE alert broker to classify light curves from next-generation alert streams. ATAT was tested in production during the first round of the ELAsTiCC campaigns. Methods. ATAT consists of two transformer models that encode light curves and features using novel time modulation and quantile feature tokenizer mechanisms, respectively. ATAT was trained on different combinations of light curves, metadata, and features calculated over the light curves. We compare ATAT against the current ALeRCE classifier, a balanced hierarchical random forest (BHRF) trained on human-engineered features derived from light curves and metadata. Results. When trained on light curves and metadata, ATAT achieves a macro F1 score of 82.9 ± 0.4 in 20 classes, outperforming the BHRF model trained on 429 features, which achieves a macro F1 score of 79.4 ± 0.1. Conclusions. The use of transformer multimodal architectures, combining light curves and tabular data, opens new possibilities for classifying alerts from a new generation of large etendue telescopes, such as theVera C. RubinObservatory, in real-world brokering scenarios.

Astronomy & Astrophysics

Measurement bias in self-heating x-ray free electron laser experiments from diffraction studies of phase transformation in titanium

X-ray self-heating is a common by-product of X-ray Free Electron Laser (XFEL) techniques that can affect targets, optics, and other irradiated materials. Diagnosis of heating and induced changes in samples may be performed using the x-ray beam itself as a probe. However, the relationship between conditions created by and inferred from x-ray irradiation is unclear and may be highly dependent on the material system under consideration. Here, we report on a simple case study of a titanium foil irradiated, heated, and probed by a MHz XFEL pulse train at 18.1 keV delivered by the European XFEL using measured x-ray diffraction to determine temperature and finite element analysis to interpret the experimental data. We find a complex relationship between apparent temperatures and sample temperature distributions that must be accounted for to adequately interpret the data, including beam averaging effects, multivalued temperatures due to sample phase transitions, and jumps and gaps in the observable temperature near phase transformations. The results have implications for studies employing x-ray probing of systems with large temperature gradients, particularly where these gradients are produced by the beam itself. Finally, this study shows the potential complexity of studying nonlinear sample behavior, such as phase transformations, where biasing effects of temperature gradients can become paramount, precluding clear observation of true transformation conditions.

Crystallography

Charge-induced atomic strain as a predictor of structural phase transformation in rare-earth intermetallics

We present a descriptor based on charge-induced atomic strain in crystalline lattices for predicting structural phase transformations in rare-earth intermetallic compounds containing lanthanides and transition metals. The charge-induced local atomic strain was obtained from structural optimization of experimentally known crystalline phases using state of the art density-functional theory methods. The predictive power of the descriptor was evaluated on 𝑅⁢𝐸 2 ⁢In (𝑅𝐸 = rare earth) compounds, a class known for diverse phase transformations. We show that incorporating quantum-mechanical effects—such as local charge distribution, bonding, symmetry, and electronic structure—enhances the robustness of the descriptor. To gain further insight, we analyzed phononic and electronic behavior in Y 2 ⁢In and demonstrated that experimental phase transformations are captured only when atomic strain effects are included. The descriptor was further used to predict structural phase changes in (Y⁢b 1–𝑥 ⁢E⁢r 𝑥 ) 2 ⁢In and G⁡d 2 ⁡(I⁢n 1–𝑥⁢ A⁢l 𝑥 ), with predictions confirmed by x-ray powder diffraction. Here, while the current study is focused on lanthanide-based intermetallics, the underlying principles of the descriptor suggest potential applicability to other closely related classes of rare-earth intermetallics.

Density functional theory

Transformer-based operator learning framework for self-energy in strongly correlated systems

We introduce Σ-Attention, a transformer-based operator-learning framework for approximating the self-energy operator of strongly correlated electronic systems. By creating a batched dataset that combines results from three complementary approaches, i.e., many-body perturbation theory, strong-coupling expansion, and exact diagonalization, each effective in specific parameter regimes, Σ-Attention is applied to learn an accurate approximation for the self-energy operator that is valid across a wide range of parameter regimes. This hybrid strategy leverages the strengths of existing methods while relying on the transformer's ability to generalize beyond individual limitations. More importantly, the scalability of the transformer architecture allows the learned self-energy to be extended to systems with larger sizes, leading to much improved computational scaling. Using the one-dimensional Hubbard model, we demonstrate that Σ-Attention can accurately predict the Matsubara Green's function of large systems with a wide range of coupling strength. Our framework offers a promising and scalable pathway for studying strongly correlated systems with many possible generalizations.

Zhu, Yuanran

Unraveling the transformation pathway of the 𝛽 to 𝛾 phase transition in Ga 2 ⁢O 3 from atomistic simulations

Defect spinel 𝛾−Ga 2 ⁢O 3 is the least stable polymorph of Ga 2 ⁢O 3 , so its frequent appearance as a structural defect within or on the surface of monoclinic 𝛽−Ga 2 ⁢O 3 remains a mystery. Through first-principles calculations, we explore potential pathways for the phase transition from 𝛽−Ga 2⁢ O 3 to 𝛾−Ga 2 ⁢O 3 , and examine two key driving forces: tensile strain and Ga deficiency. When configurational entropy contributions to phase energies are included, the 𝛾 phase becomes energetically competitive with the 𝛽 phase, with the free energy difference between these phases diminishing even further under Ga-deficient conditions. Notably, a stability crossover occurs at room temperature at high vacancy concentrations ([V$^{3−}_{Ga}$]>3%) . A simple model 𝛽 → 𝛾 transformation pathway is identified, comprising two primary reactions, that enables the formation of the 𝛾 phase via simultaneous migration of Ga atoms from tetrahedral lattice sites to octahedral interstitial positions. The transformation barriers are prohibitively large in pristine Ga 2 ⁢O 3 , but can be substantially reduced by: (1) the presence of Ga vacancies, (2) elongational strains along the crystallographic 𝑎-axis, and (3) when volumetric relaxations are possible during transformation. These results elucidate prior experimental observations, where 𝛾−Ga 2⁢ O 3 is seen on damaged surfaces or in highly 𝑛-type 𝛽−Ga 2⁢ O 3 environments, which support Ga deficiency and mechanical strain. The insights into the driving forces and mechanisms of 𝛾−Ga 2⁢ O 3 formation enhance understanding of how localized strain and nonequilibrium defect concentrations may facilitate its formation from the 𝛽 phase.

Defects

Physics-informed transformation toward improving the machine-learned NLTE models of ICF simulations

The integration of machine-learning techniques into inertial confinement fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By replacing the costly nonlocal thermodynamic equilibrium (NLTE) model with machine-learning models, significant reductions in calculation time have been achieved. However, determining how to optimize machine-learning-based NLTE models in order to match ICF simulation dynamics remains challenging, underscoring the need for physically relevant error metrics and strategies to enhance model accuracy with respect to these metrics. Thus, we propose novel physics-informed transformations designed to emphasize energy transport, use these transformations to establish new error metrics, and demonstrate that they yield smaller errors within reduced principal-component spaces compared to conventional transformations. Published by the American Physical Society 2025

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

A low-temperature, one-step synthesis for monazite can transform monazite into a readily usable advanced nuclear waste form

It has been demonstrated that monazite-type materials are excellent candidates for nuclear waste forms, and hence, their facile synthesis is of great importance for the needed sequestration of existing nuclear waste. The synthesis of monazite, LaPO 4 , requires inconveniently high temperatures near 1000°C and generally involves the conversion of the presynthesized rhabdophane, LaPO 4 •nH 2 O, to the LaPO 4 monazite phase. During this structure transformation, the rhabdophane converts irreversibly to the thermodynamically stable monoclinic monazite structure. A low-temperature (185° to 260°C) mild hydrothermal acid-promoted synthesis of monazite is described that can both transform presynthesized rhabdophane or assemble reagents to the monoclinic monazite structure. The pH dependence of this reaction is detailed, and its applicability to the LnPO 4 (Ln = La, Ce, Pr, Nd, Sm-Gd), Ca 0.5 Th 0.5 PO 4 , and Sr 0.5 Th 0.5 PO 4 systems is discussed. The crystal growth of Ca 0.5 Th 0.5 PO 4 and Sr 0.5 Th 0.5 PO 4 is described, and their crystal structures were reported. In situ x-ray diffraction studies, performed as a function of temperature, provide insight into the structure transformation process.

Biogeochemistry

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277

CurvilinearGrids.jl: A Julia package for curvilinear coordinate transformations

Finite-difference discretizations of partial differential equations are widespread throughout the scientific community. Oftentimes finite-differences are used to compute spatial gradients of fields on a discrete grid, which is typically a uniform or rectilinear Cartesian mesh. Arbitrary multidimensional geometry is difficult to discretize directly with finite differences, however, due to non-uniform grid spacing and non-orthogonality. Curvilinear coordinate transformations can be used as a strategy to enable arbitrary geometry. While these curvilinear transformations are straightforward, the governing PDEs require additional terms (metrics) and must adhere to strict conservation laws; these criteria complicate the application of the transformation and require careful implementation.

97 MATHEMATICS AND COMPUTING