Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Evaluating the grain-scale deformation behavior of a single-phase FCC high entropy alloy using synchrotron high energy diffraction microscopy

We report although the deformation behavior of high-entropy alloys (HEAs) has been extensively studied at the macroscale, many important properties have yet to be explored for these alloys at the microscale, thus hampering accurate prediction of damage and failure processes. Synchrotron high-energy diffraction microscopy (HEDM) and fast-Fourier transform-based crystal plasticity modeling was conducted to investigate the three-dimensional (3D) grain-resolved micromechanical response for approximately 1,900 constituent grains within a single-phase FCC HEA up to 1% applied strain. The evolution of grain-resolved elastic strains, lattice reorientations, and maximum resolved shear stresses (mRSS) were evaluated to quantify elastic, yield, and fully plastic behavior. Overall, the initial critical resolved shear stress (CRSS), determined via in situ HEDM and companion modeling, was found to be > 20% higher than estimated using the classical polycrystalline Taylor factor (M = 3.06). However, a descriptive parameter based on the average grain-resolved Taylor factor ($\overline{M}$) was found to show excellent agreement with plastic yielding behavior observed within HEDM datasets. Noticeable deviations in HEDM lattice reorientations compared to both EVP-FFT simulations and classical predictions for FCC polycrystals were discovered, highlighting the complexity in correlating local lattice reorientations, Taylor, and Schmid factors with plastic response for this material at the grain-scale. Therefore, it is anticipated that the overall trends and parameter identification of 3D grain-resolved properties in this study can serve as an important foundation for continued mesoscale investigation on both well-established and newly developed Cantor-like HEAs.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Investigation of twin growth mechanisms in precipitate hardened AZ91

Here, in this work, an elasto-viscoplastic fast-Fourier-transform (EVP-FFT) model with a dislocation-density (DD) based hardening law is employed to study the growth of a {10$\bar{1}$2} tensile twin that is blocked by basal-precipitates in precipitate-hardened AZ91 magnesium alloy. It is frequently reported that twin growth is hindered in precipitate-hardened Mg alloys; however, thick twin domains are often observed experimentally in these material systems. Detailed numerical investigation of deformation twinning starting from an early propagation stage, before twin growth, reveals that the stress fields that result from two sequentially propagated twins co-impinging on a precipitate relaxes the twin back stress locally and promotes twin growth at the twin-precipitate junction. Based on these findings, a two-step growth mechanism is proposed for twins arrested by precipitates. In the first step, the interaction of a twin tip with a precipitate develops a stress concentration on the other side of the precipitate, prompting the formation of a second twin. Subsequently, the back stresses associated with the first twin are relaxed by the formation of the second twin, allowing the first twin to grow at the twin-precipitate junction and eventually engulf the precipitate. This mechanism suggests that twin growth can be achieved locally with minimal additional external forces, explaining how relatively large twin domains can develop even in the presence of arrays of precipitates.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Peridynamic elastic waves in two-dimensional unbounded domains: Construction of nonlocal Dirichlet-type absorbing boundary conditions

The focus of this paper is on application of peridynamics (PD) to propagation of elastic waves in unbounded domains. We construct absorbing boundary conditions (ABCs) derived from a semi-analytical solution of the PD governing equation at the exterior region. This solution is made up of a finite series of plane waves, as fundamental solutions (modes), which satisfy the PD dispersion relations. The modes are adjusted to transmit the energy from the interior region (near field) to the exterior region (far field). The corresponding unknown coefficients of the series are found in terms of the displacement field at a layer of points adjacent to the absorbing boundary. This is accomplished through a collocation procedure at subregions (clouds) around each absorbing point. The proposed ABCs offer appealing advantages, which facilitate their application to PD. They are of Dirichlet-type, hence their implementation is relatively simple as no derivatives of the field variables are required. They are constructed in the time and space domains and thus application of Fourier and Laplace transforms, cumbersome for nonlocal models, is not required. At the discrete level, the modes satisfy the same numerical dispersion relations of the near field, which makes the far-field solution compatible with that of the near field. We scrutinize the performance of the proposed ABCs through several examples. So our investigation shows that the proposed ABCs perform stably in time with an appropriate level of accuracy even in problems characterized by highly-dispersive propagating waves, including crack propagation in semi-unbounded brittle solids.

42 ENGINEERING↗
DOE OSTI2025

Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials

Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.

Composite materials↗
DOE OSTI2022

Non-local large-strain FFT-based formulation and its application to interface-dominated plasticity of nano-metallic laminates

Here, this paper presents a novel formulation and its robust numerical implementation of strain-gradient (SG) crystal plasticity within a large-strain (LS) elasto-viscoplastic (EVP) fast Fourier transform (FFT)-based micromechanical model. The resulting non-local SG-LS-EVPFFT formulation is used to model and understand the process of kink band formation during layer-parallel compression of nano-metallic laminates (NMLs). NMLs are layered composites with nanoscale thicknesses, thus requiring consideration of the interaction between dislocations and interfaces within the micromechanical model. The length-scale parameter of the SG model is calibrated by simulating a double pile-up and comparing predictions to analytical solution. This required new expressions for the defect energy, resulting in more accurate double pile-up predictions. The calibrated SG-LS-EVPFFT model is then used to simulate layer-parallel compression of copper-niobium NML. Formation of kink bands is predicted, and the model is used to rationalize the microscopic mechanisms enabling the formation process. It is found that accumulation of dislocations at interfaces leads to activation of layer-parallel slip, which in turn leads to kink band formation.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Generalized grain boundary constitutive description implemented in a strain-gradient large-strain FFT-based formulation: Application to nano-metallic laminates

Herein this paper presents a general treatment of grain boundary constitutive behavior in the context of strain-gradient (SG) plasticity, and its numerical implementation in a large-strain (LS) elasto-viscoplastic (EVP) fast Fourier transform (FFT)-based micromechanical model. Two novel grain boundary constitutive equations are proposed, allowing for more accurate description of the Burgers vector flow at the grain boundary. The capabilities of the generalized SG-LS-EVPFFT formulation are illustrated for the case of kink-band formation during layer-parallel compression of nano-metallic laminates (NMLs), requiring consideration of the interaction between dislocations and interfaces.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Twinning pathways enabled by precipitates in $\mathrm{AZ91}$

While precipitates have been shown to substantially strengthen magnesium alloys by blocking the glide of dislocations inside the grain, the interactions between these precipitates and deformation twins, which commonly occur in these alloys, are much less understood. Here, in this work, an elasto-viscoplastic fast-Fourier-transform (EVP-FFT) model is used to study the interactions between plate-shaped basal precipitates and propagating $10\bar{1}2$ tensile twins in AZ91 Mg alloy. The results suggest that while precipitates may impede the propagation and thickening of twins, they can also cause stress localizations that can promote the formation of multiple new twins of the same or different crystallographic variants. We show that the location of the twin-precipitate interaction site, whether precipitate-central or precipitate-edge impingement, and the thickness of the precipitate can influence the propensity for twins to expand around the precipitate or nucleate a new twin on the other side of it. Depending on the twin-precipitate impingement site, we propose multiple twinning pathways that can help explain how twins can proliferate in the magnesium alloys in the presence of precipitates.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Luminescent Metal–Organic Framework for the Selective Detection of Aldehydes

The detection of toxic, hazardous chemical species is an important task because they pose serious risks to either the environment or human health. Luminescent metal–organic frameworks (LMOFs) as alternative sensors offer rapid and sensitive detection of chemical species. Interactions between chemical species and LMOFs result in changes in the photoluminescence (PL) profile of the LMOFs which can be readily detected using a simple fluorometer. Herein, we report the use of a robust, Zn-based LMOF, [Zn 5 (μ 3 -OH) 2 (adtb) 2 (H 2 O) 5 ·5 DMA] (Zn-adtb, LMOF-341), for the selective detection of benzaldehyde. Upon exposure to benzaldehyde, Zn-adtb experiences significant luminescent quenching, as characterized through PL experiments. Photoluminescent titration experiments reveal that LMOF-341 has a detection limit of 64 ppm and a Ksv value of 179 M –1 for benzaldehyde. Furthermore, we study the guest–host interactions that occur between LMOF-341 and benzaldehyde through in situ Fourier transform infrared and computational modeling employing density functional theory. The results show that benzaldehyde interacts more strongly with LMOF-341 compared to formaldehyde and propionaldehyde. Furthermore, our combined studies also reveal that the mechanism of luminescence quenching originates from an electron-transfer process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

cm 2 -Scale Synthesis of MoTe 2 Thin Films with Large Grains and Layer Control

Owing to the small energy differences between its polymorphs, MoTe 2 can access a full spectrum of electronic states from the 2H semiconducting state to the 1T' semimetallic state and from the T d Weyl semimetallic state to the superconducting state in the 1T' and T d phase at low temperature. Thus, it is a model system for phase transformation studies as well as quantum phenomena such as the quantum spin Hall effect and topological superconductivity. Careful studies of MoTe 2 and its potential applications require large-area MoTe 2 thin films with high crystallinity and thickness control. Here, we present cm 2 -scale synthesis of 2H-MoTe 2 thin films with layer control and large grains that span several microns. Layer control is achieved by controlling the initial thickness of the precursor MoO x thin films, which are deposited on sapphire substrates by atomic layer deposition and subsequently tellurized. Despite the van der Waals epitaxy, the precursor–substrate interface is found to critically determine the uniformity in thickness and grain size of the resulting MoTe 2 films: MoTe 2 grown on sapphire show uniform films while MoTe 2 grown on amorphous SiO 2 substrates form islands. Furthermore, this synthesis strategy decouples the layer control from the variabilities of growth conditions for robust growth results and is applicable to growing other transition-metal dichalcogenides with layer control.

2D materials↗
DOE OSTI2023

Direct Conversion of Methane to Ethylene and Acetylene over an Iron-Based Metal–Organic Framework

Conversion of methane (CH 4 ) to ethylene (C 2 H 4 ) and/or acetylene (C 2 H 2 ) enables routes to a wide range of products directly from natural gas. However, high reaction temperatures and pressures are often required to activate and convert CH 4 controllably, and separating C 2+ products from unreacted CH 4 can be challenging. Here, we report the direct conversion of CH 4 to C 2 H 4 and C 2 H 2 driven by non-thermal plasma under ambient (25 °C and 1 atm) and flow conditions over a metal–organic framework material, MFM-300(Fe). The selectivity for the formation of C 2 H 4 and C 2 H 2 reaches 96% with a high time yield of 334 μmol g cat –1 h –1 . At a conversion of 10%, the selectivity to C 2+ hydrocarbons and time yield exceed 98% and 2056 μmol g cat –1 h –1 , respectively, representing a new benchmark for conversion of CH 4 . In situ neutron powder diffraction, inelastic neutron scattering and solid-state nuclear magnetic resonance, electron paramagnetic resonance (EPR), and diffuse reflectance infrared Fourier transform spectroscopies, coupled with modeling studies, reveal the crucial role of Fe–O(H)–Fe sites in activating CH 4 and stabilizing reaction intermediates via the formation of an Fe–O(CH 3 )–Fe adduct. In addition, a cascade fixed-bed system has been developed to achieve online separation of C 2 H 4 and C 2 H 2 from unreacted CH 4 for direct use. Integrating the processes of CH 4 activation, conversion, and product separation within one system opens a new avenue for natural gas utility, bridging the gap between fundamental studies and practical applications in this area.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Generative Electrolyte Solvent and Formulation Discovery

Molecular mixtures and/or formulations are of great importance in fields ranging from materials science to pharmaceuticals to chemistry. In batteries, electrolytes are complex molecular mixtures consisting of multiple salts and solvents and additives at different concentrations that dictate battery capacity, safety, and cycle life, among others. Unfortunately, due to the complex composition and infinite design space as well as the conflicting property requirements, electrolyte design is the rate-determining step in the design of next generation battery chemistries. In this work, we develop a transformer-based generative AI model − ElectrolyteGPT − capable of generating solvents and electrolyte formulations to satisfy a wide range of desired property requirements. First, we curate an electrolyte-relevant database and develop a new line notation for formulations. Then, we show that ElectrolyteGPT can generate solvents and formulations conditioned on a wide range of important electrolyte properties such as ionic conductivity, oxidative stability, Coulombic efficiency, viscosity, and more. Finally, we experimentally synthesize the generated solvents and fabricate the electrolyte formulations and show that they can meet the desired property requirements and enable longterm cycling in energy-dense anode-free lithium metal batteries. Our work showcases the ability of generative models to address challenges in molecular mixture design for next generation batteries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Health co-benefits of achieving sustainable net-zero greenhouse gas emissions in California

The achievement of net-zero greenhouse gas (GHG) emissions by 2100 is required to limit global temperature rise below 2 °C above preindustrial levels. Earlier accomplishments of net-zero GHG emissions in developed regions support this global target. In this study, we have developed a road map for California to achieve net-zero GHG emissions sustainably in 2050 by using detailed modelling of energy system transformation, cross-sectoral connectivity and technology penetration, as well as quantify the associated health co-benefits from reduced co-emitted air pollutants. We find that approximately 14,000 premature deaths can be avoided in California in 2050 and that these health co-benefits are disproportionately higher in disadvantaged communities (that is, 35% of avoided deaths will come from 25% of the state’s population). The annualized monetary benefits (US$215 billion) exceed the GHG abatement cost (US$106 billion) by US$109 billion. This road map requires the use of bioenergy with carbon capture and sequestration technology to offset some GHG emissions. However, this technology comes at a price as it would emit a considerable amount of air pollutants and reduce health co-benefits by US$4 billion. Nevertheless, our analysis shows that ambitious GHG reduction efforts can provide substantial health co-benefits, especially for residents of disadvantaged communities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Artificial neural network prediction of self-diffusion in pure compounds over multiple phase regimes

Artificial neural networks (ANNs) were developed to accurately predict the self-diffusion constants for pure components in liquid, gas and super critical phases. The ANNs were tested on an experimental database of 6625 self-diffusion constants for 118 different chemical compounds. The presence of multiple phases results in a heavy skew in the distribution of diffusion constants and multiple approaches were used to address this challenge. First, an ANN was developed with the raw diffusion values to assess what the main drawbacks of this direct method were. The first approach for improving the predictions involved taking the log 10 of diffusion to provide a more uniform distribution and reduce the range of target output values used to develop the ANN. The second approach involved developing individual ANNs for each phase using the raw diffusion values. Results show that the log transformation leads to a model with the best self-diffusion constant predictions and an overall average absolute deviation (AAD) of 6.56%. The resultant ANN is a generalized model that can be used to predict diffusion across all three phases and over a diverse group of compounds. The importance of each input feature was ranked using a feature addition method revealing that the density of the compound has the largest impact on the ANN prediction of self-diffusion constants in pure compounds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Restoring permutational invariance in the Jordan–Wigner transformation

The Jordan–Wigner transformation is a powerful tool for converting systems of spins into systems of fermions, or vice versa. While this mapping is exact, the transformation itself depends on the labelling of the spins. One consequence of this dependence is that approximate solutions of a Jordan–Wigner-transformed Hamiltonian may depend on the (physically inconsequential) labelling of the spins. In this work, we turn to an extended Jordan–Wigner transformation which remedies this problem and which may also introduce some correlation atop the Hartree–Fock solution of a transformed spin Hamiltonian. We demonstrate that this extended Jordan–Wigner transformation can be thought of as arising from a unitary version of the Lie algebraic similarity transformation (LAST) theory. Here, we show how these ideas, particularly in combination with the standard (non-unitary) version of LAST, can provide a potentially powerful tool for the treatment of the XXZ and J 1 –J 2 Heisenberg Hamiltonians.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Combining protein sequences and structures with transformers and equivariant graph neural networks to predict protein function

Abstract Motivation Millions of protein sequences have been generated by numerous genome and transcriptome sequencing projects. However, experimentally determining the function of the proteins is still a time consuming, low-throughput, and expensive process, leading to a large protein sequence-function gap. Therefore, it is important to develop computational methods to accurately predict protein function to fill the gap. Even though many methods have been developed to use protein sequences as input to predict function, much fewer methods leverage protein structures in protein function prediction because there was lack of accurate protein structures for most proteins until recently. Results We developed TransFun—a method using a transformer-based protein language model and 3D-equivariant graph neural networks to distill information from both protein sequences and structures to predict protein function. It extracts feature embeddings from protein sequences using a pre-trained protein language model (ESM) via transfer learning and combines them with 3D structures of proteins predicted by AlphaFold2 through equivariant graph neural networks. Benchmarked on the CAFA3 test dataset and a new test dataset, TransFun outperforms several state-of-the-art methods, indicating that the language model and 3D-equivariant graph neural networks are effective methods to leverage protein sequences and structures to improve protein function prediction. Combining TransFun predictions and sequence similarity-based predictions can further increase prediction accuracy. Availability and implementation The source code of TransFun is available at https://github.com/jianlin-cheng/TransFun.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Deep image reconstruction for background subtraction in heavy-ion collisions

Jet reconstruction in an ultrarelativistic heavy-ion collision suffers from a notoriously large, fluctuating thermal background. Traditional background‐subtraction methods struggle to remove this soft background while preserving the jet's hard substructure. In this Letter, we present DeepSub, a machine-learning-based approach for full-event background‐subtraction. DeepSub utilizes a model based on Swin Transformer layers to denoise jet images and disentangle hard jets from the heavy-ion background. DeepSub significantly outperforms existing subtraction techniques by reproducing key jet observables such as jet 𝑝 T and mass, and substructure observables such as girth and the energy correlation function, at the subpercent to percent level. As such, DeepSub paves the way for precision heavy-ion measurements in hitherto inaccessible kinematic regimes.

Qureshi, Umar Sohail [Stanford University, CA (Uni↗