Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Intrinsic activation energies for ring contraction of allylic cations in zeolites

Cyclic carbocations are important intermediates in zeolite-catalyzed chemistries such as methanol-to-hydrocarbons conversion, naphthenes ring opening, or coke formation. While information about their thermodynamic stability exists, little is known about the kinetics of formation and transformation of cyclic carbocations in zeolites. To fill this knowledge gap, ring contraction of the 1,3,5,5-tetramethylcyclohexenyl cation (C 10 H 17 + ), a representative of 6-membered ring allylic cations, was investigated by in situ UV–vis and IR spectroscopy. Protonic forms of zeolites served as catalysts, at temperatures from 80 °C to 135 °C. Significant oligomerization and hydride transfer in BEA and FAU hampered kinetics analysis, whereas ring contraction dominated in the channels of MOR. The reactant cation, characterized by an electronic absorption at 314 nm and an allylic stretch at 1549 cm −1 , contracted to both a 1,3-alkyl-substituted cyclopentenyl cation (287 nm and 1506 cm −1 ) and a 1,2,3-alkyl-substituted cyclopentenyl cation (297 nm and 1489 cm −1 ). Collection of time-resolved IR spectra and fitting of the intensities with various kinetic models revealed a third transformation, which is expected from thermodynamics: the 1,3-alkyl-substituted cyclopentenyl cation isomerizes to the 1,2,3-alkyl-substituted cyclopentenyl cation. Series of IR spectra recorded at different temperatures delivered intrinsic activation enthalpies (entropies) in MOR of 67 ± 2 kJ mol −1 (−130 ± 6 J mol −1 K −1 ) and 90 ± 3 kJ mol −1 (−70 ± 8 J mol −1 K −1 ) for the contraction to 1,3- and 1,2,3-substituted species, and of 88 ± 5 kJ mol −1 (−84 ± 12 J mol −1 K −1 ) for the isomerization. The findings characterize one path – via contraction of larger rings – to different cyclopentenyl species in zeolites; and the associated, moderate activation energies suggest such transformations contribute to many complex hydrocarbon reaction networks.

Acid catalysis↗

Application of machine learning to estimate fireball characteristics and their uncertainty from infrared spectral data

Experiments or events involving high explosives (HE) can be monitored remotely by infrared (IR) sensors to gather information about the configuration or materials involved in the device. Researchers at the Air Force Institute of Technology (AFIT) developed a phenomenological model for HE fireball spectra in the IR range that allows for parameters to be extracted from Fourier transform infrared (FTIR) data. This model includes parameters tied to physical characteristics of the fireball: temperature, size, soot, and gas concentrations. Previous works have sought to recover these parameters by the fitting of either whole spectra or select wavenumber bands to this phenomenological model. Difficulties arise due to the complex relationships between the parameters to be fit. Uncertainty quantification of the estimated fireball parameters is also problematic since HE experiments do not have any ground truth information on the parameters. It is suggested that artificial neural network (ANN) based approaches may be well suited to this problem, because of their ability to capture complex and highly nonlinear relationships. As such, this work seeks to explore the efficacy of deep artificial neural networks (DNNs) for this problem of parameter recovery from spectra and to also investigate the uncertainty of recovering the fireball parameters from FTIR data. Networks are designed using the hyperparameter optimization tool Hyperopt and trained/tested on artificial data generated using the phenomenological model developed by AFIT. The results of applying the network to the artificial data set are compared to a physics-based band approach that uses a selected number of bands based on their physical properties. Information on the uncertainty of estimating parameters from remotely sensed experimental data is obtained by treating the accuracy of the DNN model on artificial data as an upper bound and by examining the impact of emissivity due to soot on parameter estimation error; the results for artificial data are likely to be optimistic as compared to recovering parameters from experimental data.

42 ENGINEERING↗

PSCF+: An Extended and Improved Open-Source Software Package for Polymer Self-Consistent Field Calculations

This work introduces PSCF+, a freely available open‑source software tool for modeling how block copolymers self‑assemble into ordered nanoscale structures. The software allows researchers to study a wide range of polymer models and interaction types, making it possible to directly compare theoretical predictions with molecular and simulation‑based studies in a consistent way. PSCF+ incorporates several recently developed numerical methods that significantly reduce computer memory requirements and speed up calculations, enabling efficient use of modern GPU hardware. Here, it also provides automated tools to calculate free‑energy landscapes and phase boundaries, which are essential for understanding and predicting material behavior. Together, these advances make PSCF+ a powerful and flexible platform for studying polymer self‑assembly and support the design of new polymeric materials for scientific and technological applications.

Chemical calculations↗

Scaling transformations and the origins of light relics constraints from cosmic microwave background observations

Here, we use here a family of scaling transformations, that scale key rates in the evolution equations, to analytically understand constraints on light relics from cosmic microwave background (CMB) maps, given cosmological models of varying degrees of complexity. We describe the causes of physical effects that are fundamentally important to the constraining power of the data, with a focus on the two that are most novel. We use as a reference model a cosmological model that admits a scaling transformation that increases light relic energy density while avoiding all of these causes. Constraints on light relics in a given model can then be understood as due to the differences between the given model and the reference model, as long as the additional light relics only interact gravitationally with the Standard Model components. This understanding supports the development of cosmological models that can evade light relics constraints from CMB maps.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep learning-enabled natural language processing to identify directional pharmacokinetic drug–drug interactions

Background. During drug development, it is essential to gather information about the change of clinical exposure of a drug (object) due to the pharmacokinetic (PK) drug-drug interactions (DDIs) with another drug (precipitant). While many natural language processing (NLP) methods for DDI have been published, most were designed to evaluate if (and what kind of) DDI relationships exist in the text, without identifying the direction of DDI (object vs. precipitant drug). Here we present a method for the automatic identification of the directionality of a PK DDI from literature or drug labels. Methods. We reannotated the Text Analysis Conference (TAC) DDI track 2019 corpus for identifying the direction of a PK DDI and evaluated the performance of a fine-tuned BioBERT model on this task by following the training and validation steps prespecified by TAC. Results. This initial attempt showed the model achieved an F-score of 0.82 in identifying sentences as containing PK DDI and an F-score of 0.97 in identifying object versus precipitant drugs in those sentences. Discussion and conclusion. Despite a growing list of NLP methods for DDI extraction, most of them use a common set of corpora to perform general purpose tasks (e.g., classifying a sentence into one of several fixed DDI categories). There is a lack of coordination between the drug development and biomedical informatics method development community to develop corpora and methods to perform specific tasks (e.g., extract clinical exposure changes due to PK DDI). We hope that our effort can encourage such a coordination so that more “fit for purpose” NLP methods could be developed and used to facilitate the drug development process.

59 BASIC BIOLOGICAL SCIENCES↗

Operating advanced scientific instruments with AI agents that learn on the job

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.

Large Language Models↗

Privacy-Aware RAG-Enabled LLMs for Collaborative AI in Organizations

Recent advancements in Large Language Models (LLMs) based on Transformer architectures have significantly improved capabilities in natural language processing and generation. However, deploying LLMs for inter-organizational communication poses challenges, in ensuring privacy and facilitating effective collaboration. This paper introduces a novel decentralized inference meta-agent chatbot that leverages privacy-aware Retrieval-Augmented Generation (RAG)-enabled LLMs for collaborative AI communication across organizations. Built on Microsoft’s Autogen, the platform enables LLMs to autonomously refine responses, enhancing accuracy and relevance. It incorporates advanced hallucination mitigation techniques using Uptrain and a privacy-focused RAG framework that employs synthetic document generation to protect sensitive information. Comprehensive evaluations demonstrate the platform’s effectiveness in maintaining contextual relevance and stringent privacy standards, effectively addressing critical challenges in LLM-enhanced collaborative AI communication. This work represents a significant step toward secure and efficient inter-organizational collaboration using advanced generative AI technologies.

97 - MATHEMATICS AND COMPUTING↗

Topographic hydro-conditioning to resolve surface depression storage and ponding in a fully distributed hydrologic model

Land surface depressions play a central role in the transformation of rainfall to ponding, infiltration and runoff, yet digital elevation models (DEMs) used by spatially distributed hydrologic models that resolve land surface processes rarely capture land surface depressions at spatial scales relevant to this transformation. Methods to generate DEMs through processing of remote sensing data, such as optical and light detection and ranging (LiDAR) have favored surfaces without depressions to avoid adverse slopes that are problematic for many hydrologic routing methods. Here, in this study, we present a new topographic conditioning workflow, Depression-Preserved DEM Processing (D2P) algorithm, which is designed to preserve physically meaningful surface depressions for depression-integrated and efficient hydrologic modeling. D2P includes several features: (1) an adaptive screening interval for delineation of depressions, (2) the ability to filter out anthropogenic land surface features (e.g., bridges), (3) the ability to blend river smoothing (e.g., a general downslope profile) and depression resolving functionality. From a case study in the Goodwin Creek Experimental Watershed, D2P successfully resolved 86% of the ponds at a DEM resolution of 10 m. Topographic conditioning was achieved with minimum impact as D2P reduced the number of modified cells from the original DEM by 51% compared to a conventional algorithm. Furthermore, hydrologic simulation using a D2P processed DEM resulted in a more robust characterization on surface water dynamics based on higher surface water storage as well as an attenuated and delayed peak streamflow.

54 ENVIRONMENTAL SCIENCES↗

Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image

Abstract Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.

Astronomy & Astrophysics↗

The five-point bootstrap

We study five-point correlation functions of scalar operators in d-dimensional conformal field theories. We develop a new approach to computing the five-point conformal blocks for exchanged primary operators of arbitrary spin by introducing a generalization of radial coordinates, using an appropriate ansatz, and perturbatively solving two quadratic Casimir differential equations. We then study five-point correlators 〈σσϵσσ〉 in the critical 3d Ising model. We truncate the operator product expansions (OPEs) in the correlator by including a finite number of primary operators with conformal dimension below a cutoff ∆ ⩽ ∆ cutoff . We then compute several OPE coefficients involving ϵ and two spinning operators by demanding that the truncated correlator approximately satisfies the crossing relation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evaluating the grain-scale deformation behavior of a single-phase FCC high entropy alloy using synchrotron high energy diffraction microscopy

We report although the deformation behavior of high-entropy alloys (HEAs) has been extensively studied at the macroscale, many important properties have yet to be explored for these alloys at the microscale, thus hampering accurate prediction of damage and failure processes. Synchrotron high-energy diffraction microscopy (HEDM) and fast-Fourier transform-based crystal plasticity modeling was conducted to investigate the three-dimensional (3D) grain-resolved micromechanical response for approximately 1,900 constituent grains within a single-phase FCC HEA up to 1% applied strain. The evolution of grain-resolved elastic strains, lattice reorientations, and maximum resolved shear stresses (mRSS) were evaluated to quantify elastic, yield, and fully plastic behavior. Overall, the initial critical resolved shear stress (CRSS), determined via in situ HEDM and companion modeling, was found to be > 20% higher than estimated using the classical polycrystalline Taylor factor (M = 3.06). However, a descriptive parameter based on the average grain-resolved Taylor factor ($\overline{M}$) was found to show excellent agreement with plastic yielding behavior observed within HEDM datasets. Noticeable deviations in HEDM lattice reorientations compared to both EVP-FFT simulations and classical predictions for FCC polycrystals were discovered, highlighting the complexity in correlating local lattice reorientations, Taylor, and Schmid factors with plastic response for this material at the grain-scale. Therefore, it is anticipated that the overall trends and parameter identification of 3D grain-resolved properties in this study can serve as an important foundation for continued mesoscale investigation on both well-established and newly developed Cantor-like HEAs.

36 MATERIALS SCIENCE↗

Investigation of twin growth mechanisms in precipitate hardened AZ91

Here, in this work, an elasto-viscoplastic fast-Fourier-transform (EVP-FFT) model with a dislocation-density (DD) based hardening law is employed to study the growth of a {10$\bar{1}$2} tensile twin that is blocked by basal-precipitates in precipitate-hardened AZ91 magnesium alloy. It is frequently reported that twin growth is hindered in precipitate-hardened Mg alloys; however, thick twin domains are often observed experimentally in these material systems. Detailed numerical investigation of deformation twinning starting from an early propagation stage, before twin growth, reveals that the stress fields that result from two sequentially propagated twins co-impinging on a precipitate relaxes the twin back stress locally and promotes twin growth at the twin-precipitate junction. Based on these findings, a two-step growth mechanism is proposed for twins arrested by precipitates. In the first step, the interaction of a twin tip with a precipitate develops a stress concentration on the other side of the precipitate, prompting the formation of a second twin. Subsequently, the back stresses associated with the first twin are relaxed by the formation of the second twin, allowing the first twin to grow at the twin-precipitate junction and eventually engulf the precipitate. This mechanism suggests that twin growth can be achieved locally with minimal additional external forces, explaining how relatively large twin domains can develop even in the presence of arrays of precipitates.

36 MATERIALS SCIENCE↗

Peridynamic elastic waves in two-dimensional unbounded domains: Construction of nonlocal Dirichlet-type absorbing boundary conditions

The focus of this paper is on application of peridynamics (PD) to propagation of elastic waves in unbounded domains. We construct absorbing boundary conditions (ABCs) derived from a semi-analytical solution of the PD governing equation at the exterior region. This solution is made up of a finite series of plane waves, as fundamental solutions (modes), which satisfy the PD dispersion relations. The modes are adjusted to transmit the energy from the interior region (near field) to the exterior region (far field). The corresponding unknown coefficients of the series are found in terms of the displacement field at a layer of points adjacent to the absorbing boundary. This is accomplished through a collocation procedure at subregions (clouds) around each absorbing point. The proposed ABCs offer appealing advantages, which facilitate their application to PD. They are of Dirichlet-type, hence their implementation is relatively simple as no derivatives of the field variables are required. They are constructed in the time and space domains and thus application of Fourier and Laplace transforms, cumbersome for nonlocal models, is not required. At the discrete level, the modes satisfy the same numerical dispersion relations of the near field, which makes the far-field solution compatible with that of the near field. We scrutinize the performance of the proposed ABCs through several examples. So our investigation shows that the proposed ABCs perform stably in time with an appropriate level of accuracy even in problems characterized by highly-dispersive propagating waves, including crack propagation in semi-unbounded brittle solids.

42 ENGINEERING↗

Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials

Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.

Composite materials↗

Non-local large-strain FFT-based formulation and its application to interface-dominated plasticity of nano-metallic laminates

Here, this paper presents a novel formulation and its robust numerical implementation of strain-gradient (SG) crystal plasticity within a large-strain (LS) elasto-viscoplastic (EVP) fast Fourier transform (FFT)-based micromechanical model. The resulting non-local SG-LS-EVPFFT formulation is used to model and understand the process of kink band formation during layer-parallel compression of nano-metallic laminates (NMLs). NMLs are layered composites with nanoscale thicknesses, thus requiring consideration of the interaction between dislocations and interfaces within the micromechanical model. The length-scale parameter of the SG model is calibrated by simulating a double pile-up and comparing predictions to analytical solution. This required new expressions for the defect energy, resulting in more accurate double pile-up predictions. The calibrated SG-LS-EVPFFT model is then used to simulate layer-parallel compression of copper-niobium NML. Formation of kink bands is predicted, and the model is used to rationalize the microscopic mechanisms enabling the formation process. It is found that accumulation of dislocations at interfaces leads to activation of layer-parallel slip, which in turn leads to kink band formation.

36 MATERIALS SCIENCE↗

Generalized grain boundary constitutive description implemented in a strain-gradient large-strain FFT-based formulation: Application to nano-metallic laminates

Herein this paper presents a general treatment of grain boundary constitutive behavior in the context of strain-gradient (SG) plasticity, and its numerical implementation in a large-strain (LS) elasto-viscoplastic (EVP) fast Fourier transform (FFT)-based micromechanical model. Two novel grain boundary constitutive equations are proposed, allowing for more accurate description of the Burgers vector flow at the grain boundary. The capabilities of the generalized SG-LS-EVPFFT formulation are illustrated for the case of kink-band formation during layer-parallel compression of nano-metallic laminates (NMLs), requiring consideration of the interaction between dislocations and interfaces.

36 MATERIALS SCIENCE↗

Twinning pathways enabled by precipitates in $\mathrm{AZ91}$

While precipitates have been shown to substantially strengthen magnesium alloys by blocking the glide of dislocations inside the grain, the interactions between these precipitates and deformation twins, which commonly occur in these alloys, are much less understood. Here, in this work, an elasto-viscoplastic fast-Fourier-transform (EVP-FFT) model is used to study the interactions between plate-shaped basal precipitates and propagating $10\bar{1}2$ tensile twins in AZ91 Mg alloy. The results suggest that while precipitates may impede the propagation and thickening of twins, they can also cause stress localizations that can promote the formation of multiple new twins of the same or different crystallographic variants. We show that the location of the twin-precipitate interaction site, whether precipitate-central or precipitate-edge impingement, and the thickness of the precipitate can influence the propensity for twins to expand around the precipitate or nucleate a new twin on the other side of it. Depending on the twin-precipitate impingement site, we propose multiple twinning pathways that can help explain how twins can proliferate in the magnesium alloys in the presence of precipitates.

36 MATERIALS SCIENCE↗