Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transformer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Metal ion dopant-induced famatinite to chalcostibite phase transformation of copper antimony sulphide colloidal nanostructures: effect on photophysical and pseudocapacitance properties

Here, the strategic doping of transition metal ions into copper antimony sulphide (CAS) semiconducting nanostructures can significantly influence their photophysical and pseudocapacitive properties, for which there are few reports and therefore is the focus of this study. Accordingly, highly crystalline metal ion (Mn 2+ , Fe 2+ , Co 2+ , Ni 2+ and Zn 2+ ) doped off-stoichiometric copper rich/poor, antimony-rich/poor, and sulphur-poor CAS nanostructures (10–23 nm) were grown via colloidal (hot-injection) synthesis using metal diethyldithiocarbamate precursors. Importantly, metal ion doping significantly influences the structure and composition of the off-stoichiometric CAS nanostructures. Data from powder X-ray diffraction, Raman spectroscopy, high-resolution scanning/transmission electron microscopy, and energy dispersive X-ray spectroscopy confirm that the heavier metal ion dopants induce a novel phase transformation from famatinite (fCAS) to chalcostibite (cCAS) nanostructures. The influence of the metal ion dopants is also observed in the optical properties of as-synthesized nanostructures. This involves blue-shifted ultraviolet-visible absorption, reduced Urbach tailing, and tunable bandgaps between 2.17 and 2.38 eV. Also, the doped nanostructures display broad visible-near infrared photoluminescence via a triple radiative pathway with relatively short decay lifetimes between 0.2 and 6.1 ns. This is mediated by electronic transitions involving intrinsic (copper/antimony/sulphur interstitial) and extrinsic (metal ion interstitial) defect states. Additionally, electrodes prepared from Mn 2+ -doped fCAS nanostructures show enhanced pseudocapacitance via Na+ surface adsorption and intercalation relative to undoped fCAS electrodes, while Zn 2+ -doped cCAS electrodes exhibit pseudocapacitance via a combination of Na+ surface adsorption, intercalation, and redox reactions. These electrodes exhibit reduced charge transfer resistance, improved electronic conductivity and notably enhanced specific capacitance (∼222 F g −1 ), and charge transport, as measured in 1 M Na 2 SO 4 electrolyte via cyclic voltammetry and electrochemical impedance spectroscopy. To this end, the discovery of the metal ion-induced phase transformation presents a new avenue for optimizing the functional properties of fCAS and cCAS nanostructures, highlighting the critical role of metal ion-related defects in controlling the optical and electrochemical properties, towards potential solar absorption and energy storage applications.

25 ENERGY STORAGE↗
DOE OSTI2025

Elucidating the phase transformations and grain growth behavior of O3-type sodium-ion layered oxide cathode materials during high temperature synthesis

Understanding the formation mechanism of layered oxide cathodes via solid-state synthesis is imperative to achieving controllability over their materials properties and electrochemical behaviors. In this work, we investigate the phase and microstructure evolution during the synthesis of NaNi 1/3 Fe 1/3 Mn 1/3 O 2 , a model sodium-ion layered oxide cathode, using a combination of imaging, diffraction, and spectroscopic techniques. We unravel the synthetic mechanistic pathways involved in the high-temperature calcination reaction, as well as elaborate the synthesis-microstructure-performance relationship of this material. The formation of the final layered oxide phase involves a gradual transformation through a sodiated oxyhydroxide intermediate. During the reaction, the precursor dehydration reaction dominates at 250–550 °C, while the major sodiation reaction occurs at 550–850 °C. Alongside multiple stages of phase transformations, the final grain structure formation occurs through the continuous growth of the (003) and (104) facets. During the reaction, Mn acts as the charge-compensating element and exhibits depth-dependent characteristics. When the sodiation reaction dominates over dehydration, the reaction intermediates undergo gradual electronic structure changes with increasing temperature, as indicated by the spectral features of TM3d-O2p hybrid states. Calcination duration is also a critical parameter governing the microstructure, surface reactivity, phase fraction distribution and electrochemical performance of the material. The optimal calcination duration was determined to be 18 hours at 850 °C under the conditions evaluated here. Calcination beyond this duration was found to be detrimental to electrochemical performance due to Na and O loss and heterogeneous sodium distribution throughout the particles. Our work sheds light on the complex crystallographic-chemical-microstructural evolution of sodium ion layered oxide cathodes and provides insight into precisely tuning material properties which are intimately linked to battery performances.

25 ENERGY STORAGE↗
DOE OSTI2020

Fast transformations between configuration state function and Slater determinant bases for direct configuration interaction

A hybrid configuration state function (CSF) and Slater determinant (SD) basis full configuration interaction (CI) program was developed to simultaneously take advantage of fast SD basis algorithms for σ = Hc formation and the smaller CI vector length and more robust convergence offered by a CSF basis. Graphical processing unit acceleration of the direct CSF-SD and SD-CSF basis transformation algorithms ensures that the combined transformation time per iteration relative to σ formation is small (~15%). In addition to the obvious benefits of reducing the memory footprint of the CI vector, additional computational savings are demonstrated that rely directly on the size of the CI basis, in one particular case reducing the CI time-to-solution of a HF-CAS-(16,16)-CI/6-31G calculation of ethylene from 1954.79 s to 956 s by using a CSF basis, a 2.0× speedup.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Quantification of MagLIF morphology using the Mallat scattering transformation

The morphology of the stagnated plasma resulting from magnetized liner inertial fusion is measured by imaging the self-emission x rays coming from the multi-keV plasma. Equivalent diagnostic responses can be generated by integrated radiation-magnetohydrodynamic (rad-MHD) simulations from programs such as HYDRA and GORGON. There have been only limited quantitative ways to compare the image morphology, that is the texture, of simulations and experiments. We have developed a metric of image morphology based on the Mallat scattering transformation (MST), a transformation that has proved to be effective at distinguishing textures, sounds, and written characters. This metric is designed, demonstrated, and refined by classifying ensembles (i.e., classes) of synthetic stagnation images and by regressing an ensemble of synthetic stagnation images to the morphology (i.e., model) parameters used to generate the synthetic images. We use this metric to quantitatively compare simulations to experimental images, experimental images to each other, and to estimate the morphological parameters of the experimental images with uncertainty. This coordinate space has proved to be very adept at doing a sophisticated relative background subtraction in the MST space. This was needed to compare the experimental self-emission images to the rad-MHD simulation images.

Glinsky, Michael E. (ORCID:0000000324933326)↗
DOE OSTI2022

Partially polaron-transformed quantum master equation for exciton and charge transport dynamics

Polaron-transformed quantum master equation (PQME) offers a unified framework to describe the dynamics of quantum systems in both limits of weak and strong couplings to environmental degrees of freedom. Thus, the PQME serves as an efficient method to describe charge and exciton transfer/transport dynamics for a broad range of parameters in condensed or complex environments. However, in some cases, the polaron transformation (PT) being employed in the formulation invokes an over-relaxation of slow modes and results in premature suppression of important coherence terms. A formal framework to address this issue is developed in the present work by employing a partial PT that has smaller weights for low frequency bath modes. In this work, it is shown that a closed form expression of a second order time-local PQME including all the inhomogeneous terms can be derived for a general form of partial PT, although more complicated than that for the full PT. All the expressions needed for numerical calculation are derived in detail. Applications to a model of a two-level system coupled to a bath of harmonic oscillators, with test calculations focused on those due to homogeneous relaxation terms, demonstrate the feasibility and the utility of the present approach.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Optimization of transformer ratio and beam loading in a plasma wakefield accelerator with a structure-exploiting algorithm

Plasma-based acceleration has emerged as a promising candidate as an accelerator technology for a future linear collider or a next-generation light source. We consider the plasma wakefield accelerator (PWFA) concept where a plasma wave wake is excited by a particle beam and a trailing beam surfs on the wake. For a linear collider, the energy transfer efficiency from the drive beam to the wake and from the wake to the trailing beam must be large, while the emittance and energy spread of the trailing bunch must be preserved. One way to simultaneously achieve this when accelerating electrons is to use longitudinally shaped bunches and nonlinear wakes. In the linear regime, there is an analytical formalism to obtain the optimal shapes. In the nonlinear regime, however, the optimal shape of the driver to maximize the energy transfer efficiency cannot be precisely obtained because currently no theory describes the wake structure and excitation process for all degrees of nonlinearity. In addition, the ion channel radius is not well defined at the front of the wake where the plasma electrons are not fully blown out by the drive beam. We present results using a novel optimization method to effectively determine a current profile for the drive and trailing beam in PWFA that provides low energy spread, low emittance, and high acceleration efficiency. We parameterize the longitudinal beam current profile as a piecewise-linear function and define optimization objectives. For the trailing beam, the algorithm converges quickly to a nearly inverse trapezoidal trailing beam current profile similar to that predicted by the ultrarelativistic limit of the nonlinear wakefield theory. For the drive beam, the beam profile found by the optimization in the nonlinear regime that maximizes the transformer ratio also resembles that predicted by linear theory. Furthermore, the current profiles found from the optimization method provide higher transformer ratios compared with the linear ramp predicted by the relativistic limit of the nonlinear theory.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Atomic-scale in situ observation of electron beam and heat induced crystallization of Ge nanoparticles and transformation of Ag@Ge core-shell nanocrystals

Crystallization of amorphous materials by thermal annealing has been investigated for numerous applications in the fields of nanotechnology, such as thin-film transistors and thermoelectric devices. The phase transition and shape evolution of amorphous germanium (Ge) and Ag@Ge core–shell nanoparticles with average diameters of 10 and 12 nm, respectively, were investigated by high-energy electron beam irradiation and in situ heating within a transmission electron microscope. The transition of a single Ge amorphous nanoparticle to the crystalline diamond cubic structure at the atomic scale was clearly demonstrated. Depending on the heating temperature, a hollow Ge structure can be maintained or transformed into a solid Ge nanocrystal through a diffusive process during the amorphous to crystalline phase transition. Selected area diffraction patterns were obtained to confirm the crystallization process. In addition, the thermal stability of Ag@Ge core–shell nanoparticles with an average core of 7.4 and a 2.1 nm Ge shell was studied by applying the same beam conditions and temperatures. The results show that at a moderate temperature (e.g., 385 °C), the amorphous Ge shell can completely crystallize while maintaining the well-defined core–shell structure, while at a high temperature (e.g., 545 °C), the high thermal energy enables a freely diffusive process of both Ag and Ge atoms on the carbon support film and leads to transformation into a phase segregated Ag–Ge Janus nanoparticle with a clear interface between the Ag and Ge domains. In conclusion, this study provides a protocol as well as insight into the thermal stability and strain relief mechanism of complex nanostructures at the single nanoparticle level with atomic resolution.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Unsupervised machine learning discovery of structural units and transformation pathways from imaging data

We show that unsupervised machine learning can be used to learn chemical transformation pathways from observational Scanning Transmission Electron Microscopy (STEM) data. To enable this analysis, we assumed the existence of atoms, a discreteness of atomic classes, and the presence of an explicit relationship between the observed STEM contrast and the presence of atomic units. With only these postulates, we developed a machine learning method leveraging a rotationally invariant variational autoencoder (VAE) that can identify the existing molecular fragments observed within a material. The approach encodes the information contained in STEM image sequences using a small number of latent variables, allowing the exploration of chemical transformation pathways by tracing the evolution of atoms in the latent space of the system. The results suggest that atomically resolved STEM data can be used to derive fundamental physical and chemical mechanisms involved, by providing encodings of the observed structures that act as bottom-up equivalents of structural order parameters. The approach also demonstrates the potential of variational (i.e., Bayesian) methods in the physical sciences and will stimulate the development of more sophisticated ways to encode physical constraints in the encoder–decoder architectures and generative physical laws and causal relationships in the latent space of VAEs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Extending the Mott–Gurney law to one-dimensional nonplanar diodes using point transformations

Recent studies have applied variational calculus, conformal mapping, and point transformations to generalize the one-dimensional (1D) space-charge limited current density (SCLCD) and electron emission mechanisms to nonplanar geometries; however, these assessments have focused on extending the Child–Langmuir law (CLL) for SCLCD in vacuum. Since the charge in the diode is independent of the coordinate system (i.e., covariant), we apply bijective point transformations to extend the Mott–Gurney law (MGL) for the SCLCD in a collisional or semiconductor gap to nonplanar 1D geometries. This yields a modified MGL that replaces the Cartesian gap distance with a canonical gap distance that may be written generally in terms of geometric scale factors that are known for multiple geometries. We tabulate results for common geometries. Such an approach may be applied to any current density, including non-space-charge limited gaps and SCLCD that may fall between the CLL and MGL.

Garner, Allen L. [Purdue Univ., West Lafayette, IN↗
DOE OSTI2026

Scalable quantum computational science: A perspective from block-encodings and polynomial transformations

Significant developments made in quantum hardware and error correction recently have been driving quantum computing toward practical utility. However, gaps remain between abstract quantum algorithmic development and practical applications in computational sciences. In this perspective article, we propose several properties that scalable quantum computational science methods should possess. We further discuss how block-encodings and polynomial transformations can potentially serve as a unified framework with the desired properties. Recent advancements on these topics are presented, including the construction and assembly of block-encodings, and various generalizations of quantum signal processing (QSP) algorithms to perform polynomial transformations. The scalability of QSP methods on parallel and distributed quantum architectures is also highlighted. Promising applications in simulation and observable estimation in chemistry, physics, and optimization problems are presented. We hope this perspective serves as a gentle introduction to state-of-the-art quantum algorithms for the computational science community and inspires future development of scalable quantum computational science methodologies that bridge theory and practice.

Bayesian inference↗
DOE OSTI2022

Biotropic liquid crystal phase transformations in cellulose-producing bacterial communities

Biological functionality is often enabled by a fascinating variety of physical phenomena that emerge from orientational order of building blocks, a defining property of nematic liquid crystals that is also pervasive in nature. Out-of-equilibrium, “living” analogs of these technological materials are found in biological embodiments ranging from myelin sheath of neurons to extracellular matrices of bacterial biofilms and cuticles of beetles. However, physical underpinnings behind manifestations of orientational order in biological systems often remain unexplored. For example, while nematiclike birefringent domains of biofilms are found in many bacterial systems, the physics behind their formation is rarely known. Here, using cellulose-synthesizing Acetobacter xylinum bacteria, we reveal how biological activity leads to orientational ordering in fluid and gel analogs of these soft matter systems, both in water and on solid agar, with a topological defect found between the domains. Furthermore, the nutrient feeding direction plays a role like that of rubbing of confining surfaces in conventional liquid crystals, turning polydomain organization within the biofilms into a birefringent monocrystal-like order of both the extracellular matrix and the rod-like bacteria within it. We probe evolution of scalar orientational order parameters of cellulose nanofibers and bacteria associated with fluid-gel and isotropic-nematic transformations, showing how highly ordered active nematic fluids and gels evolve with time during biological-activity-driven, disorder-order transformation. In conclusion, with fluid and soft-gel nematics observed in a certain range of biological activity, this mesophase-exhibiting system is dubbed “biotropic,” analogously to thermotropic nematics that exhibit solely orientational order within a temperature range, promising technological and fundamental-science applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Of Actors, Cities and Energy Systems: Advancing the Transformative Potential of Urban Electrification

The electrification of transportation and the integration of electric vehicles (EVs) with buildings connected to clean grids has been touted as one of the key solutions to the global decarbonization challenge. Cities are on the frontlines of current and future electrification, as they depend on and drive electricity generation, distribution, and use. City actors also occupy a central role in the actions to enable electrification to support energy transitions in efficient, equitable, environmentally sound, and resilient ways. Currently, however, research and development on the interactions between actors, cities and energy systems is predominantly conducted in disciplinary siloes. This topical review analyzes the transformational potential of urban electrification. It focuses on efforts to electrify transportation and integrate EVs with buildings connected to a clean grid. We find that actions in these area are driving change; they are adopted by wealthier populations and on an experimental basis by specific communities. Their larger-scale growth is constrained by institutional, behavioral, and infrastructural factors. We also find that existing siloed disciplinary approaches are often incompatible with advancing holistic research. To achieve that, divergent communities of scholars need to come together to integrate their research and create broader perspectives. Through incorporation of the social sciences, these perspectives need to consider the societal limits and potentials brought to bear by human behavior and decision making. Only then can urban electrification be understood as the empirically rich and socially complex topic that it is. And only with this understanding will innovations and smart policy actions be able to tap into the transformational potential of urban electrification.

cities↗
DOE OSTI2023

A gated graph transformer for protein complex structure quality assessment and its performance in CASP15

Abstract Motivation Proteins interact to form complexes to carry out essential biological functions. Computational methods such as AlphaFold-multimer have been developed to predict the quaternary structures of protein complexes. An important yet largely unsolved challenge in protein complex structure prediction is to accurately estimate the quality of predicted protein complex structures without any knowledge of the corresponding native structures. Such estimations can then be used to select high-quality predicted complex structures to facilitate biomedical research such as protein function analysis and drug discovery. Results In this work, we introduce a new gated neighborhood-modulating graph transformer to predict the quality of 3D protein complex structures. It incorporates node and edge gates within a graph transformer framework to control information flow during graph message passing. We trained, evaluated and tested the method (called DProQA) on newly-curated protein complex datasets before the 15th Critical Assessment of Techniques for Protein Structure Prediction (CASP15) and then blindly tested it in the 2022 CASP15 experiment. The method was ranked 3rd among the single-model quality assessment methods in CASP15 in terms of the ranking loss of TM-score on 36 complex targets. The rigorous internal and external experiments demonstrate that DProQA is effective in ranking protein complex structures. Availability and implementation The source code, data, and pre-trained models are available at https://github.com/jianlin-cheng/DProQA.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Quenching, bursting, and galaxy shapes: colour transformation as a function of morphology

ABSTRACT Different mechanisms for quenching star formation in galaxies are commonly invoked in the literature, but the relative impact of each one at different cosmic epochs is still unknown. In particular, the relation between these processes and morphological transformation remains poorly understood. In this work, we measure the effectiveness of changes in star formation rates by analysing a new parameter, the Star Formation Acceleration (SFA), as a function of galaxy morphology. This methodology is capable of identifying both bursting and quenching episodes that occurred in the preceding 300 Myr. We use morphological classification catalogues based on Deep Learning techniques. Our final sample has ∼14 200 spirals and ∼2500 ellipticals. We find that elliptical galaxies in the transition region have median shorter quenching time-scales (τ < 1 Gyr) than spirals (τ ≥ 1 Gyr). This result conforms to the scenario in which major mergers and other violent processes play a fundamental role in galaxy evolution for most ellipticals, not only quenching star formation more rapidly but also playing a role in morphological transformation. We also find that ∼two-thirds of galaxies bursting in the green valley in our sample are massive spirals ($M_\star \ge 10^{11.0}\, \mathrm{M}_\odot$) with signs of disturbance. This is in accordance with the scenario where low-mass galaxies are losing their gas in an interaction with a massive galaxy: while the former is quenching, the last is being refueled and going through a burst, showing signs of recent interaction.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Mapping variations of redshift distributions with probability integral transforms

We present a method for mapping variations between probability distribution functions and apply this method within the context of measuring galaxy redshift distributions from imaging survey data. This method, which we name PITPZ for the probability integral transformations it relies on, uses a difference in curves between distribution functions in an ensemble as a transformation to apply to another distribution function, thus transferring the variation in the ensemble to the latter distribution function. This procedure is broadly applicable to the problem of uncertainty propagation. In the context of redshift distributions, for example, the uncertainty contribution due to certain effects can be studied effectively only in simulations, thus necessitating a transfer of variation measured in simulations to the redshift distributions measured from data. We illustrate the use of PITPZ by using the method to propagate photometric calibration uncertainty to redshift distributions of the Dark Energy Survey Year 3 weak lensing source galaxies. For this test case, we find that PITPZ yields a lensing amplitude uncertainty estimate due to photometric calibration error within 1 per cent of the truth, compared to as much as a 30 per cent underestimate when using traditional methods.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Towards an astronomical foundation model for stars with a transformer-based model

ABSTRACT Rapid strides are currently being made in the field of artificial intelligence using transformer-based models like Large Language Models (LLMs). The potential of these methods for creating a single, large, versatile model in astronomy has not yet been explored. In this work, we propose a framework for data-driven astronomy that uses the same core techniques and architecture as used by LLMs. Using a variety of observations and labels of stars as an example, we build a transformer-based model and train it in a self-supervised manner with cross-survey data sets to perform a variety of inference tasks. In particular, we demonstrate that a single model can perform both discriminative and generative tasks even if the model was not trained or fine-tuned to do any specific task. For example, on the discriminative task of deriving stellar parameters from Gaia XP spectra, we achieve an accuracy of 47 K in Teff, 0.11 dex in log g, and 0.07 dex in [M/H], outperforming an expert XGBoost model in the same setting. But the same model can also generate XP spectra from stellar parameters, inpaint unobserved spectral regions, extract empirical stellar loci, and even determine the interstellar extinction curve. Our framework demonstrates that building and training a single foundation model without fine-tuning using data and parameters from multiple surveys to predict unmeasured observations and parameters is well within reach. Such ‘Large Astronomy Models’ trained on large quantities of observational data will play a large role in the analysis of current and future large surveys.

Leung, Henry W. (ORCID:0000000200362752)↗
DOE OSTI2024

CovTransformer: A transformer model for SARS-CoV-2 lineage frequency forecasting

With hundreds of SARS-CoV-2 lineages circulating in the global population, there is an ongoing need for predicting and forecasting lineage frequencies and thus identifying rapidly expanding lineages. Accurate prediction would allow for more focused experimental efforts to understand pathogenicity of future dominating lineages and characterize the extent of their immune escape. Here, we first show that the inherent noise and biases in lineage frequency data make a commonly-used regression-based approach unreliable. To address this weakness, we constructed a machine learning model for SARS-CoV-2 lineage frequency forecasting, called CovTransformer, based on the transformer architecture. We designed our model to navigate challenges such as a limited amount of data with high levels of noise and bias. We first trained and tested the model using data from the UK and the USA, and then tested the generalization ability of the model to many other countries and US states. Remarkably, the trained model makes accurate predictions two months into the future with high levels of accuracy both globally (in 31 countries with high levels of sequencing effort) and at the US-state level. Our model performed substantially better than a widely used forecasting tool, the multinomial regression model implemented in Nextstrain, demonstrating its utility in SARS-CoV-2 monitoring. Assuming a newly emerged lineage is identified and assigned, our test using retrospective data shows that our model is able to identify the dominating lineages 7 weeks in advance on average before they became dominant. Overall, our work demonstrates that transformer models represent a promising approach for SARS-CoV-2 forecasting and pandemic monitoring.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Neutrino Flavor Transformation in Neutron Star Mergers

Here, we present the first numerical relativity simulations including neutrino flavor transformations that could result from flavor instabilities, quantum many-body effects, or potential beyond standard model physics in neutron star mergers. We find that neutrino flavor transformations impact the composition and structure of the remnant, potentially leaving an imprint on the postmerger gravitational-wave signal. They also have a significant impact on the composition and nucleosynthesis yields of the ejecta.

79 ASTRONOMY AND ASTROPHYSICS↗