SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

All sources NASA NTRS DOE OSTI

NASA NTRS1993

Numerical Model for Isothermal and Non-Isothermal Crystallization of Liquids and Glasses

A new numerical model of isothermal and non-isothermal first order phase transformations, such as the crystallization of liquids and glasses, is presented. This model computes directly the volume fraction transformed, taking into account time-dependent nucleation rates and cluster-size-dependent growth velocities. The model is applied to the crystallization of lithium disilicate glass, using the appropriate kinetic and thermodynamic parameters. The model is used (1) to determine the validity of common methods for computing the volume fraction transformed as a function of time in isothermal experiments when a time-dependent nucleation rate is expected, (2) to simulate non-isothermal differential scanning calorimetry (DSC) studies of glass devitrification as a function of scan rate, and (3) to compute the effect of preannealing on the DSC peak parameters. A novel behavior of the nucleation rate with scan rate is predicted, arising because the relaxation of the cluster distribution cannot be described by a single relaxation time. Comparisons of the calculations with experimental data on this glass demonstrate the validity of the model.

Kelton, K. F.↗

NASA NTRSDate not supplied

Derivation of Integrated Load Distributions from Resampled Computational Data

Principal component analysis (PCA) has been the center of many surrogate models used to characterize fluid flows in recent years. However, little work has been done to character- ize the uncertainty in the PCA transform itself and its effect on derived surrogate models. To explore the uncertainty, a typical interpolated surrogate model is constructed for a represen- tative aerodynamic body from computational data. The computational data is then resampled to explore the robustness of the PCA transformation. The variations of the model predictions during this resampling are analyzed to get a measure of confidence in the PCA transformation, which is then applied to the interpolated surrogate model to get uncertainty on integrated force predictions. An initial test case has been explored with promising results.

Principal Component Analysis↗

NASA NTRSDate not supplied

Derivation of Integrated Load Distributions from Resampled Computational Data

Computational Fluid Dynamics↗

DOE OSTI2024

ATAT: Astronomical Transformer for time series and Tabular data

Context. The advent of next-generation survey instruments, such as theVera C. RubinObservatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. Aims. Our aim is to develop a next-generation model for the classification of variable astronomical objects. We describe ATAT, the Astronomical Transformer for time series And Tabular data, a classification model conceived by the ALeRCE alert broker to classify light curves from next-generation alert streams. ATAT was tested in production during the first round of the ELAsTiCC campaigns. Methods. ATAT consists of two transformer models that encode light curves and features using novel time modulation and quantile feature tokenizer mechanisms, respectively. ATAT was trained on different combinations of light curves, metadata, and features calculated over the light curves. We compare ATAT against the current ALeRCE classifier, a balanced hierarchical random forest (BHRF) trained on human-engineered features derived from light curves and metadata. Results. When trained on light curves and metadata, ATAT achieves a macro F1 score of 82.9 ± 0.4 in 20 classes, outperforming the BHRF model trained on 429 features, which achieves a macro F1 score of 79.4 ± 0.1. Conclusions. The use of transformer multimodal architectures, combining light curves and tabular data, opens new possibilities for classifying alerts from a new generation of large etendue telescopes, such as theVera C. RubinObservatory, in real-world brokering scenarios.

Astronomy & Astrophysics↗

NASA NTRS1993

Spectroscopic studies of model polar stratospheric cloud films

Fourier transform infrared (FTIR) spectroscopy has been used to study nitric-acid/ice films representative of type I polar stratospheric clouds (PSCs). These studies reveal that in addition to amorphous nitric acid/ice mixtures, there are three stable stoichiometric hydrates of nitric acid: nitric-acid monohydrate (NAM), dihydrate (NAD), and trihydrate (NAT). We also observe two distinct crystalline forms of the trihydrate, which we denote alpha- and beta-NAT. These two forms appear to differ in their concentration of crystalline defects, but not in their chemical composition. In addition to probing the composition of type I PSCs, we have also used FTIR spectroscopy to study the interaction of HCl with model PSC films. In this work we find that for HCl pressures in the range 10 exp -5 to 10 exp -7 Torr, HCl is taken up by ice at 155 K to form a thin layer of HCl.6H2O. At 193 K, the uptake of HCl by ice was consistent with less than or equal to monolayer coverage. Uptake of HCl by alpha and beta-NAT at 175 K was also consistent with less than or equal to monolayer coverage.

Tolbert, Margaret A.↗

DOE OSTI2024

Model associated with: "Thermodynamic control on the decomposition of organic matter across different electron acceptors"

This model data package is associated with the publication “Thermodynamic control on the decomposition of organic matter across different electron acceptors” submitted to Soil Biology and Biochemistry (Zheng et al., 2023; https://doi.org/10.1016/j.soilbio.2024.109364).In this research, a thermodynamic modeling framework is built to flexibly incorporate both organic matter (OM) molecules and electron acceptors for estimating potential free energy release from various redox reactions and to further predict reaction rates based on Microbial Transition State Theory. The model package includes scripts for thermodynamic modeling and postprocessing. Input Fourier-transform ion cyclotron resonance (FTICR) data are from a previous experimental study (Boye et al., 2018), and model outputs are free energy predictions and stoichiometric coefficients associated with all possible redox reactions.This data package is associated with the project GitHub repository found at MM_bioenergetic_modeling.This data package contains four folders (Input_FTICR, Model, Output, and Output_processing), a file-level metadata (FLMD) csv, and a data dictionary (dd) csv. Please see Zheng_bioenergetic_modeling_flmd.csv for a list of all files contained in this data package and descriptions for each. The Zheng_bioenergetic_modeling_dd.csv file describes the csv column headers. The “Model” folder contains scripts to run energy balance calculations for each electron acceptor. The “Output” folder contains csv files with stoichiometric information from model simulations. And the "Output_processing" folder contains scripts for reaction rate calculations and to generate plots.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

Testing the Predictive Capability of the High-Fidelity Generalized Method of Cells Using an Efficient Reformulation

The High-Fidelity Generalized Method of Cells is a new micromechanics model for unidirectionally reinforced periodic multiphase materials that was developed to overcome the original model's shortcomings. The high-fidelity version predicts the local stress and strain fields with dramatically greater accuracy relative to the original model through the use of a better displacement field representation. Herein, we test the high-fidelity model's predictive capability in estimating the elastic moduli of periodic composites characterized by repeating unit cells obtained by rotation of an infinite square fiber array through an angle about the fiber axis. Such repeating unit cells may contain a few or many fibers, depending on the rotation angle. In order to analyze such multi-inclusion repeating unit cells efficiently, the high-fidelity micromechanics model's framework is reformulated using the local/global stiffness matrix approach. The excellent agreement with the corresponding results obtained from the standard transformation equations confirms the new model's predictive capability for periodic composites characterized by multi-inclusion repeating unit cells lacking planes of material symmetry. Comparison of the effective moduli and local stress fields with the corresponding results obtained from the original Generalized Method of Cells dramatically highlights the original model's shortcomings for certain classes of unidirectional composites.

Arnold, Steven M.↗

DOE OSTI2019

Native Plasmid-Encoded Mercury Resistance Genes Are Functional and Demonstrate Natural Transformation in Environmental Bacterial Isolates

Plasmid-mediated horizontal gene transfer (HGT) is a major driver of genetic diversity in bacteria. We experimentally validated the function of a putative mercury resistance operon present on an abundant 8-kbp native plasmid found in groundwater samples without detectable levels of mercury. Phylogenetic analyses of the plasmid-encoded mercury reductases from the studied groundwater site show them to be distinct from those reported in proximal metal-contaminated sites. We synthesized the entire native plasmid and demonstrated that the plasmid was sufficient to confer functional mercury resistance in Escherichia coli . Given the possibility that natural transformation is a prevalent HGT mechanism in the low-cell-density environments of groundwaters, we also assayed bacterial strains from this environment for competence. We used the native plasmid-encoded metal resistance to design a screen and identified 17 strains positive for natural transformation. We selected 2 of the positive strains along with a model bacterium to fully confirm HGT via natural transformation. From an ecological perspective, the role of the native plasmid population in providing advantageous traits combined with the microbiome’s capacity to take up environmental DNA enables rapid adaptation to environmental stresses. Horizontal transfer of mobile genetic elements via natural transformation has been poorly understood in environmental microbes. Here, we confirm the functionality of a native plasmid-encoded mercury resistance operon in a model microbe and then query for the dissemination of this resistance trait via natural transformation into environmental bacterial isolates. We identified 17 strains including Gram-positive and Gram-negative bacteria to be naturally competent. These strains were able to successfully take up the plasmid DNA and obtain a clear growth advantage in the presence of mercury. Our study provides important insights into gene dissemination via natural transformation enabling rapid adaptation to dynamic stresses in groundwater environments.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

ssys

`ssys` is a Python toolkit for exact algebraic transformation of ordinary differential equation (ODE) models into canonical S-system or Generalized Mass Action (GMA) form. Given a model in Antimony or SBML format, `ssys` produces a mathematically equivalent representation. The transformation introduces auxiliary variables as needed to decompose a broad class of nonlinearities into products of power-law terms. The recast is exact: the original and transformed systems have identical dynamics on the invariant constraint manifold defined by auxiliary variable definitions, given consistent initial conditions.

Hlavacek, William [Los Alamos National Laboratory]↗

DOE OSTI2023

Coupled chemo-mechanical modeling of point-defect diffusion in a crystal plasticity fast Fourier transform framework

Below the yield strength and at moderate-to-high homologous temperatures, the inelastic deformation of metals is mostly governed/rate-controlled by vacancy diffusion-mediated processes. As a function of grain size, stress, temperature and dislocation content, vacancies (or atoms) can adopt preferential diffusion paths across grain interiors, along grain boundaries, or towards and along dislocations, resulting in climb and self-climb. In the steady state and under constant load, grain boundary and grain bulk vacancy diffusion-mediated plasticity have been described in seminal works by Coble and by Nabarro and Herring, respectively. Yet, the interplay between all aforementioned potential diffusion pathways has not been comprehensively mapped. This work presents a thermodynamically-consistent full-field model integrated within a voxel-based elasto-viscoplastic fast Fourier transform framework, which considers the coupling between the diffusion-mediated plasticity mechanisms. In the proposed approach, the kinetics and kinematics of plastic deformation due to vacancy diffusion along grain boundaries and grain bulk, as well as the exchange between grain boundaries and bulk are described explicitly. A homogenization approach at the voxel level is further introduced to simultaneously consider bulk and grain boundary diffusion in a numerically efficient fashion. The new formulation predicts the expected strain rate dependencies and the scaling of the steady-state creep rate with respect to grain size, temperature, and stress. Finally, the model predicts the transition from grain bulk to grain boundary-dominated diffusion with reduction in grain size, a significant step towards capturing transitions in deformation behavior without any phenomenological or ad-hoc adjustments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

JGI Plant Transformation Workshop, May 20-21, 2025

Domestic biomass crops such as sorghum, switchgrass, Miscanthus, and poplar can provide United States industries with renewable feedstocks while also supporting low-input farming systems and strengthening supply chains for biofuels, biochemicals and biomaterials. The U.S. leads globally in biomass crop genomics, yet progress in engineering traits is constrained by slow, genotype-dependent transformation methods and lengthy Design-Build-Test-Learn (DBTL) cycles. At a May 2025 workshop, a panel of experts recommended establishing a DOE Plant Transformation Capability (PTC) to overcome these barriers. The PTC would unite two missions: advancing research to achieve genotype-independent, automated methods, and delivering scalable transformation services through a user-facility model. With expected gains of 10–100x in efficiency, including transformation and cost reduction, the PTC would accelerate the path from discovery to engineered plants, expand community access and training, and support downstream applications and workflows including field trials and regulatory navigation. By enabling rapid and predictable crop engineering, the PTC would strengthen U.S. supply chains, enhance industrial competitiveness, and ensure that DOE’s genomic investments deliver national impact.

09 BIOMASS FUELS↗

DOE OSTI2022

Phase-field framework with constraints and its applications to ductile fracture in polycrystals and fatigue

Abstract Modeling of ductile fracture in polycrystalline structures is challenging, since it requires integrated modeling of cracks, crystal plasticity, and grains. Here we extend the typical phase-field framework to the situations with constraints on the order parameters, and formulate two types of phase-field models on ductile fracture. The Type-I model incorporates three sets of order parameters, which describe the distributions of cracks, plastic strain, and grains, respectively. Crystal plasticity is employed within grain interiors accommodated by J 2 plasticity at grain boundaries. The applications of the Type-I model to single crystals and bicrystals demonstrate the influences of grain orientations and grain boundaries on crack growth. In the Type-II model, J 2 plasticity is assumed for the whole system and grain structures are neglected. Taking advantage of the efficiency of the fast Fourier transform, our Type-II model is employed to study low cycle fatigue. Crack closure and striation-like patterning of plastic strain are observed in the simulations. Crack growth rate is analyzed as a function of the J -integral, and the simulated fatigue life as a function of plastic strain agrees with the Coffin–Manson relation without a priori assumption.

36 MATERIALS SCIENCE↗

NASA NTRS2005

A Tool for Requirements-Based Programming

Absent a general method for mathematically sound, automated transformation of customer requirements into a formal model of the desired system, developers must resort to either manual application of formal methods or to system testing (either manual or automated). While formal methods have afforded numerous successes, they present serious issues, e.g., costs to gear up to apply them (time, expensive staff), and scalability and reproducibility when standards in the field are not settled. The testing path cannot be walked to the ultimate goal, because exhaustive testing is infeasible for all but trivial systems. So system verification remains problematic. System or requirements validation is similarly problematic. The alternatives available today depend on either having a formal model or pursuing enough testing to enable the customer to be certain that system behavior meets requirements. The testing alternative for non-trivial systems always have some system behaviors unconfirmed and therefore is not the answer. To ensure that a formal model is equivalent to the customer s requirements necessitates that the customer somehow fully understands the formal model, which is not realistic. The predominant view that provably correct system development depends on having a formal model of the system leads to a desire for a mathematically sound method to automate the transformation of customer requirements into a formal model. Such a method, an augmentation of requirements-based programming, will be briefly described in this paper, and a prototype tool to support it will be described. The method and tool enable both requirements validation and system verification for the class of systems whose behavior can be described as scenarios. An application of the tool to a prototype automated ground control system for NASA mission is presented.

Rash, James L.↗

NASA NTRS1989

Model reduction in the physical coordinate system

In the dynamics modeling of a flexible structure, finite element analysis employs reduction techniques, such as Guyan's reduction, to remove some of the insignificant physical coordinates, thus producing a dynamics model that has smaller mass and stiffness matrices. But this reduction is limited in the sense that it removes certain degrees of freedom at a node points themselves in the model. From the standpoint of linear control design, the resultant model is still too large despite the reduction. Thus, some form of the model reduction is frequently used in control design by approximating a large dynamical system with a fewer number of state variables. However, a problem arises from the placement of sensors and actuators in the reduced model, because a model usually undergoes, before being reduced, some form of coordinate transformations that do not preserve the physical meanings of the states. To correct such a problem, a method is developed that expresses a reduced model in terms of a subset of the original states. The proposed method starts with a dynamic model that is originated and reduced in finite element analysis. Then the model is converted to the state space form, and reduced again by the internal balancing method. At this point, being in the balanced coordinate system, the states in the reduced model have no apparent resemblance to those of the original model. Through another coordinate transformation that is developed, however, this reduced model is expressed by a subset of the original states.

Yae, K. Harold↗

DOE OSTI2024

Kinetics of HCP-BCC Phase Transition Boundary in Magnesium at High Pressure

Under high pressures, many crystalline metals undergo solid–solid phase transformations. In order to accurately model the behavior of materials under extreme loading conditions, it is essential to understand the kinetics of phase transition. Using molecular dynamics simulations, this work demonstrates the feasibility of characterizing the speeds of a moving phase boundary using atomistic simulations employing a suitable empirical potential for single-crystal magnesium. The model can provide temperature- and tensorial stress-dependent velocity of a moving phase boundary as a rate-limiting contribution to the kinetics of phase transformation in continuum codes. Results demonstrate that a nonlinear interaction exists between plasticity and phase transition, facilitating a jump in the velocity of a moving phase boundary, facilitated by activated plastic deformation mechanisms.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

DOE OSTI2022

Competing ionization and dissociation in the H 2 gerade system

A numerically solvable two-dimensional (2D) model, employed by the authors to study the dissociative recombination of H$^+_2$ in the ungerade symmetry, is extended to describe the collision process in the gerade symmetry of H$_2$. In this symmetry, the ionization and dissociation processes are driven primarily by the direct, curve-crossing mechanism. The model is represented by a set of three coupled electronic channels in 2D, in the space of $\textit{s, p, d}$ partial waves of the colliding electron. In this work, we demonstrate that the Born-Oppenheimer properties of the H$_2$ molecule in the relevant range of internuclear distances can be described by such a model. The molecular rotational degrees of freedom are accounted for by the rotational frame transformation. The numerical solution of the model is discussed, and the resulting rovibrationally inelastic and dissociative recombination cross sections are compared with the available data.

74 ATOMIC AND MOLECULAR PHYSICS↗