Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Transformation of an Embedded Five-Membered Ring in Polycyclic Aromatic Hydrocarbons via the Hydrogen-Abstraction–Acetylene-Addition Mechanism: A Theoretical Study

Five-membered rings are constituents of many polycyclic aromatic hydrocarbons (PAHs) and their presence on the edges of large PAHs has been repeatedly observed experimentally. However, modern kinetic combustion models often do not consider the growth of PAHs through the transformation of the five-membered rings. Here, in connection with the above, we carried out a theoretical study of the mechanism of Hydrogen-Abstraction-aCetylene-Addition (HACA) transformation of an embedded five-membered ring on the armchair PAH edge to a six-membered ring, considering cyclopenta[d,e,f]phenanthrene (4,5-methylenephenanthrene) as a prototype system for this process. The potential energy surface for the reactions of cyclopenta[d,e,f]phenanthrenyl radicals produced by direct H abstractions from cyclopenta[d,e,f]phenanthrene with acetylene has been compiled at the G3(MP2,CC)//B3LYP/6-311G(d,p) level of theory including zero-point vibrational energy corrections. The computed energies and molecular parameters were then used to solve the Rice-Ramsperger-Kassel-Marcus Master Equation (RRKM-ME) in order to calculate reaction rate at various pressures and temperatures, which were fitted to modified Arrhenius equation for further kinetic modeling. The results show that the HACA transformation of the embedded five-membered ring to a six-membered ring is possible, albeit slow. The most viable reaction mechanism involves the R2 + C 2 H 2 reaction, where the acetylene molecules adds to a σ-radical in the six-membered ring adjacent to the five-membered ring via a low entrance barrier. The predominant product of R2 + C 2 H 2 is predicted to be 3 ethynyl 4H cyclopenta[def]phenanthrene Pr5 via immediate H elimination from the initial addition complex. Next, Pr5 undergoes H-assisted isomerization to 4aH-pentaleno[4,3,2,1-cdef]phenanthrene Pr4, and the latter adds an H atom eventually forming the 1-pyrenylmethyl radical Pr3: R2 + C 2 H 2 ⇌ 3 ethynyl 4H cyclopenta[def]phenanthrene (Pr5) + H ⇌ 4aH-pentaleno[4,3,2,1-cdef]phenanthrene (Pr4) + H Pr5 + H ⇌ Pr4 + H Pr4 + H → 1-pyrenylmethyl (Pr3) This HACA sequence may be competitive with the methyl radical addition to the R1 radical formed by H abstraction from the CH 2 group in the five-membered ring of cyclopenta[d,e,f]phenanthrene, which provides a pathway to pyrene following two H atom losses. Relative contributions of the two mechanisms of the five- to six-membered ring transformation would strongly depend on the branching ratios of the R1 and R2 radicals produced by the H abstractions and the available concentration of C 2 H 2 vs. CH 3 and hence differ in different flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Effects of Minor Alloying Elements and Impurities on Long-Range Ordering in Ni-Cr-Based Alloys

There is growing concern about long-range ordered Ni2Cr phase forming during thermal aging of Ni-Cr-based alloys (e.g., 690, 625), which leads to lattice contraction, hardening, and embrittlement, possibly limiting the service life of light water reactor components. The timespan when this phase transformation occurs can vary in orders of magnitude between model and commercial alloys and is likely related to the presence of major (e.g., Fe, Mo) and minor alloying elements (e.g., Ti, Si, Nb). These minor alloying elements have been hypothesized to bind with vacancies and therefore limit diffusion. Contrarily, impurities (e.g., P, S) are believed to enhance vacancy diffusion and accelerate the Ni2Cr phase transformation because of a vacancy drag mechanism. This study implements experimental isothermal aging of model Ni-Cr binary and Ni-Cr-X ternary alloys, where X is Ti, Si, Nb, and P to help understand how each minor alloying element affects the Ni2Cr phase transformation timeline. Synchrotron-based X-ray diffraction and hardness measurements are used to quantify the evolution of the Ni2Cr phase transformation through a variety of short aging times to identify the onset of long-range order. These experimental results are compared to first principles simulations from literature to understand the mechanism by which each element impacts vacancy diffusion and the formation of the long-range ordered phase, Ni2Cr.

36 - MATERIALS SCIENCE↗
DOE OSTI2023

Surface Energies of LaMnO 3 High-Index Surfaces Obtained from Density-Functional Theory

Here, the first six cubic LaMnO 3 high-index surfaces, (210), (211), (221), (310), (311), and (320), are examined for the first time. The unrelaxed and relaxed surface energies of the surfaces are computed as a function of surface model thickness using unrelaxed and relaxed surface models, respectively. The (210), (320), (211), and (221) surfaces are found to be more stable than the low-index (011) and (111) surfaces. Helping to explain this result, the surface terminations of the (210), (320), (211), or (221) surface are seen to exhibit a rotational relaxation of the MnO 6 or oxygen octahedra extending from the surface into the bulk. By contrast, the relaxed surface energies of the (310) and (311) surfaces are concluded to be difficult to determine due to a structural transformation or phase change in the surface models of the surfaces away from cubic LaMnO 3 . The finding of a phase change is important. It indicates that a phase change in the surface models of a surface for another material could occur if the surface is relatively open and a different phase of the material is stable at low temperature. When modeling such a surface, two steps are suggested to be taken.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Data-based filtered dissipation rate modelling for multi-modal turbulent combustion: evaluating a priori model generalizability

Manifold-based models offer a computationally efficient alternative to directly transporting the thermochemical state in computational simulations of turbulent reacting flows, projecting the high-dimensional thermochemical state-space onto a low-dimensional manifold. Recent efforts have yielded a manifold-based model applicable to multi-modal combustion, enabling reconstruction of the thermochemical state from solutions to two-dimensional manifold equations in mixture fraction and generalized progress variable that are parameterised by three scalar dissipation rates. In coarse-grained simulations such as Large Eddy Simulation (LES), closure of the multi-modal manifold equations and subfilter variances/covariance requires closure of three filtered scalar dissipation rates. Here, the present work adopts a data-based approach, providing closure for the three filtered scalar dissipation rates via deep neural networks (DNNs). High-fidelity datasets corresponding to an autoigniting n-dodecane jet flame and a bluff body swirl-stabilized confined lifted spray flame of two aviation fuels (Jet-A and C1) with different ignition propensities are leveraged to generate training data that spans a diverse range of thermodynamic conditions and combustion modes, including low- and high-temperature ignition regimes in addition to premixed and nonpremixed behaviour. A final DNN model is trained to enforce inherent physical constraints by learning nonlinear functional transformations of the three filtered scalar dissipation rates. The generalizability of this constrained DNN model is demonstrated a priori via conditional statistics evaluated on the lifted spray flame with C1–a configuration that had not been included in the training data. Excellent DNN agreement with conditional DNS statistics is observed, and integrated gradients are computed to identify the most sensitive input variables. The similarity of the marginal PDFs of the most informative input variables and outputs across configurations are quantified via the Wasserstein metric, demonstrating that data-based models may successfully generalize to unseen parametric conditions so long as the most informative input variables share similar distributions across training and testing datasets.

Data-based modelling↗
DOE OSTI2021

The predictive skill of convolutional neural networks models for disease forecasting

In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Uncertainty-aware molecular dynamics from Bayesian active learning for phase transformations and thermal transport in SiC

Abstract Machine learning interatomic force fields are promising for combining high computational efficiency and accuracy in modeling quantum interactions and simulating atomistic dynamics. Active learning methods have been recently developed to train force fields efficiently and automatically. Among them, Bayesian active learning utilizes principled uncertainty quantification to make data acquisition decisions. In this work, we present a general Bayesian active learning workflow, where the force field is constructed from a sparse Gaussian process regression model based on atomic cluster expansion descriptors. To circumvent the high computational cost of the sparse Gaussian process uncertainty calculation, we formulate a high-performance approximate mapping of the uncertainty and demonstrate a speedup of several orders of magnitude. We demonstrate the autonomous active learning workflow by training a Bayesian force field model for silicon carbide (SiC) polymorphs in only a few days of computer time and show that pressure-induced phase transformations are accurately captured. The resulting model exhibits close agreement with both ab initio calculations and experimental measurements, and outperforms existing empirical models on vibrational and thermal properties. The active learning workflow readily generalizes to a wide range of material systems and accelerates their computational understanding.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Neutrino Flavor Transformation in Neutron Star Mergers

Here, we present the first numerical relativity simulations including neutrino flavor transformations that could result from flavor instabilities, quantum many-body effects, or potential beyond standard model physics in neutron star mergers. We find that neutrino flavor transformations impact the composition and structure of the remnant, potentially leaving an imprint on the postmerger gravitational-wave signal. They also have a significant impact on the composition and nucleosynthesis yields of the ejecta.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗
DOE OSTI2023

Modeling the co-assembly of binary nanoparticles

Abstract In this work, we present a binary assembly model that can predict the co-assembly structure and spatial frequency spectra of monodispersed nanoparticles with two different particle sizes. The approach relies on an iterative algorithm based on geometric constraints, which can simulate the assembly patterns of particles with two distinct diameters, size distributions, and at various mixture ratios on a planar surface. The two-dimensional spatial-frequency spectra of the modeled assembles can be analyzed using fast Fourier transform analysis to examine their frequency content. The simulated co-assembly structures and spectra are compared with assembled nanoparticles fabricated using transfer coating method are in qualitative agreement with the experimental results. The co-assembly model can also be used to predict the peak spatial frequency and the full-width at half-maximum bandwidth, which can lead to the design of the structure spectra by selection of different monodispersed particles. This work can find applications in fabrication of non-periodic nanostructures for functional surfaces, light extraction structures, and broadband nanophotonics.

Mohanty, Saurav (ORCID:0009000302592855)↗
DOE OSTI2026

TRACE Input Modernization

This work presents a Tom’s Obvious Minimal Language (TOML)-based representation of input for the US Nuclear Regulatory Commission’s TRAC/RELAP Advanced Computational Engine (TRACE) thermal hydraulics code. Implemented using the Workbench Analysis Sequence Processor (WASP), the approach maps traditional TRACE input structures to a hierarchical format composed of named parameters, typed values, and native data collections. The resulting representation preserves TRACE’s existing modeling capabilities while providing a modern, structured interface for model development and management. WASP further extends TOML through a file import directive that supports modular model composition and reusable input organization. In addition, WASP provides extended array data entry convenience with various data repeat and interpolation capabilities. Examples of the new TOML syntax are provided for major TRACE input categories, including hydraulic components, heat structures, control systems, and trip logic. The TOML representation establishes a foundation for improved validation, tooling, automation, and model maintainability while remaining compatible with existing TRACE workflows. To facilitate migration to the TOML-based input format, the TRACE executable now supports conversion of native TRACE input into an intermediate JSON representation. A Python utility subsequently transforms the JSON data into an equivalent TOML model. Lastly, the TRACE executable now supports execution using TOML-formatted input.

Lefebvre, Robert A. [Oak Ridge National Laboratory↗
DOE OSTI2024

A FFT-based mesoscale continuum dislocation mechanics with defect energy: Applications to composites and polycrystals

A crystal plasticity elastoviscoplastic FFT (fast Fourier transform) formulation with a mesoscale continuum field dislocation mechanics model is presented, which incorporates a defect energy density that depends on GND densities and an associated material length scale. This allows to thermodynamically derive internal length scale dependent intra-crystalline backstress and Peach–Koehler force acting on GND densities. The model considers GND density evolution through a filtered numerical spectral approach, which is coupled with stress equilibrium through the elastoviscoplastic FFT algorithm. The discrete Fourier transform (DFT) method together with finite difference (FD) schemes is applied to solve both the backstress tensor and the Fourier–Green operator. Numerical results are first reported for two-phase laminate composites with plastic single crystal channels and elastic precipitates for shear loadings. Channel size effects are simulated and analyzed on the overall and local hardening behaviors during monotonous loadings. In addition, the evolutions of GND densities and the role of their associated backstress on size effects are examined during reversible shear loading. In a second part, the role of the defect energy internal length scale on polycrystal’s hardening during tension–compression is discussed. The results are compared to those obtained using FFT-based continuum field dislocation mechanics without defect energy.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Impacts of Experimentally Obtained Harmonic Spectrums of Residential Appliances on Distribution Feeder: Preprint

This paper focuses on the harmonic load flow study for a set of residential loads and the impacts of the harmonic contents on the distribution feeder. Owing to the increased use of the power electronic based appliances and energy efficient home equipment like the lighting loads, the percentage of non-linear loads has increased in the distribution system which can impact the system performance, loss, and stability. Thus a comprehensive knowledge of their power quality and harmonic analysis is essential to improve the load models, voltage stability assessment, determining possible interactions at harmonic frequencies, protection planning, and the effect of the system impedance. For this study, the household appliances include the lighting, power electronics, resistive, and motor loads with a nominal supply voltage of 120 V single-phase or 240 V split-phase at a nominal frequency of 60 Hz. The harmonic spectrum as obtained from the experimental data is used to solve the harmonic load flow for a detailed secondary network including the distribution transformer extracted from a real distribution feeder's model. Additionally, the impact of the voltage harmonic on a three phase test load is presented through experimental results. The harmonic data of the transformer terminal voltage as obtained from the former load flow study is scaled to generate the source voltage for the three phase configuration of the grid simulator to make the test setup very similar to a real scenario.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Feature Extraction: Improving Remote Sensor Classification of Non-Proliferation

This research focuses on developing algorithms for nuclear non-proliferation detection using remote sensor modeling. To improve the performance of classification models, we implemented a data pipeline with feature extraction. This pipeline takes raw data and transforms it into smaller data points called features that still describe the model. Improving this classification works towards the departments of energy’s missions of ensuring American’s security and prosperity by creating technology that addresses nuclear challenges. To conduct this analysis, we used the Python programming language and some key packages, including tsfresh and TSFEL. Originally tsfresh was selected because it has the most statistical features out of all the packages. Later TSFEL was incorporated due to the additional features it can extract from data, such as temporal and spectral. However, feature extraction becomes challenging in the presence of missing values. In this case, two additional Python packages were added to our workflow, NumPy and pandas, allowing for the feature extraction process to handle unknown values. Our data pipeline was tested on data collected from a simulation that describes the process state of a physical example. The results show the pipeline’s capability to consume and extract a total 17 features from tabular data. Future work includes producing classifications using decision tree-based models such as XGBoost and improving data collection by analyzing feature importance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Bim-to-fea Conversion Program

The purpose of this program is to enable interoperability between BIM-based architectural design software (i.e., Revit, ArchiCAD, AVEVA E3D) to structural analysis software (i.e., SAP2000). The program takes in BIM building model data via the IFC file format, automatically transforms the architectural coordination entities (structural beams, columns, slabs, walls) to structural analysis entities (i.e., finite element space frames and shells), automatically adjusts the connectivity of the structural analysis entities, and finally exports the structural analysis entities as a structural analysis model contained within a new IFC file. For example, a 3D building in Revit can be exported to an IFC file, run through this BIM-to-FEA program, then the exported IFC can be inputted into SAP2000.

Crowder, Nicholas [Idaho National Laboratory (INL)↗
DOE OSTI2020

The Critical Role Of Conversion Cost And Comparative Advantage In Modeling Agricultural Land Use Change

The difference in land use modeling approaches is an important uncertain factor in evaluating future climate scenarios in global economic models. We compare five widely used land use modeling approaches: constrained optimization, constant elasticity of transformation (CET), the additive form of constant elasticity of transformation (ACET), logit, and Ricardian. We demonstrate that the approaches differ not only by the extent of parameter uses but also by the definition of conversion cost and the consideration of comparative advantage implied by land heterogeneity. We develop a generalized hybrid approach that incorporates ACET/logit and Ricardian to account for both conversion cost and comparative advantage. We use this hybrid approach to estimate future climate impacts on agriculture. We find a welfare loss of about 0.38–0.46% of the global GDP. We demonstrate that ignoring land heterogeneity or land conversion costs underestimates climate impacts on agricultural production and welfare.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Anomaly Detection in Connected and Autonomous Vehicle Trajectories Using LSTM Autoencoder and Gaussian Mixture Model

Connected and Autonomous Vehicles (CAVs) technology has the potential to transform the transportation system. Although these new technologies have many advantages, the implementation raises significant concerns regarding safety, security, and privacy. Anomalies in sensor data caused by errors or cyberattacks can cause severe accidents. To address the issue, this study proposed an innovative anomaly detection algorithm, namely the LSTM Autoencoder with Gaussian Mixture Model (LAGMM). This model supports anomalous CAV trajectory detection in the real-time leveraging communication capabilities of CAV sensors. The LSTM Autoencoder is applied to generate low-rank representations and reconstruct errors for each input data point, while the Gaussian Mixture Model (GMM) is employed for its strength in density estimation. The proposed model was jointly optimized for the LSTM Autoencoder and GMM simultaneously. The study utilizes realistic CAV data from a platooning experiment conducted for Cooperative Automated Research Mobility Applications (CARMAs). The experiment findings indicate that the proposed LAGMM approach enhances detection accuracy by 3% and precision by 6.4% compared to the existing state-of-the-art methods, suggesting a significant improvement in the field.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

A Bezier Curve Informed Melt Pool Geometry to Model Additive Manufacturing Microstructures Using SPPARKS

Additive manufacturing is a transformative technology with the potential to manufacture designs which traditional subtractive machining methods cannot. Additive manufacturing offers fast builds at near final desired geometry; however, material properties and variability from part to part remain a challenge for certification and qualification of metallic components. AM induced metallic microstructures are spatially heterogeneous and highly process dependent. Engineering properties such as strength and toughness are significantly affected by microstructure morphologies resulting from the manufacturing process Linking process parameters to microstructures and ultimately to the dynamic response of AM materials is critical to certifying and qualifying AM built parts and components and improving the performance of AM materials. The AM fabrication process is characterized by building parts layer by layer using a selective laser melt process guided by a computer. A laser selectively scans and melts metal according to a designated geometry. As the laser scans, metal melts, fuses, and solidifies forming the final geometry in a layerwise fashion. As the laser heat source moves away, the metal cools and solidifies forming metallic microstructures. This work describes a microstructure modeling application implemented in the SPPARKS kinetic Monte Carlo computational framework for simulating the resulting microstructures. The application uses Bzier curves and surfaces to model the melt pool surface and spatial temperature profile induced by moving the laser heat source; it simulates the melting and fusing of metal at the laser hot spot and microstructure formation and evolution when the laser moves away. The geometry of the melt pool is quite flexible and we explore effects of variances in model parameters on simulated microstructures.

36 MATERIALS SCIENCE↗
DOE OSTI2024

In situ study of microstructure evolution and α → ω phase transition in annealed and pre-deformed Zr under hydrostatic loading

The detailed study of the effect of the initial microstructure on its evolution under hydrostatic compression before, during, and after the irreversible α → ω phase transformation and during pressure release in Zr using in situ x-ray diffraction is presented. Two samples were studied: one is plastically pre-deformed Zr with saturated hardness and the other is annealed. Phase transformation α → ω initiates at lower pressure for a pre-deformed sample but for a volume fraction of ω Zr, c > 0.7, a larger volume fraction is observed for the annealed sample. This implies that the proportionality between the athermal resistance to the transformation and the yield strength in the continuum phase transformation theory is invalid; an advanced version of the theory is outlined. Phenomenological plasticity theory under hydrostatic loading is outlined in terms of microstructural parameters, and plastic strain is estimated. During transformation, the first rule is suggested, i.e., the average domain size, microstrain, and dislocation density in ω Zr for c < 0.8 are functions of the volume fraction, c of ω Zr only, which are independent of the plastic strain tensor prior to transformation and pressure. The microstructure is not inherited during phase transformation. Surprisingly, for the annealed sample, the final dislocation density and the average microstrain after pressure release in the ω phase are larger than for the severely pre-deformed sample. The results suggest that an extended experimental basis is required for the predictive models for the combined pressure-induced phase transformations and microstructure evolutions.

36 MATERIALS SCIENCE↗