Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Digital Signal Processing Using Deep Neural Networks

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer, and correct transmission channel effects, and directly demodulate baseband RF signals.

42 ENGINEERING↗
DOE OSTI2023

Standardized Data to Improve Understanding and Modeling of Soil Nitrogen at Continental Scale

Abstract Nitrogen (N) is a key limiting nutrient in terrestrial ecosystems, but there remain critical gaps in our ability to predict and model controls on soil N cycling. This may be in part due to lack of standardized sampling across broad spatial–temporal scales. Here, we introduce a continentally distributed, publicly available data set collected by the National Ecological Observatory Network (NEON) that can help fill these gaps. First, we detail the sampling design and methods used to collect and analyze soil inorganic N pool and net flux rate data from 47 terrestrial sites. We address methodological challenges in generating a standardized data set, even for a network using uniform protocols. Then, we evaluate sources of variation within the sampling design and compare measured net N mineralization to simulated fluxes from the Community Earth System Model 2 (CESM2). We observed wide spatiotemporal variation in inorganic N pool sizes and net transformation rates. Site explained the most variation in NEON’s stratified sampling design, followed by plots within sites. Organic horizons had larger pools and net N transformation rates than mineral horizons on a sample weight basis. The majority of sites showed some degree of seasonality in N dynamics, but overall these temporal patterns were not matched by CESM2, leading to poor correspondence between observed and modeled data. Looking forward, these data can reveal new insights into controls on soil N cycling, especially in the context of other environmental data sets provided by NEON, and should be leveraged to improve predictive modeling of the soil N cycle.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

On the Use of Smart Meter Data to Estimate the Voltage Magnitude on the Primary Side of Distribution Service Transformers: Preprint

This paper develops a novel method to estimate the voltage magnitude on the primary side of distribution service transformers. The proposed method relies exclusively on smart meters, and therefore it is fully data-driven. This is an important feature because electric utilities have detailed models of only the primary network--that is, the network between the distribution substation and the primary side of service transformers that are installed closer to end-customer sites. The network that connects the secondary side of service transformers to end-customer sites, referred to as the secondary network, is simply represented by a lumped load. For each secondary network, the proposed method uses data acquired from only 2 smart meters: the closest and the farthest--in the sense of electrical distance--from the service transformer. As a reference to this feature, the proposed method is named SM2Vp. To our knowledge, this is the first time a method is shown to provide actionable information for real-time operation and control of power distribution grids using only two smart meters per secondary network. This is important because utilities have experienced barriers in managing and using large data sets for real-time operation and control. SM2Vp is primarily intended to provide pseudo-measurements for distribution system state estimation, but it can also be used directly for voltage control schemes. The performance of SM2Vp is demonstrated by numerical simulations carried out on three secondary network synthetic models and by using field data provided by a utility partner serving customers in southwestern California. A maximum relative error of approximately 3.9% or less is observed for the primary voltage magnitude estimates in all numerical experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Microbial metabolic dependency and its impacts on the soil carbon cycle (Final Technical Report, DE-SC0016364)

The terrestrial biosphere contains a large fraction of global carbon (C) and nearly 70% of the organic C in terrestrial systems is found in soils. Global changes in atmospheric CO 2 , temperature, precipitation, and ecosystem N inputs, will impact primary production and carbon inputs to soils, but it remains difficult to predict soil responses to these environmental conditions. Our ability to predict C-cycle responses to global change remains limited by unexplained variability within the terrestrial C-cycle. Our difficulty in predicting responses of the soil C-cycle to environmental change suggests a need for a greater understanding of the biotic mechanisms that govern soil C-transformations. Changes in microbial community structure and function have been proposed to impact soil processes, but mechanistic connections between microbial activity and C-cycle transformations remain poorly described. We assembled an interdisciplinary team to conduct cross-scale examination of microbial contributions to C-cycle dynamics and C-fate in soils. We investigated microbial contributions to soil C-transformations using a suite of complementary isotopic techniques including DNA-Stable Isotope Probing (DNA-SIP), metagenomic-SIP, metabolomic-SIP, proteomic-SIP, and microspatial analysis of soil organic C. These techniques were deployed in experiments that tested fundamental assumptions that underlie terrestrial C-cycle models. We characterized the functional characteristics of soil microorganisms responsible for major C-transformations in soil, evaluated the metabolic and ecological interactions that underlie soil C-cycle dynamics, and evaluated the degree to which these interactions impact rates of C mineralization and stabilization in soils.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Machine Learning Models for Predicting Molecular UV–Vis Spectra with Quantum Mechanical Properties

Accurate understanding of Ultraviolet–visible (UV–Vis) spectra is critical for highthroughput design of compounds for drug discovery. Experimentally determining UV–Vis spectra can become expensive when dealing with a large quantity of novel molecules. This provides us an opportunity to drive computational advances in molecular property predictions using quantum mechanics and machine learning. In this work, we use both Quantum Mechanically (QM) predicted and measured UV–Vis spectra as input to modify four different machine learning architectures: UVvis-SchNet, UVvis- DTNN, UVvis-Transformer, and UVvis-MPNN. Here we find that the UVvis-MPNN model outperforms the other models when using optimized 3D coordinates and QM predicted spectra as input features. This model has the highest performance for predicting UVVisible spectra with a training RMSE of 0.06 and validation RMSE of 0.08.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Ferromagnetism and doublon localization in a Wannier-Hubbard chain

We derive a “Wannier-Hubbard” model consisting of an array of overlapping atomic orbitals interacting via a local Coulomb interaction. Transforming to an orthogonal Wannier basis set, the resulting Hamiltonian displays long-range hopping and interactions, with new terms such as correlated hopping and ferromagnetic direct exchange, among others. We numerically study the one-dimensional version of the model at half-filling using the density matrix renormalization group method, unveiling a rich phase diagram as a function of the interaction U and the overlap s with metallic and ferromagnetic phases separated by a ferrimagnetic region. Our results indicate a path toward understanding emergent phases under pressure and beyond standard model Hamiltonians.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Computational Workflow of Elucidating Viral Impact on Mediating Microbial Response to In-situ Experimental Warming: Bridging microbial modeling to carbon and mineral modeling

Viruses are abundant in soils and shape microbial communities in ways that can potentially influence ecosystem processes, yet their contributions to carbon cycling and mineral transformations remain poorly understood. Here we present a multi-phase framework that links virus-host interactions to soil biogeochemistry by combining ecological simulations, genome- and community-scale metabolic modeling, and statistical and machine-learning analyses. We first calibrated microbial abundance profiles under explicit infection scenarios to capture how viral pressure alters community structure, then explored alternative interaction strategies, including kill-the-winner, piggyback-the-winner, and mixed lytic-lysogenic modes, through forward simulations. These ecological shifts were translated into metabolic consequences using exchange fluxes summarized into biologically meaningful categories, while integrated statistical and machine-learning screens elevated subtle but consistent signals. Application of this framework revealed that viral infections shift the balance between organic and inorganic fluxes, redirecting metabolism from diffuse organic transformations toward inorganic pools such as protons and CO 2 , directly linking viral regulation to respiration and soil carbon balance. The roll-up analysis also isolated perturbations in critical mineral ions, including magnesium, manganese, zinc, and copper, which serve as essential enzymatic cofactors. In piggyback-the-winner scenarios, uptake of these ions was strongly suppressed. Contrasting viral strategies produced distinct community structures and metabolic outcomes, from broad suppression under kill-the-winner dynamics to dramatic redistributions under high-lytic and high-gain lysogenic regimes that collapsed vulnerable microbial populations while promoting opportunists. Together, these results provide a tractable path to trace viral perturbations from host abundance shifts to metabolic flux adjustments and ecosystem-scale processes, offering a practical way to include viruses in earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Flexible PCB Windings Size Optimization for Winding AC Resistance Minimization Under the Sinusoidal Voltage Regime

In this paper, optimization of the winding AC resistance of the flexible printed circuit board (FPCB) wire windings is performed. A one-dimensional model of the FPCB winding is introduced and an equation for the FPCB winding AC resistance and its low and medium frequency approximation are derived. The approximate FPCB winding AC resistance equation is used to derive optimum thickness of the FPCB winding conductor thickness at which minimum of winding AC resistance (global optimum) is achieved. The Finite Element Method analysis and experimental verification of derived equations (winding resistance, impedance, power loss, and temperature measurements) is performed in order validate derived model and winding resistance equation.

42 ENGINEERING↗
DOE OSTI2022

Electrochemically-Induced Phase Transformations in Battery Storage Compounds (Final Technical Report)

Compounds of interest for ion storage in advanced batteries frequently exhibit phase transformations as the working ion concentration varies. Under large electrochemical driving forces inherent to practical use, systems are often driven far from equilibrium. This program combines experiments and theory to understand the phase transition behavior of ion insertion compounds when electrochemically driven far from equilibrium. As model systems, we focus on alkaline metal phosphates AMPO4 (A = alkali; M = first row transition metal) of olivine structure, which are both technologically interesting and ideally suited for fundamental study due to the ability to systematically tune transformation strain, and along with it, the phase transformation pathway. Behavior in compositions having large transformation strains (~15 vol%) requiring plasticity for strain accommodation is emphasized. Experimental techniques include operando characterization of structure while simultaneously varying electrokinetic parameters, and high resolution microscopy of nanoscale and interfacial phenomena. Phase-field modeling is used to model the thermodynamics and kinetics of competing transformation pathways, extended to include the effects of plasticity, and integrated with porous electrode kinetic theory to treat multi-particle effects. Success in this project will lead to an ability to design ion storage compounds with predictable transformation pathways, electrochemical kinetics, capacity utilization, and durability. New technologically important compounds may also be discovered.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Chemical Modeling of the Capture of Radioiodine Species

Iodine is a common fission product resulting from the transmutation of uranium fuel in nuclear power reactors. The short-lived radioactive isotope, 131 I, with a half-life of around eight days, would be a particular health concern if released into the environment. Capture materials, such as activated carbon, are used routinely in nuclear power plants and medical isotope production facilities to remove this hazard during normal operations to reduce emissions to acceptable levels. Iodine, unlike other common fission products such as noble gases, is challenging because of the wide range of molecular forms and oxidation states (from +VII in IF 7 to -I in iodide) that it displays, which can interconvert both in the gas phase and in the solution phase for example. The work in this project is focused on three computational tasks. In the first, we consider the binding of iodine-containing molecules of varying oxidation states to the major component of activated carbon – pristine graphene-like sheets. The second task focused on molecular binding and possible chemical transformations resulting from the reaction of molecular iodine with chemical functional groups on the edge of the graphene sheets or surface defects in the sheet itself. The final task was associated with radiolytic breakdown of 131 I to 131 Xe in iodine containing molecules and investigated the resulting molecular fragmentation process both in the gas phase and on the graphene-like surface. For each of the tasks, the intent was to learn about the thermodynamics and kinetics of the chemical transformations and use the calculations to provide parameters for input into kinetic models describing these processes for interpretation of experimental data in future work.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2022

More Realistic Intermediate Depth Dry Firn Densification in the Energy Exascale Earth System Model (E3SM)

Abstract Earth system models account for seasonal snow cover, but many do not accommodate the deeper snowpack on ice sheets (aka firn) that slowly transforms to ice under accumulating snowfall. To accommodate and resolve firn depths of up to 60 m in the Energy Exascale Earth System Model's land surface model (ELM), we add 11 layers to its snowpack and evaluate three dry snow compaction equations in multi‐century simulations. After comparing results from ELM simulations (forced with atmospheric reanalysis) with empirical data, we find that implementing into ELM a two‐stage firn densification model produces more accurate dry firn densities at intermediate depths of 20–60 m. Compared to modeling firn using the equations in the (12 layer) Community Land Model (version 5), switching to the two‐stage firn densification model (with 16 layers) significantly decreases root‐mean‐square errors in upper 60 m dry firn densities by an average of 41 kg m −3 (31%). Simulations with three different firn density parameterizations show that the two‐stage firn densification model should be used for applications that prioritize accurate upper 60 m firn air content (FAC) in regions where the mean annual surface temperature is greater than roughly −31°C. Because snow metamorphism, firn density, and FAC are major components in modeling ice sheet surface albedo, melt water retention, and climatic mass balance, these developments advance broader efforts to simulate the response of land ice to atmospheric forcing in Earth system models.

58 GEOSCIENCES↗
DOE OSTI2021

Method and apparatus for shape-based energy analysis of solids

A computer-readable medium stores instructions including storing a model of a physical structure and defining a mesh for the model. The mesh includes finite elements, each defined by a respective set of edges. The instructions include, for each finite element, identifying a governing differential equation and a set of complementary functions that exactly satisfy the governing differential equation. The instructions include determining an applied physical stimulus for the physical structure. The instructions include generating an energy optimization model that minimizes a difference between internal energy and external energy of the finite elements in response to the applied physical stimulus. The model includes a matrix of respective scalar multipliers for the complementary functions for each finite element. The instructions include transforming the matrix and calculating a physical parameter of interest. The instructions include, in response to the physical parameter not satisfying a design parameter, updating the model of the physical structure.

Spears, Robert E.↗
DOE OSTI2025

Tactical Analysis for Calculating Contextual Risk at Boundaries: Summary of Laboratory Directed Research & Development Effort

The Tactical Analysis for Calculating Contextual Risk at Boundaries (TACCRAB) tool is an innovative digital twin (DT) platform and automated risk algorithm designed to transform operational decision-making in structured screening environments, with an initial focus on Southern Border Land Ports of Entry (POEs). The invention provides integration points for advanced artificial intelligence, predictive modeling, and real-time data analysis to produce a comprehensive risk management tool that enables proactive, data-informed security strategies. The core inventive features of TACCRAB center on its unique risk algorithm, which dynamically calculates contextual risk by synthesizing historical data, near real-time streaming data from the checkpoints themselves, and AI-generated predictions. Unlike traditional risk assessment methods, TACCRAB utilizes a DT to provide comprehensive operational insights, allowing stakeholders to visualize, simulate, and optimize checkpoint configurations with unprecedented speed and contextual awareness. TACCRAB's key innovation lies in its ability to combine multiple complex inputs - including technology detection probabilities, resource availability, screening pathway characteristics, and threat actor behavioral patterns - into a unified risk calculation and update these inputs based on changing operational and environmental conditions. By leveraging a DT that continuously updates and learns from linked data, TACCRAB can suggest adaptive mitigation strategies that minimize risk while maintaining operational efficiency. Particularly novel is the platform's approach to decision support, which goes beyond static risk assessment. The DT provides dynamic metrics such as wait times, resource allocation effectiveness, and potential emerging threat scenarios, enabling users to view sophisticated, relevant what-if simulations and optimize checkpoint operations in near real-time. The system's architecture allows for generalized application across different screening environments, such as secure facilities, ports of entry, and soft targets, making it a versatile tool for security and operational management. The invention distinguishes itself through its comprehensive integration of predictive modeling, AI-driven pattern discovery, and user-friendly interface design. By combining these elements, TACCRAB transforms complex risk data into actionable insights, supporting decision-makers at various organizational levels - from booth agents making split-second screening decisions to checkpoint managers optimizing the day's resource allocation to strategic planners managing long-term investments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Insights into Active Sites and Mechanisms of Benzyl Alcohol Oxidation on Nickel–Iron Oxyhydroxide Electrodes

The electrochemical oxidation of bio-derived molecules has recently garnered interest for its potential in opening electrified synthetic pathways toward value-added products. Herein, we investigate the electrochemical conversion of benzyl alcohol (BA) to benzaldehyde and benzoate on nickel–iron (Fe ~ 7–18%) electrodes as a model system to understand reaction mechanisms and environmental conditions that can transform these molecules. Our results indicate a strong correlation between benzyl alcohol oxidation (BAO) onset potentials and Ni(II/III) redox peak positions, highlighting the potential role that lower oxidation states of nickel, i.e., Ni 3+ , can play in BAO catalysis. Our work on the Ni 2+/3+ system complements mechanisms that involve higher oxidation states of Ni as reported by others. We note that the Ni redox position and thus BAO onset is impacted by Fe incorporation during electrochemistry from unpurified electrolytes, which can resemble standard reactor operating conditions. We perform a systematic computational investigation into BAO and provide density functional theory (DFT) insights into how the redox mechanism has been such a prominent focus of alcohol oxidations. This includes the mode of BA adsorption and the nature of the adsorption site; upon conversion of the Ni 2+ surface to active Ni 3+ via hydroxyl deprotonation, BAO is thermodynamically downhill. Our DFT study also introduces the possibility of a vacancy-driven mechanism, though expected to be less prevalent during catalysis than the redox mechanism for a Ni 3+ surface. Through the systematic investigation of experimental reaction conditions and computational free energy thermodynamics, we have gained valuable insights into BAO reaction mechanisms that inform catalytic activity. Our study opens avenues for further design and development of catalyst active sites for the oxidation of related organic molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Effect of Ice Number Concentration on the Evolution of Boundary Layer Clouds During Arctic Marine Cold‐Air Outbreaks

Abstract Marine cold‐air outbreaks (MCAOs) are crucial for Arctic Ocean heat loss, featuring convective cloud rolls that transition into convection cells downstream. Understanding factors controlling this transformation is the key for improving MCAO cloud representation in climate models. This study employs large‐eddy simulations to investigate how cloud ice number concentrations () affect cloud evolution using a case from the Cold‐Air Outbreaks in the Marine Boundary Layer Experiment (COMBLE) campaign. The simulations, performed in a Lagrangian framework following an air mass trajectory, are driven by ERA5 reanalysis data. Initially, all simulations produce similar cloud patterns, but higher leads to earlier breakup of cloud rolls. Between 4 and 10 hr, surface precipitation rates are similar across simulations, but precipitation initiates earlier, and the cloud‐base precipitation rates are higher when is higher. The stronger precipitation evaporation leads to increased stability of the boundary layer and reduced intensity of vertical mixing between the surface and cloud layer. An increased sink of cloud layer moisture via precipitation and decreased source through diminished vertical transport result in earlier cloud breakup in higher conditions. Simulations with different sea surface temperatures (SST) indicate that this cloud breakup mechanism remains valid for MCAOs of different strengths, although the cloud organization is more sensitive to SST changes in low environments. This work highlights the importance of accurate representations of ice processes in simulating MCAO clouds and suggests the need for observational constraints of ice nucleating particles and over the mixed‐phase cloud regimes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Microbes and Climate Change: a Research Prospectus for the Future

Climate change is the most serious challenge facing humanity. Microbes produce and consume three major greenhouse gases—carbon dioxide, methane, and nitrous oxide—and some microbes cause human, animal, and plant diseases that can be exacerbated by climate change. Hence, microbial research is needed to help ameliorate the warming trajectory and cascading effects resulting from heat, drought, and severe storms. We present a brief summary of what is known about microbial responses to climate change in three major ecosystems: terrestrial, ocean, and urban. We also offer suggestions for new research directions to reduce microbial greenhouse gases and mitigate the pathogenic impacts of microbes. These include performing more controlled studies on the climate impact on microbial processes, system interdependencies, and responses to human interventions, using microbes and their carbon and nitrogen transformations for useful stable products, improving microbial process data for climate models, and taking the One Health approach to study microbes and climate change.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Binary Optimal Control of Single-Flux-Quantum Pulse Sequences

We introduce a binary, relaxed gradient, trust-region method for optimizing pulse sequences for single flux quanta (SFQ) control of a quantum computer. The pulse sequences are optimized with the goal of realizing unitary gate transformations. Each pulse has a fixed amplitude and duration. Here we model this process as an binary optimal control problem, constrained by Schrödinger’s equation, where the binary variables indicate whether each pulse is on or off. We introduce a first-order trust-region method, which takes advantage of a relaxed gradient to determine an optimal pulse sequence that minimizes the gate infidelity, while also suppressing leakage to higher energy levels. The proposed algorithm has a computational complexity of O(p log(p)), where p is the number of pulses in the sequence. We present numerical results for the H and X gates, where the optimized pulse sequences give gate fidelity’s better than 99.9%, in ≈ 25 trust-region iterations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

UBW (USLCI-Brightway2) [SWR-25-169]

Life cycle inventory (LCI) data are critical for robust life cycle assessment (LCA), yet many widely used datasets such as the U.S. Life Cycle Inventory (USLCI) are not natively compatible with advanced modeling frameworks like Brightway2. This work presents an automated pipeline to transform USLCI data into a fully functional Brightway2 project. The workflow performs systematic data cleaning, resolves duplicate process and exchange identifiers, and applies allocation to multi-output processes. Technosphere and biosphere flows are harmonized through unit conversions and a bridge mapping to the biosphere3 database, with comprehensive logging of missing flows and cutoff issues. The resulting Brightway2 database is validated using matrix diagnostics to ensure consistency of the technosphere, and is benchmarked via life cycle impact assessment (LCIA) methods such as ReCiPe and IPCC GWP. Outputs include reproducible CSV exports of corrected processes, elementary flows, characterization factors, and LCIA results, alongside backup utilities for project sharing. This pipeline lowers barriers for integrating USLCI data into open-source LCA workflows, enabling reproducible, validated LCA inventories within the Brightway 2 framework.

Ghosh, Tapajyoti [National Laboratory of the Rocki↗