Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Distinct Gas-Particle Partitioning and Viscosity Characteristics of Secondary Organic Aerosols Derived from α-Pinene versus Ocimene

Secondary organic aerosols (SOA) have complex, multicomponent composition that controls particle viscosity and gas-particle partitioning, key factors to their atmospheric evolution. This study investigates the chemical composition, volatility and viscosity of SOA formed by ozonolysis of cyclic α-pinene (PSOA) and acyclic ocimene (OSOA) monoterpenes. Using Temperature-Programmed Desorption combined with Direct Analysis in Real-Time ionization and High-Resolution Mass Spectrometry, we determined the molecular composition and saturation mass concentration of individual SOA constituents. These data enabled gas-particle partitioning and viscosity estimates under varied atmospheric conditions. PSOA, composed of higher molecular weight and less oxidized species, shows higher condensability and viscosity under high total organic mass (tOM) loadings. Here, in contrast, OSOA, consisting of more oxidized, lower molecular weight species, exhibits greater sensitivity to tOM, with viscosity increasing significantly upon dilution. Poke-flow experiments support this trend, indicating that OSOA undergoes more dynamic compositional and phase changes during atmospheric aging. These observations reveal distinct dynamic trends in the atmospheric transformations and reactivity of SOA from cyclic and acyclic monoterpenes, with the latter showing greater compositional changes during aging that alter viscosity and diffusion. This highlights the importance of incorporating such dynamic transformations into atmospheric models to improve predictions of SOA atmospheric loadings, lifetimes, and impacts.

cyclic and acyclic monoterpenes↗
DOE OSTI2024

Learning protocols for the fast and efficient control of active matter

Exact analytic calculation shows that optimal control protocols for passive molecular systems often involve rapid variations and discontinuities. However, similar analytic baselines are not generally available for active-matter systems, because it is more difficult to treat active systems exactly. Here we use machine learning to derive efficient control protocols for active-matter systems, and find that they are characterized by sharp features similar to those seen in passive systems. We show that it is possible to learn protocols that effect fast and efficient state-to-state transformations in simulation models of active particles by encoding the protocol in the form of a neural network. We use evolutionary methods to identify protocols that take active particles from one steady state to another, as quickly as possible or with as little energy expended as possible. Our results show that protocols identified by a flexible neural-network ansatz, which allows the optimization of multiple control parameters and the emergence of sharp features, are more efficient than protocols derived recently by constrained analytical methods. Our learning scheme is straightforward to use in experiment, suggesting a way of designing protocols for the efficient manipulation of active matter in the laboratory.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

Deep learning forecasts the spatiotemporal evolution of fluid-induced microearthquakes

Microearthquakes generated by subsurface fluid injection record the evolving stress state and permeability of reservoirs. Forecasting their spatiotemporal evolution is therefore critical for applications such as enhanced geothermal systems, carbon dioxide sequestration and other geoengineering applications. Here we propose a transformer neural network model that ingests hydraulic stimulation history and prior microearthquake observations to forecast four key quantities: cumulative microearthquake count, cumulative logarithmic seismic moment, and the 50th- and 95th-percentile extents of the microearthquake cloud. Applied to the EGS Collab Experiment 1 dataset, the model achieves R2 > 0.98 for the 1-s forecast horizon and R2 > 0.88 for the 15-s forecast horizon across all targets, and supplies uncertainty estimates through a learned standard deviation term. These accurate, uncertainty-quantified forecasts enable real-time inference of fracture propagation and permeability evolution, demonstrating the strong potential of deep-learning approaches to improve seismic-risk assessment and guide mitigation strategies in future fluid-injection operations.

Chung, Jaehong↗
DOE OSTI2026

An algebraic convolution formulation for multiple-scattering correction in small-angle neutron scattering

Multiple scattering in small-angle neutron scattering (SANS) redistributes spectral weight and distorts structural interpretation, particularly for thick or strongly scattering samples. We develop a finite-dimensional spectral desmearing framework that corrects multiple scattering without resorting to integral transforms or model-dependent extrapolation. The primary intensity is expanded in an orthonormal basis adapted to the isotropic transverse-momentum measure, under which convolution reduces to a recursive tensor contraction, allowing the Poisson-weighted multiple-scattering series to be evaluated directly in a finite-dimensional basis representation. This formulation yields a stable forward–inverse mapping between apparent and primary spectra. Numerical tests demonstrate convergence under repeated convolution and accurate recovery of the single-scattering intensity. Application to SANS measurements collected at multiple neutron facilities, including the Spallation Neutron Source, the High Flux Isotope Reactor, and the Institut Laue-Langevin, shows the quantitative reconstruction of the underlying primary spectrum across a wide range of transmission conditions, including strongly attenuating samples. Here, the method provides a stable, model-agnostic framework for multiple-scattering correction in SANS and enables consistent structural interpretation across instruments and scattering regimes.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗
DOE OSTI2023

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Ring artifact reduction via multiscale nonlocal collaborative filtering of spatially correlated noise

X-ray micro-tomography systems often suffer severe ring artifacts in reconstructed images. These artifacts are caused by defects in the detector, calibration errors, and fluctuations producing streak noise in the raw sinogram data. In this work, these streaks are modeled in the sinogram domain as additive stationary correlated noise upon logarithmic transformation. Based on this model, a streak removal procedure is proposed where the Block-Matching and 3-D (BM3D) filtering algorithm is applied across multiple scales, achieving state-of-the-art performance in both real and simulated data. Specifically, the proposed fully automatic procedure allows for attenuation of streak noise and the corresponding ring artifacts without creating major distortions common to other streak removal algorithms.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

MapsTorch : automatic differentiation for X-ray fluorescence data analysis

X-ray fluorescence (XRF) is a popular spectroscopy technique for elemental analysis. Spectrum fitting and parameter tuning are at the core of XRF analysis and are conventionally manually intensive, especially for synchrotron experiments involving large amounts of diverse samples. This work introduces the automatic differentiation (AD) technique to XRF and an open-source package called MapsTorch. By transforming an analytical model of the XRF spectrum into a differentiable computation graph with AD, MapsTorch enables robust optimization of parameters and elemental intensities. We evaluate MapsTorch by conducting computational experiments on a large number of historical synchrotron XRF datasets and compare its performance with the currently practiced fitting tool NLopt. The results show that MapsTorch consistently achieves high-quality fits and often leads to better fitting quality than NLopt, particularly in tasks such as initial spectrum fitting and elemental intensity refinement. The robust performance of MapsTorch paves the way for developing automated and high-throughput XRF data analysis workflows to handle the increasing data volumes expected from next-generation synchrotron facilities.

X-ray fluorescence↗
DOE OSTI2024

A Deep Learning Approach for In-Network Synchrophasor Missing Data Recovery Using Programmable Network Switches

Phasor measurement unit (PMU) networks deliver accurate and timely measurements, which is essential for managing today’s electric power systems. To ensure data quality and enhance the cyber-resilience of PMU networks against malicious attacks and data errors, this study presents an online PMU missing data recovery scheme by leveraging P4 programmable switches. The data plane incorporates a customized PMU protocol parser that abstracts the necessary payload data for recovery. Recovery processes are executed in the control plane using a pre-trained machine learning model. Both traditional and advanced ML models, such as transformer and TimeGPT, are explicitly employed for data prediction. This approach ensures rapid and precise data recovery. Performance evaluations focus on recovery speed and accuracy, using a real dataset from a campus microgrid. With 20% missing PMU data, the mean absolute percentage error for voltage magnitude is 0.0384%, and the phase angle error discrepancy is approximately 0.4064%.

Phasor Measurement Unit, Machine Learning, Program↗
DOE OSTI2023

Inorganic Hydrogeochemistry in the 21st Century

Abstract Chemical and isotopic processes occur in every segment of the hydrological cycle. Hydrogeochemistry—the subdiscipline that studies these processes—has seen a transformation from “witch's brew” to credible science since 2000. Going forward, hydrogeochemical research and applications are critical to meeting urgent societal needs of climate change mitigation and clean energy, such as (1) removing CO 2 from the atmosphere and storing gigatons of CO 2 in soils and aquifers to achieve net‐zero emissions, (2) securing critical minerals in support of the transition from fossil fuels to renewable energies, and (3) protecting water resources by adapting to a warming climate. In the last two decades, we have seen extensive activity and progress in four research areas of hydrogeochemistry related to water‐rock interactions: arsenic contamination of groundwater; the use of isotopic and chemical tracers to quantify groundwater recharge and submarine groundwater discharge; the kinetics of chemical reactions and the mineral‐water interface's control of contaminant fate and transport; and the transformation of geochemical modeling from an expert‐only exercise to a widely accessible tool. In the future, embracing technological advances in machine learning, cyberinfrastructure, and isotope analytical tools will allow breakthrough research and expand the role of hydrogeochemistry in meeting society's needs for climate change mitigation and the transition from fossil fuels to renewable energies.

Zhu, Chen (ORCID:0000000153746787)↗
DOE OSTI2025

Host Onboarding Tool (HObT) v1.0.0

The Host OnBoarding Tool (Hobt) is a publicly accessible, web-based software designed to organize and share information about microbial hosts under development at the Agile BioFoundry (ABF). It streamlines the assessment, tracking, and sharing of information related to microbial host development and provides a centralized platform where users can rapidly evaluate hosts' readiness for various bio processes. HObT leverages the Tier System, a standardized host development framework that organizes and assesses microbial hosts based on their readiness for biomanufacturing. Each tier outlines key targets—including genetic tools, growth conditions, omics data, and predictive models—needed to transform new or emerging microbes into established production platforms. By applying clear criteria for advancement, the Tier System helps users quickly evaluate each organism's current development status, identify gaps in available knowledge or tools, and prioritize future strain improvement efforts. Through its user-friendly interface, HObT encourages contributions of new data and insights from researchers, fostering collaboration and accelerating host development. By providing structured guidance for microbial strain advancement, HObT and the Tier System support more systematic, rapid, and cost-effective development of non-traditional microbial hosts, ultimately enhancing the efficiency and impact of biomanufacturing research and applications.

Plahar, Hector [Lawrence Berkeley National Laborat↗
DOE OSTI2025

Atmospheric Profile Builder

APBuilder is a software tool designed to generate atmospheric profiles for use with AC2Dr by downloading weather model data and transforming it into 1D or 2D binary profiles. These binary profiles serve as required inputs for AC2Dr, an LLNL-developed, open source, two-dimensional numerical solver for the acoustic wave equation based on the finite difference method.

Kim, Keehoon [Lawrence Livermore National Laborato↗
DOE OSTI2026

?hem-GPT series of AI models

A suite of chemistry GPT models built using Transform Your World are available at DOI, from which one example is mirrored on Hugging Face. https://huggingface.co/asalij/Xhem-GPT-2

Salij, Andrew↗
DOE OSTI2020

An Automatic Learning Framework for Smart Residential Communities

Predictability has been foundational to matching supply and demand in the day-to-day operation of the electric power system. Demand predictability is eroding because of the increased use of renewable energy resources and more sophisticated loads, such as electric vehicles and smart appliances. In this paper, an automatic software framework is described which can be used for load forecasting in smart communities. A time-varying clustering-based Markov chain approach is used to predict the energy consumption of residential buildings in a smart community. The training data is based on 1-minute meter data of occupied homes over one month. The data points are first clustered based on the energy consumption and the time of the day. Then, the original data is converted using the Centroids of the clusters. A time-varying Markov chain is subsequently trained to model the energy consumption behavior of residents for each home using the transformed data. The trained model is shown to successfully predict load in 5-minute intervals over a 24 hours period.

Zandi, Helia↗
DOE OSTI2024

FIU Project 2: Environmental Remediation Science & Technology [Slides]

FIU’s research under this project involves conducting basic and applied science to fill knowledge gaps and validate potential remediation technologies for contaminated soil and groundwater and the assessment of the fate and transport of contaminants in the environment. The aim of FIU’s research is to reduce the potential for contaminant mobility or toxicity in the surface and subsurface through the development and application of state-of-the-art scientific and environmental remediation technologies at the Hanford Site, Savannah River Site (SRS), and the Waste Isolation Pilot Plant (WIPP), which is the Nation’s only mined geologic repository for permanent disposal of transuranic waste. FIU collaborates with scientists from Pacific Northwest National Laboratory (PNNL), Savannah River National Laboratory (SRNL), Savannah River Ecology Laboratory (SREL), Los Alamos National Laboratory (LANL) and the DOE Carlsbad Field Office (CBFO) in order to plan and execute research that is synergistic with the work being conducted at the sites, and that supports the resolution of critical science and engineering needs which leads to a better understanding of the long-term behavior of subsurface contaminants. The knowledge gained through this research will be used to transform experimental and modeling innovations into practical applications deployed at the sites to support EM’s primary goal of expediting the closure of major contaminated soil and groundwater sites and waste units. Collaborative relationships between FIU and the national laboratories have provided large benefits over the years to FIU, the national laboratories, the DOE complex, and the DOE EM mission. By working closely with the national laboratories, FIU’s research is not only closely aligned with the cleanup mission priorities at the DOE sites, but complements and supports ongoing work at the national laboratories for screening of new remedial technologies. This coordination and leveraging of research efforts results in time- and cost-savings, and will accelerate progress of the DOE EM environmental restoration mission.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Development of Explainable, Knowledge-Guided AI Models to Enhance the E3SM Land Model Development and Uncertainty Quantification

Focal Area(s): (2)Predictive modeling using AI techniques and AI-derived model components; use of AI and other tools to design a prediction system comprising of a hierarchy of models. (3) Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge- guided AI. Science Challenge: The Energy Exascale Earth System Model (E3SM) is a fully coupled, state-of-the-science Earth system model that uses code optimized for DOE's advanced computers to address the most critical scientific questions facing our nation and society (Golaz et al., 2019). The E3SM Land model (ELM) is designed to understand how the changes in terrestrial land surfaces will interact with other Earth system components and has been used to understand hydrologic cycles, biogeophysics, and ecosystem dynamics. In spite of great successes, the ELM has several known issues that restrain rapid improvements. For example, the ELM uses equilibrium models to simulate dynamic land-climate interactions and it requires long model spin-up time to identify suitable initial conditions for transient simulations. The ELM lacks built-in uncertainty mechanisms that can improve the robustness of model predictions. The ELM is a holistic, deterministic model system with a rigid design, and in many situations, it is hard to modify the ELM system to incorporate new theory/hypothesis and new data across scales to address emerging science problems (such as predicting the impacts of water cycle extremes). In addition, The ELM is technically optimized for traditional CPU-centric computers and it cannot fully utilize the current and incoming leadership computers for model simulations and uncertainty quantification (UQ). The success of artificial intelligence (AI) has inspired scientists to use AI models to discover intrinsic features from simulation data (Chattopadhyay et al., 2020) and observational data (Reichstein et al., 2019) to gain further process understanding of Earth science problems. However, autonomous AI model training through deep learning usually requires a huge amount of annotated data. To overcome the limitations from the data and computing resources, knowledge-guided AI models are necessary where human-knowledge is ingested in model construction (Banino et al., 2018) and training process (Silver et al., 2016) for efficient learning. Herein, we present a new way that leverages the process understanding from the ELM to guide AI model development for the ELM enhancement and UQ. We hope this study can inspire further Earth and environmental system model developments and transformations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Power Application Developer’s Guide to the Common Information Model: An Introduction for Power Systems Engineers and Application Developers – CIM17v40

A key issue in creating the next generation of energy management system (EMS) and advanced distribution management system (ADMS) platforms will be the ability to represent and exchange power system network model data in a consistent manner. To this end, the Common Information Model (CIM) stands out as the only standardized vocabulary (or ontology) for defining power system network models and asset data in a comprehensive, consistent manner across the generation-transmission-distribution boundary. The CIM is freely available to use and extend. The CIM is maintained by the UCAiug (informally known as the CIM User’s Group) under an Apache 2.0 license. The CIM Users Group collaborates with the IEC and other standards communities for the development of technical and informative specifications. Although portions of the information model are referred to by the corresponding IEC standards naming, it is not necessary to purchase any of the IEC standards to use the CIM information model. This document provides a roadmap for power system engineers and application developers not familiar with semantic modeling to start using the CIM for modeling, simulation, optimization, and development of advanced power applications. The key classes needed for defining power system topology and equipment are explained systematically. Key focus areas include modeling of lines, transformers, generators, switching equipment, loads, and distributed energy resources (DERs).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Materials and Fuels Complex FY-24 -- FY-28 Five-Year Investment Strategy

MFC supports current RD&D missions while enabling new projects and missions working with DOE-NE sponsors, other federal agencies, private industry, and academia. The investment strategy described in this document guides the efforts to build, expand, and sustain DOE-NE research capabilities at MFC, increase access to MFC capabilities by industry and the nuclear RD&D community, and revitalize existing MFC nuclear infrastructure. The strategy also anticipates and guides the preparations necessary for demonstration of advanced nuclear energy technologies in support of NRIC, the DOE Gateway for Accelerated Innovation in Nuclear (GAIN) initiative, and nuclear energy and other related critical outcomes identified in the INL Laboratory Plan. The investment strategy for MFC addresses building and improving on these core competencies, introducing new and revitalized RD&D capabilities, and maturing the NRIC test bed. MFC is also implementing new business and operations models to help transform MFC into a complex that supports an advanced nuclear technology development test bed. The strategy for MFC is presented in several parts, each focusing on an element needed for success.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Machine Reading at Scale: A Search Engine for Scientific and Academic Research

The Internet, much like our universe, is ever-expanding. Information, in the most varied formats, is continuously added to the point of information overload. Consequently, the ability to navigate this ocean of data is crucial in our day-to-day lives, with familiar tools such as search engines carving a path through this unknown. In the research world, articles on a myriad of topics with distinct complexity levels are published daily, requiring specialized tools to facilitate the access and assessment of the information within. Recent endeavors in artificial intelligence, and in natural language processing in particular, can be seen as potential solutions for breaking information overload and provide enhanced search mechanisms by means of advanced algorithms. As the advent of transformer-based language models contributed to a more comprehensive analysis of both text-encoded intents and true document semantic meaning, there is simultaneously a need for additional computational resources. Information retrieval methods can act as low-complexity, yet reliable, filters to feed heavier algorithms, thus reducing computational requirements substantially. In this work, a new search engine is proposed, addressing machine reading at scale in the context of scientific and academic research. It combines state-of-the-art algorithms for information retrieval and reading comprehension tasks to extract meaningful answers from a corpus of scientific documents. The solution is then tested on two current and relevant topics, cybersecurity and energy, proving that the system is able to perform under distinct knowledge domains while achieving competent performance.

Sousa, Norberto (ORCID:0000000329194817)↗