Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

ESMs Latent Space Exploration for Uncertainty Quantification and Spatiotemporal Downscaling

This final report for DOE Award DE-SC0023044 presents advances in two key areas of climate modeling: (1) representative climate model selection and (2) Earth System Model (ESM) downscaling using hybrid AI methods. The first section introduces a reordered, three-stage workflow to select representative GCM runs that more effectively balance historical skill with ensemble spread, validated across Texas, Bihar, and New York. The second section introduces two novel super-resolution frameworks, ViSIR and ViFOR, that integrate Vision Transformers with sinusoidal and Fourier-based implicit neural representations. These models achieve state-of-the-art reconstruction accuracy for ESM variables including surface temperature and heat fluxes. The report includes detailed methodology, benchmarks, and results, demonstrating significant gains in uncertainty quantification, spatial fidelity, and scalability for climate-impact studies.

54 ENVIRONMENTAL SCIENCES↗

Position-specific isotope effects during alkaline hydrolysis of 2,4-dinitroanisole resolved by compound-specific isotope analysis, 13 C NMR, and density-functional theory

Compound-specific isotope analysis (CSIA), position-specific isotope analysis (PSIA), and computational modeling (e.g., quantum mechanical models; reactive-transport models) are increasingly being used to monitor and predict biotic and abiotic transformations of organic contaminants in the field. However, identifying the isotope effect(s) associated with a specific transformation remains challenging in many cases. We describe and interpret the position-specific isotope effects of C and N associated with a SN 2 Ar reaction mechanism by a combination of CSIA and PSIA using quantitative 13 C nuclear magnetic resonance spectrometry, and density-functional theory, using 2,4-dinitroanisole (DNAN) as a model compound. The position-specific 13 C enrichment factor of O–C 1 bond at the methoxy group attachment site (ε C1 ) was found to be approximately -41‰, a diagnostic value for transformation of DNAN to its reaction products 2,4-dinitrophenol and methanol. Theoretical kinetic isotope effects calculated for DNAN isotopologues agreed well with the position-specific isotope effects measured by CSIA and PSIA. This combination of measurements and theoretical predictions demonstrates a useful tool for evaluating degradation efficiencies and/or mechanisms of organic contaminants and may promote new and improved applications of isotope analysis in laboratory and field investigations.

13C NMR↗

Digital Infrastructure Industry Engagement

The commercial nuclear sector faces unprecedented financial challenges driven by low natural gas prices and subsidized renewables in a market that does not reward carbon-free baseload capacity. These circumstances, along with increasingly antiquated labor-centric operating models and analog technology, have forced the early closure of multiple nuclear facilities and placed a much larger population of nuclear stations at risk. Nuclear plant economic survival in current and forecasted market conditions requires an efficient and technology-centric operating model that harvests the native efficiencies of advanced technology. This is analogous to transformations that have occurred in other industries.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Advancing representations of equity and justice in climate mitigation futures

THIS PAPER WAS PRIMARILY COMPLETED PRIOR TO THE AUTHOR JOINING PNNL AND NO DOE FUNDING WAS USED FOR THIS PAPER. In this work, we review how equity and justice issues in global climate mitigation scenarios are addressed within Integrated Assessment Models (IAMs) and propose a new research agenda to strengthen their integration in model development and application. We begin by examining prominent concerns at the science-policy interface. We introduce a typology of equity and justice limitations in climate mitigation scenarios, distinguishing among structural, methodological, and epistemological biases that shape what integrated assessment models can reveal at policy-relevant scales. Reflecting on these concerns, we propose a research agenda that describes new avenues of work and draws together distinct emerging initiatives. This agenda is based on the feasibility and depth of required interventions, from incremental improvements to structural reforms and alternative participatory approaches. Drawing on reflexive insights from integrated assessment practitioners, it addresses the operational challenges of translating justice concepts into metrics, including risks of reductionism, tokenism, and narrow definitions. Underlying this research agenda is a recognition that modeling communities must engage more critically with implicit assumptions in model design and use that have equity and justice implications. Achieving equitable climate futures will require transformative actions that integrate diverse justice concerns, advance sustainable development goals, and confront systemic inequities across both human and ecological dimensions. Although models will never capture all these aspects, they can be significantly enhanced to support more informed discussion and practical application. Our contribution proposes a way forward to achieving this goal.

Pachauri, Shonali↗

Developing Reaction Chemistry Models from Reactive Molecular Dynamics: TATB

Reactive Molecular Dynamic (RMD) are used to simulate the cook-off chemistry of TATB at a variety of fixed density and fixed temperature conditions. The chemical transformations are monitored using a Coordination Geometry Analysis (CGA) approach which tracks which atom types are bonded to each specific atom. This particularly identifies oxidation state changes that occur during the transformations. Correlations between these different chemical changes are identified using a Non-negative Matrix Factorization (NMF) approach. These identify reduced order chemistry models for the TATB system which contains six components whose concentration profiles are a function of both the temperature and density/pressure. The time histories of these transformations appear to show exponential growth/decay properties that could be fit with Arrhenius rates. These components should form the basis of deflagration rate models for these materials which could then be used in mesoscale simulations to analyze accidental initiation, shock-to-detonation and detonation propagation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparative feedstock analysis in Setaria viridis L. as a model for C 4 bioenergy grasses and panicoid crop species

Second generation feedstocks for bioethanol will likely include a sizable proportion of perennial C4 grasses, principally in the Panicoideae clade. The Panicoideae contain agronomically important annual grasses including Zea mays L. (maize), Sorghum bicolor (L.) Moench (sorghum), and Saccharum officinarum L. (sugar cane) as well as promising second generation perennial feedstocks including Miscanthus × giganteus and Panicum virgatum L. (switchgrass). The underlying complexity of these polyploid grass genomes is a major limitation for their direct manipulation and thus driving a need for rapidly cycling comparative model. Setaria viridis (green millet) is a rapid cycling C4 panicoid grass with a relatively small and sequenced diploid genome and abundant seed production. Stable, transient, and protoplast transformation technologies have also been developed for Setaria viridis making it a potentially excellent model for other C4 bioenergy grasses. Here, the lignocellulosic feedstock composition, cellulose biosynthesis inhibitor response and saccharification dynamics of Setaria viridis are compared with the annual sorghum and maize and the perennial switchgrass bioenergy crops as a baseline study into the applicability for translational research. A genome-wide systematic investigation of the cellulose synthase-A genes was performed identifying eight candidate sequences. Two developmental stages; (a) metabolically active young tissue and (b) metabolically plateaued (mature) material are examined to compare biomass performance metrics.

09 BIOMASS FUELS↗

Anelasticity and Phase Transition During Ramp-Release in Tin

This study examines the qualitative features of an anelasticity model associated with the bowing of dislocations in the presence of phase transition. A simple physically plausible mechanism is introduced to describe the interaction of anelasticity and the transformation. Varying the anelastic parameters results in strong differences in the deviatoric stress response. The model is applied to study the behavior of tin (Sn) and compared to data from ramp driven compression-release experiments. Tin exhibits a complex phase diagram within a relatively accessible range of temperature and pressures and the characterization of its phases is considered an open problem with significant scientific merit. The coupling between anelasticity, plasticity, and phase transformation contributes to release wave features traditionally associated with the phase transition effect alone suggesting the importance of accounting for the effects jointly. Posterior distributions of the plastic and anelastic parameters are computed using Bayesian-inference-based methods, further highlighting the importance of anelasticity in this regime.

36 MATERIALS SCIENCE↗

Frequency Analysis of Solar PV Power to Enable Optimal Building Load Control

In this paper, we present a flexibility estimation mechanism for buildings’ thermostatically controlled loads (TCLs) to enable the distribution level consumption of the majority of solar photovoltaic (PV) generation by local building TCLs. The local consumption of PV generation provides several advantages to the grid operation as well as the consumers, such as reducing the stress on the distribution network, minimizing voltage fluctuations and two-way power flows in the distribution network, and reducing the required battery storage capacity for PV integration. This would result in increasing the solar PV generation penetration levels. The aims of this study are twofold. First, spectral (frequency) analyses of solar PV power generation together with the power consumption of multiple building TCLs (such as heating, ventilation, and air conditioning (HVAC) systems, water heaters, and refrigerators) are performed. These analyses define the bandwidth over which these TCLs can operate and also describe the PV generation frequency bandwidth. Such spectral analyses, in frequency domain, can help identify the flexible components of PV generation that can be consumed by the various TCLs through optimal building load utilization. Second, a quadratic optimization problem based on model predictive control is formulated to allow consuming most of the low and medium frequency content of the PV power locally by building TCLs, while maintaining occupants’ comfort and TCLs’ physical constraints. The solution to the proposed optimization problem is achieved using optimal control strategies. Numerical results show that most of the low and medium frequency content of the PV generation can be consumed locally by building TCLs. The remaining high-frequency content of the PV generation can then be stored/offset using energy storage systems.

14 SOLAR ENERGY↗

Development of Human and Technology Integration Guidance for Work Optimization and Effective Use of Information

Existing nuclear power contributes to roughly 20% of the total electricity generation, and consistently provides the highest capacity factor of any other electricity generating resource in the United States. Despite these advantages, the existing nuclear power plant fleet in the United States has been enduring significant challenges in providing electricity in a cost-competitive manner, which has ultimately threatened the long-term economic viability of these plants. A major contributor to these increased operating and maintenance costs has been the continued reliance of a large workforce who perform their work under an operating model that has largely remained unchanged since the commissioning of these nuclear power plants. Unfortunately, while this operating model has provided safe and reliable electricity, other industries have already began transforming their workforce through the use of advanced digital technology and automation that has reduced their operating and maintenance cost significantly. In order for the United States nuclear industry to remain economically viable, a similar transformation must be considered in which digital technologies and automation capabilities are brought in to support key plant functions across all work functions across plant operation, maintenance, and support. To effectively integrate digital technology and automation in the existing nuclear power plant operating model, a multidisciplinary approach is needed that addresses technological and sociotechnical (i.e., human and technology integration) considerations. This report describes an extension to the human and technology integration methodology, herein referred to as Human Integration and Technology Task Force for Work Management Optimization (HITT), to support the safe, reliable, and efficient use of proposed innovations with the intended users in their intended environment to perform their intended tasks. By effectively incorporating human and technology integration into a plant modernization effort by using HITT, we believe that a utility can significantly improve work performance and overall workforce quality of life. For instance, if HITT is performed to optimize work management, scheduling performance and scope stability can be improved by up to 10%. HITT enables these benefits through developing a rich understanding of the work being performed, the utility’s vision, and the opportunities that provide greatest value to optimize performance through a 10-step process illustrated below as a quick guide. The quick guide contains links in the righthand side of each step that allows for navigation to the detailed section (Section 4) of HITT in this technical report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Autoregressive neural quantum states of Fermi Hubbard models

Neural quantum states (NQSs) have emerged as a powerful ansatz for variational quantum Monte Carlo studies of strongly correlated systems. Here, we apply recurrent neural networks (RNNs) and autoregressive transformer neural networks to the Fermi-Hubbard and the (non-Hermitian) Hatano-Nelson-Hubbard models in one and two dimensions. In both cases, we observe that the convergence of the RNN ansatz is challenged when increasing the interaction strength. We present a physically motivated and easy-to-implement strategy for improving the optimization, namely, by ramping of the model parameters. Furthermore, we investigate the advantages and disadvantages of the autoregressive sampling property of both network architectures. For the Hatano-Nelson-Hubbard model, we identify convergence issues that stem from the autoregressive sampling scheme in combination with the non-Hermitian nature of the model. Our findings provide insights into the challenges of the NQS approach and make the first step towards exploring strongly correlated electrons using this ansatz. Published by the American Physical Society 2025

Ibarra-García-Padilla, Eduardo (ORCID:000000019165↗

Process Optimization and Modeling for Minerals Sustainability (PrOMMiS) v1.0.0

The U.S. Department of Energy's ("DOE") Process Optimization and Modeling for Minerals Sustainability project ("PrOMMiS Project") was initiated in 2023 to transform the national Critical Minerals and Rare Earth Elements (CM & REE) landscape, thereby supporting DOE's three enduring strategic objectives: security, economic competitiveness, and environmental responsibility. To address this initiative, the PrOMMiS Project will develop, demonstrate, and deploy an open-source, advanced system modeling, optimization, and analysis application ("PrOMMiS Software Application") that will support industry decision-makers by accelerating the scale-up of novel CM & REE technologies by de-risking the development and deployment of commercial scale processes and maximizing learning throughout the development cycle.

Beattie, KeithS [Lawrence Berkeley National Labora↗

Pore‐Scale Modeling of Reactive Transport with Coupled Mineral Dissolution and Precipitation

Abstract We present a new pore‐scale model for multicomponent advective‐diffusive transport with coupled mineral dissolution and precipitation. Both dissolution and precipitation are captured simultaneously by introducing a phase transformation vector field representing the direction and magnitude of the overall phase change. An effective viscosity model is adopted in simulating fluid flow during mineral dissolution‐precipitation that can accurately capture the velocity field without introducing any empirical parameters. The proposed approach is validated against analytical solutions and interface tracking simulations in simplified structures. After validation, the proposed approach is employed in modeling realistic rocks where mineral dissolution and precipitation are dominant at different locations. We have identified three regimes for mineral dissolution‐precipitation coupling: (a) compact dissolution‐precipitation where dissolution is dominant near the inlet and precipitation is dominant near the outlet, (b) wormhole dissolution with clustered precipitation where dissolution generates wormholes in the main flow paths and precipitation clogs the secondary flow paths, and (c) dissolution dominant where all solid grains are gradually dissolved. In the three regimes, the proposed approach provides reliable porosity‐permeability relationships that cannot be described well by traditional macroscale models. We find that the permeability can increase while the overall porosity decreases when the main flow paths are expanded by dissolution and adjacent pore spaces are clogged by precipitation.

58 GEOSCIENCES↗

Distribution System Dataset Generator for AI Applications [SWR-24-75]

This software is a simple, light-weight python package to generate pytorch compatible machine learning graph dataset representing electric power distribution system. User is able to use these graph datasets to test their graph generation artificial intelligence (AI) models, link prediction AI models, graph classification AI models and so much more. This package uses grid-data-models (https://github.com/NREL-Distribution-Suites/grid-data-models) as input data format for power distribution system. NREL-Ditto (https://github.com/NREL-Distribution-Suites/ditto) tool can be leveraged to transform popular distribution system file formats such as opendss, cyme and synergi to grid-data-models.

Duwadi, Kapil↗

Data and Scripts associated with “Lambda-PFLOTRAN: Workflow for Incorporating Organic Matter Chemistry Informed by Ultra High Resolution Mass Spectrometry into Biogeochemical Modeling.”

This data package is associated with the publication “Lambda-PFLOTRAN: Workflow for Incorporating Organic Matter Chemistry Informed by Ultra High Resolution Mass Spectrometry into Biogeochemical Modeling” submitted to Geoscientific Model Development (Muller et al., 2024). In this manuscript, organic matter chemistry and thermodynamics are directly connected to reactive transport simulators through the newly developed Lambda-PFLOTRAN (Parallel Reactive Flow and Transport model) workflow tool that succinctly incorporates organic matter chemistry data generated from Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) into reaction networks to simulate aerobic respiration of the organic matter and the resulting biogeochemistry. Lambda-PFLOTRAN is a python-based workflow, executed through a Jupyter Notebook interface, that digests raw FTICR-MS data, develops a representative reaction network based on substrate-explicit thermodynamic modeling (also termed lambda modeling due to its key thermodynamic parameter λ used therein), and completes a biogeochemical simulation with the open source, reactive flow, and transport code PFLOTRAN. This data package contains Jupyter Notebook based workflows for two test cases for running biogeochemical simulations of organic matter oxidation identified by FTICR-MS. It contains four primary folders (workflow, data, src, and analysis), a file-level metadata file (Muller_2024_Lambda_PFLOTRAN_Manuscript_Data_Package_flmd.csv) that lists all the files contained in this data package with a short description of each, and a data dictionary (Muller_2024_Lambda_PFLOTRAN_Manuscript_Data_Package_dd.csv) file that describes the tabular column headers. The ‘workflow’ folder contains the Jupyter Notebook based workflows for running the lambda analysis, PFLOTRAN simulation, sensitivity analysis and parameter estimation. The ‘data’ folder contains the FTICR-MS data, initial conditions, and incubation data for test cases 1 and 2 in folders titled ‘WHONDRS’ and ‘Colloids’, respectively. The data folder also has a ‘Database’ folder containing a reaction network for bulk organic matter (assumed to be CH2O) and a general database for PFLOTRAN (hanford_rxn_network). The CH2O reaction network defines bulk organic matter oxidation. Biogeochemical simulations are completed for both the lambda binned organic matter and bulk organic matter reaction networks. The ‘hanford_rxn_network’ database includes information required for PFLTORAN simulations including ion size, molar mass, and charge of the aqueous species, gases, and minerals phases. The ‘src’ folder contains python source codes for performing lambda analysis, PFLOTRAN simulation, sensitivity analysis and parameter estimation. The ‘analysis’ folder contains outputs from the test cases 1 and 2 including lambda analysis, PFLOTRAN runs and the calibration results.

54 ENVIRONMENTAL SCIENCES↗

Inhomogeneous mean-field approach to collective excitations near the superfluid–Mott glass transition

Highlights: • Unconventional collective excitations across the superfluid–Mott glass transition. • Higgs mode localized in superfluid and insulating phases. • Broad uncritical amplitude response function at quantum phase transition. • Goldstone mode delocalizes in the superfluid phase. We develop an inhomogeneous quantum mean-field approach to the behavior of collective excitations across the superfluid–Mott glass quantum phase transition in two dimensions, complementing recent quantum Monte Carlo simulations (Puschmann et al. 2020). In quadratic (Gaussian) approximation, the Goldstone (phase) and Higgs (amplitude) modes completely decouple. Each is described by a disordered Bogoliubov Hamiltonian which can be solved by an inhomogeneous multi-mode Bogoliubov transformation. We find that the Higgs mode is spatially localized in both phases. The corresponding scalar spectral function shows a broad peak that is noncritical in the sense that its peak frequency does not soften but remains nonzero across the quantum phase transition. In contrast, the lowest-energy Goldstone mode delocalizes in the superfluid phase, leading to a zero-frequency spectral peak. We compare these findings to the results of the quantum Monte Carlo simulations. We also relate them to general results on the localization of bosonic excitations, and we discuss the limits and generality of our approach.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Simulation and Analysis on Reactor Pressure Vessel (RPV) subjected to Pressurized Thermal Shock (PTS) under SBLOCA scenario by using Cardinal to support the fracture mechanics analyses

The structural components that comprise nuclear reactors and their supporting structures are subjected to harsh operating environments that can challenge their integrity, especially after exposure for extended durations or under accident condition. As one of the most significant components of a Reactor, the Reactor Pressure Vessel (RPV) is exposed to an aggressive environment during the operation time (e.g. more than 40 years). Ageing degradation mechanisms (e.g. thermos-fatigue) could grow initial defects up to a critical size, increasing the susceptibility to failure in the RPV. The conventional methods are mostly based on simple crack and structure geometries. Very limited studies consider the real conditions of the RPV subjected to a thermal shock due to a Loss of Coolant Accident (LOCA). During a LOCA event, the most severe conditions take place when the emergency core cooling (ECC) water is injected inside the cold legs filled initially with hotter water and/or steam. The rapid cooling of the down-comer and the internal RPV surface followed probably by re-pressurization of the RPV causes large temperature gradients and variation of pressure which induces thermal-mechanical stresses. In order to develop the model for integrity assessment of a reactor pressure vessel (RPV) subjected to pressurized thermal shock (PTS), a multi-physics simulation, which includes the thermo-hydraulic, thermo-mechanical and fracture mechanics analyses is necessary. The multi-physics simulations are performed using Cardinal, a wrapping of the GPU-oriented spectral element Computational Fluid Dynamics (CFD) code NekRS and other multi-physics sub-modules within the MOOSE framework. Cardinal now fully supports MOOSE stochastic perturbations of NekRS models with varying boundary conditions, initial conditions, material properties, and any other quantity which is defined by a kernel (such as coefficients in a momentum source model). The implementation is designed in a flexible manner so that scalar values are sent from MOOSE into a user scratch space in NekRS, which can then be applied for any purpose within the NekRS case files (both on the host and device). When modeling PTS, several factors can impact the results significantly. In this report, the impacts of the geometry of the model, Reynolds number and buoyancy effect are investigated. Two geometry, i.e., a simplified model and a realistic RPV model, with both laminar and turbulent flow condition are adopted for the PTS simulation with and without buoyancy effect. The purpose of the investigation is to understand the impact of these factors on the prediction of temperature history of RPV. The accurate prediction on the temperature evolution, which will be exported to Grizzly code for further analyses on the progression of aging mechanisms and their effects on the integrity of RPV structures, is very crucial. Based on the understanding of these factors, a more sophisticated model is built to analysis the PTS under SBLOCA scenario. A literature survey is conducted to pick the SBLOCA scenario for the multi-physics simulation. The analysis helps to explain the form and the transformation of the cold plum when the ECC is activated under SBLOCA. This model can be can be applied to study the PTS effect for different RPV configurations. The results can help to assess structural component degradation for advanced reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Autoregressive long-horizon prediction of plasma edge dynamics *

Accurate modeling of scrape-off layer (SOL) and divertor-edge dynamics is vital for designing plasma-facing components in fusion devices. High-fidelity edge fluid/neutral codes such as SOLPS-ITER capture SOL physics with high accuracy, but their computational cost limits broad parameter scans and long transient studies. We present transformer-based, autoregressive surrogates for efficient prediction of 2D, time-dependent plasma edge state fields. Trained on SOLPS-ITER spatiotemporal data for the KSTAR tokamak, the surrogates forecast electron temperature, electron density, and radiated power over extended horizons. We evaluate model variants trained with increasing autoregressive horizons (1–100 steps) on short- and long-horizon prediction tasks. Longer-horizon training systematically improves rollout stability and mitigates error accumulation, enabling stable predictions over hundreds to thousands of steps and reproducing key dynamical features such as the motion of high-radiation regions. Measured end-to-end wall-clock times show the surrogate is orders of magnitude faster than SOLPS-ITER, enabling rapid parameter exploration. Prediction accuracy degrades when the surrogate enters physical regimes not represented in the training dataset, motivating future work on data enrichment and physics-informed constraints. Overall, this approach provides a fast, accurate surrogate for computationally intensive plasma edge simulations, supporting rapid scenario exploration, control-oriented studies, and progress toward real-time applications in fusion devices.

autoregressive deep learning↗

Tuning Shinkarev’s Bicycle: Separating the Parallel Cycles of Photosystem II Using Empirical Wavelet Transform

The oxygen-evolving complex (OEC) of Photosystem II (PSII) catalyzes light-driven water oxidation, a process necessary to sustain Earth’s atmospheric oxygen. Oxygen yields measured during single-turnover flash sequences exhibit period-four oscillations, which form the basis of the Joliot–Kok (S-state) model. However, when the oscillations of other processes contribute to the measured oxygen yield, fitting methods can conflate these signals and distort estimates of inefficiencies and initial S-state populations. To address this, we applied the empirical wavelet transform (EWT) as a model-independent method to separate overlapping oscillators and capture damping dynamics that are not well represented in Fourier analysis. We tested this framework on polarographic flash-oxygen traces from both our Synechocystis sp. PCC 6803 thylakoid membrane preparations and archival datasets on Chlorella and isolated chloroplasts. EWT consistently resolves the expected period-four component alongside a distinct binary oscillation. Simulations suggest that fitting this isolated period-four signal recovers VZAD parameters more accurately than analysis of raw traces, yielding different estimates for S-state distributions and transition probabilities. Notably, this binary oscillation aligns closely with semiquinone dynamics predicted solely from period-four fit parameters. These findings indicate that EWT can effectively distinguish complex signals in oxygen evolution, offering a framework potentially applicable to other spectroscopic probes of the S-state cycle.

Ferrari, Nicholas [Louisiana State Univ., Baton Ro↗