Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformative”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Thermal Design Consideration of Medium Voltage High Frequency Transformers

This paper describes a thermal design using epoxy potting for high frequency transformer (HFT) for medium voltage high power electronic applications, namely emerging solid-state transformers. To address HFT’s thermal stress problem, thermal performance of the HFT with air and epoxy potting cooling method are both simulated by magnetothermal-fluid coupling method (MTFCM). The effectiveness of the simulation analysis is verified in a 100 kW DC-DC resonant converter. Influencing factors including distance between the high frequency transformer and the metal enclosure, epoxy thermal conductivity and heat sink placements are simulated and analyzed. Finally, an optimal cooling structure is proposed for future high power HFTs.

Wang, Haoming↗
DOE OSTI2022

Image transformers for classifying acute lymphoblastic leukemia

Cancer is the leading cause of death by disease in American children. Each year, nearly 16,000 children in the United States and over 300,000 children globally are diagnosed with cancer. Leukemia is a form of blood cancer that originates in the bone marrow and accounts for one-third of pediatric cancers. This disease occurs when the bone marrow contains 20% or more immature white blood cell blasts. Acute lymphoblastic leukemia is the most prevalent leukemia type found in children, with half of all annual cases in the U.S. diagnosed for subjects under 20 years of age. To diagnose acute lymphoblastic leukemia, pathologists often conduct a morphological bone marrow assessment. This assessment determines whether the immature white blood cell blasts in bone marrow display the correct morphological characteristics, such as size and appearance of nuclei. Pathologists also use immunophenotyping via multi-channel flow cytometry to test whether certain antigens are present on the surface of blast cells; the antigens are used to identify the cell lineage of acute lymphoblastic leukemia. These manual processes require well-trained personnel and medical professionals, thus being costly in time and expenses. Computerized decision support via machine learning can accelerate the diagnosis process and reduce the cost. Training a reliable classification model to distinguish between mature and immature white blood cells is essential to the decision support system. Here, we adopted the Vision Transformer model to classify white blood cells. The Vision Transformer achieved superb classification performance compared to state-of-the-art convolutional neural networks while requiring less computational resources for training. Additionally, the latent self-attention architecture provided attention maps for a given image, providing clues as to which portion(s) of the image were significant in decision-making. We applied the Vision Transformer model and a convolutional neural network model to an acute lymphoblastic leukemia classification dataset of 12,528 samples and achieved accuracies of 88.4% and 86.2%.

Cho, Priscilla↗
DOE OSTI2025

A low-temperature, one-step synthesis for monazite can transform monazite into a readily usable advanced nuclear waste form

It has been demonstrated that monazite-type materials are excellent candidates for nuclear waste forms, and hence, their facile synthesis is of great importance for the needed sequestration of existing nuclear waste. The synthesis of monazite, LaPO 4 , requires inconveniently high temperatures near 1000°C and generally involves the conversion of the presynthesized rhabdophane, LaPO 4 •nH 2 O, to the LaPO 4 monazite phase. During this structure transformation, the rhabdophane converts irreversibly to the thermodynamically stable monoclinic monazite structure. A low-temperature (185° to 260°C) mild hydrothermal acid-promoted synthesis of monazite is described that can both transform presynthesized rhabdophane or assemble reagents to the monoclinic monazite structure. The pH dependence of this reaction is detailed, and its applicability to the LnPO 4 (Ln = La, Ce, Pr, Nd, Sm-Gd), Ca 0.5 Th 0.5 PO 4 , and Sr 0.5 Th 0.5 PO 4 systems is discussed. The crystal growth of Ca 0.5 Th 0.5 PO 4 and Sr 0.5 Th 0.5 PO 4 is described, and their crystal structures were reported. In situ x-ray diffraction studies, performed as a function of temperature, provide insight into the structure transformation process.

Biogeochemistry↗
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
DOE OSTI2022

Transformer Health Monitoring Using Dissolved Gas Analysis

Power plants use transformers for supplying generated electricity to the grid. As these transformers age and degrade, they produce specific gases. These gases can be monitored and used to predict when maintenance should be completed. This code uses four complementary techniques to predict when maintenance should be performed based on gas concentrations within the transformer.

Walker, CodyM [Idaho National Laboratory (INL), Id↗
DOE OSTI2026

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗
DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗
DOE OSTI2025

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2024

CurvilinearGrids.jl: A Julia package for curvilinear coordinate transformations

Finite-difference discretizations of partial differential equations are widespread throughout the scientific community. Oftentimes finite-differences are used to compute spatial gradients of fields on a discrete grid, which is typically a uniform or rectilinear Cartesian mesh. Arbitrary multidimensional geometry is difficult to discretize directly with finite differences, however, due to non-uniform grid spacing and non-orthogonality. Curvilinear coordinate transformations can be used as a strategy to enable arbitrary geometry. While these curvilinear transformations are straightforward, the governing PDEs require additional terms (metrics) and must adhere to strict conservation laws; these criteria complicate the application of the transformation and require careful implementation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Basic Research Needs for Transformative Manufacturing

This report is based on a Basic Research Needs workshop for Transformative Manufacturing, which was held March 9 - 11, 2020. The focus of the workshop was to identify the basic science research priorities that could accelerate innovation to transform manufacturing in the future. This was the first workshop of its kind to examine how basic energy science can drive manufacturing forward and innovate new ways to manufacture goods. Five Priority Research Directions were identified that address these science challenges: (1) innovative synthetic approaches to enable scalable assembly of matter, (2) computational methods and theoretical models to transform how manufacturing processes are controlled, (3) new characterization tools that can handle the necessary complexity, scales, and processing speeds to meet manufacturing needs, (4) new science to address opportunities relevant to sustainable and energy efficient manufacturing, and (5) foundational approaches to co-design of materials, process, and products.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Analytically Derived Piezoelectric Ejecta Data Transformations, with Implications for Claims of Experimentally Observed Self-Similarity

Building upon a previously documented analytic formalism, we derive a set of data transformations that relate piezoelectrically inferred time-dependent ejecta masses, dynamical ejecta cloud densities, and "radiographic" ejecta cloud density distributions. These transformation rules are derived rigorously, with careful attention to the assumption of instant ejecta production which is inherent in the piezoelectric mass inference procedure. Some of these relationships have not appeared previously in the literature, including solutions for the unique ejecta velocity distribution and radiographic ejecta cloud density distribution consistent with the instant-production assumption for a given piezoelectrically inferred mass dataset. In deriving the latter, we prove that—again subject to the ubiquitous instant-creation assumption—measurements at a single sensor are sufficient to determine properties of the ejecta cloud everywhere at all times. Other data transformation relationships have appeared in the literature without a rigorous derivation, or have been stated in forms that obscure the key mathematical relationships. We apply these results to arguments for self-similar ejecta cloud evolution, thereby deriving mathematical expressions by which claims of self-similarity may be examined. We prove that one analysis used in the literature to claim experimental evidence of a short ejecta production timescale—and consequently of self-similar cloud evolution—in fact places no constraint the ejecta production interval and therefore does not support the associated conclusion. We also provide a potentially useful uniqueness proof.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2020

Coupling of CTF and TRANSFORM using the Functional Mockup Interface

An in-memory coupling between the sub-channel thermal hydraulics code COBRA-TF (CTF), which is included in the Virtual Environment for Reactor Applications (VERA), and the systems code Transient Simulation Framework of Reconfigurable Models (TRANSFORM) was developed in this work. Data exchange is accomplished by using the Functional Mock-Up Interface (FMI), an open standard for coupling dynamic systems models together. The FMI-based coupling necessitated the development of a novel FORTRAN wrapper for communicating with Functional Mock-Up Units. This wrapper will facilitate future FMI-based code couplings with other FORTRAN-based programs. CTF-TRANSFORM is exercised on a simplified Molten Salt Reactor Experiment (MSRE) model in steady-state and transient configurations. The coupled CTF-TRANSFORM model is shown to predict core temperature deltas similar to those available in historical MSRE operational data and is shown to be robust to fast power transients.The coupling paves the way to performing sensitivity and design studies impossible with VERA/CTF alone, in which secondary and tertiary loop operating conditions and design parameters may be perturbed and their impact on the core operating conditions studied.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Tapless Voltage Regulating Transformer. Final Report

Voltage regulation is a common practice in power grid operation. The conventional voltage regulation methods have been facing ever increasing challenges as the penetration of renewable generations deepens in the grid. The intermittent nature of the renewable sources may result in sudden rise or drop of power generation, possibly breaking the generation-load balance. A lack of adequate voltage control not only affects the power quality but is detrimental to the system operation with the potential for large economic losses. Most conventional voltage regulation devices rely on mechanical tap changers to impose the regulation in a step-wise manner. Although sufficient for normal operations, the mechanical tap changers can be easily worn out in the challenging situations created by renewables. In this project, a novel technology called tapless voltage regulating transformer (TAREX) was proposed and investigated. It has the potential to excel at addressing the new voltage regulation challenges and replace the conventional regulating transformers. TAREX is based on the concept of the saturable-core reactor (SCR). The voltage of a TAREX can be smoothly and continuously regulated in a reasonable range by using a low rating power electronics based controller. It uses control of the transformer core magnetization to regulate the voltage on the windings, and thus eliminates the mechanical tap changer. This project is to prove the principle of TAREX, understand the voltage regulation mechanism, and preliminarily understand its impacts on the power systems through modeling, prototyping, and testing.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

How Artificial Intelligence and Machine Learning Transform the Human Condition

Our July 2021 symposium, “How Artificial Intelligence and Machine Learning Transform the Human Condition,” was hosted through a partnership between Los Alamos National Laboratory and the National Academies of Sciences, Engineering, and Medicine’s Committee on Science, Technology, and Law. The symposium is part of a broader initiative focusing on harnessing transformative technologies, and builds on our September 2020 symposium titled, “COVID-19: Harnessing a Transformational Pandemic.” Topics such as systems biology and artificial intelligence not only represent compelling research frontiers but also highlight national security challenges with social, ethical, and legal implications.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Integration of Omics into a New Comprehensive Rate Law for Competitive Terminal Electron-Accepting Processes in Reactive Transport Models: Application to N, Fe, S, and Contaminant Transformations in Stream and Wetland Sediments

Surface waters represent important sources of alternate energy and drinking water in the United States, and characterizing the biogeochemical processes that affect surface water quality is relevant to the DOE-BER mission. Sediment biogeochemical processes regulate the release of carbon (C), nutrients, and contaminants to surface waters and thus influence water quality. Sediment biogeochemical processes are dynamic and affected by the deposition and remobilization of solid material and changes in environmental conditions driven by water discharge variations. Wetlands are important natural filters of surface waters which may either trap, metabolize, or mobilize nutrients and contaminants. Despite their importance, biogeochemical processes regulating nutrient and contaminant release and C transformation in stream and wetland sediments cannot be predicted accurately by current mathematical models. These reactive transport models largely rely on detectable changes in geochemical conditions to activate metabolic processes, do not accurately account for the competition between microbial processes, and poorly constrain effects of hydrological perturbations on biogeochemical processes. In this BER-SBR exploratory project, metagenomic and geochemical signatures were combined to identify microbially-mediated redox processes in anaerobic stream and wetland sediments from the Savannah River Site (SRS, ANL SFA) and East Fork Poplar Creek (EFPC, ORNL SFA) that play important roles in C, uranium (U), and mercury (Hg) transformations. In addition, sediment incubations were conducted to examine the competition between anaerobic respiration processes Finally, new rate laws were developed for reactive transport models that rely on complementary metagenomic and geochemical signatures to identify the underlying anaerobic microbial processes in stream and wetland sediments, describe the competition between the dominant metabolic processes involved in nutrient release and U and Hg mobilization, and more accurately quantify carbon transformation and the response of microbial processes to changes in redox conditions associated with hydrological forcing. These rate laws were optimized in batch reactors with SRS wetland sediments, where iron and sulfate reduction dominate. Anaerobic carbon remineralization processes followed the expected thermodynamic sequence of microbial respiration with depth in both sediments, except that geochemical signals indicated that sulfate reduction was inactive in EFPC sediments and moderate in SRS wetland sediments. Estimates indicated that microbial iron reduction contributed to at least half of the production of reduced iron in these sediments. Incubations demonstrated that nitrate reduction, denitrification, and dissimilatory nitrate reduction to ammonium were active in the natural EFPC sediment and activated upon nitrate amendment in these nitrate-rich sediments. In turn, these processes were outcompeted by the addition of either iron oxides or sulfate as alternative terminal electron acceptors. Although geochemical products of sulfate reduction were not detected in the incubations, the abundance of sulfate reduction genes increased with depth in the sediment and was equally more pronounced in treatments amended with either iron oxides or sulfate. Simultaneously, anaerobic sulfide oxidizing bacteria coupling sulfide oxidation to DNRA (and not conventional denitrification) were apparently enriched over time, regardless of the treatments. These findings indicate that sulfate reduction is important in freshwater stream sediments and probably catalyzed by a cryptic sulfur cycle involving nitrogen species, in which the sulfur products from sulfate reduction are immediately removed by side reactions and not detectable by geochemical measurements alone. Similar experiments in SRS sediments, however, demonstrated little interaction between nitrogen and sulfur cycling microorganisms. Sulfate reduction was impacted by the addition of more thermodynamically favorable electron acceptors, suggesting either that iron-reducing microorganisms outcompeted sulfate-reducing microorganisms for organic substrate, depleting the stock of electron donor available for sulfate reduction, or that the cryptic sulfur cycle was shunted by the precipitation of FeS generated as a result of the abiotic reduction of iron oxides by dissolved sulfide. A diagnostic modeling exercise was conducted to further investigate the competition between terminal electron accepting processes. As conventional kinetic models typically do not account for cryptic cycles and used inaccurate formulations to describe competition between microbial communities, new metabolic rate laws were developed that explicitly express the electron acceptor-specific enzyme of each energetically favorable metabolic process based on gene abundance detected in the incubations. The model was tested with the sediment slurry incubation data to determine whether substrate competition could explain the decrease in sulfate reduction observed in the presence of iron oxide competitor. The model was able to reproduce geochemical concentrations really well in each treatment once the model was calibrated with the unamended control, suggesting that microbial competition was indeed driven by thermodynamic considerations. Overall, carbon remineralization processes and rates will be reproduced much more realistically with the new metabolic rate laws.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Illuminating the pathways to carbon liberation: a systems approach to characterizing the consequential unknowns of carbon transformation and loss from thawing permafrost peatlands (Final Report)

The IsoGenie3 Project delivered new systems-level insights into carbon cycling in thawing permafrost landscapes, with an emphasis on methane and carbon dioxide emissions. From >200 samples from the site collected over a decade, co-analyzed for geochemistry and microbiology, the team recovered ~1,500 assembled microbial genomes and ~1,900 viral population genomes, revealing appreciable genetic novelty - from a new highly abundant bacterial phylum, to novel methane consumers and their activities, to rampant viral novelty. IsoGenie3 linked these organisms to carbon compound transformations (which define the cycling of organic matter in soils, and the loss of the greenhouse gases carbon dioxide and methane), and saw that the microbes at each stage of permafrost thaw had different genetic potential to degrade categories of compounds, expressed that genetic potential differently, and actually transformed carbon compounds into greenhouse gases in different ways. IsoGenie 3 identified that some of the thaw-stage differences were due to plant-microbiome relationships; the plant species across the thaw gradient contributed different carbon compounds into the soil, and hosted distinct microbiota (differing among parts of plants as well as species). Lastly, microbes in the saturated post-thaw conditions appeared likely to contribute to the mobilization and toxification of mercury released during thaw. In parallel with ongoing field sampling and analysis, hypotheses arising from field observations were tested via lab incubation experiments. When communities are taken out of their native habitats, they behave differently, and the team first rigorously quantified the magnitude of this effect on microbiome composition and functional capacity, organic matter composition, and gas production; overall the main system processes were maintained in the lab incubations under the conditions tested. Further, the microbial data could inform geochemical reaction network models of those processes. Then, the team ran experiments with additions of compounds, varying temperature, and “live” vs. “dead” peat (the latter having been gamma irradiated, with a few additional variants to control for methodological artifacts). From these, we (a) determined the importance of plant-derived soluble phenolic compounds in bogs’ extraordinary recalcitrance of organic matter, and carbon gas emissions skewed to carbon dioxide; (b) proposed an abiotic ‘tanning’ mechanism, which could contribute to Sphagnum’s inhibitory effect on anaerobic decomposition through alteration of N availability. IsoGenie3 illuminated longer-term and landscape-scale interactions of permafrost thaw and carbon cycling, advancing knowledge of the drivers of methane dynamics not only across in the permafrost-associated peatland (where hydrology and plant communities dictate microbiomes) but also their interconnected lakes (where sediment carbon quality and resident microbiota are determined by position within lake, and lake features). By leveraging observations of site methane dynamics extending well before this project, the team was able to construct a 44-year portrait of the interplay of permafrost thaw, hydrology, vegetation dynamics, and carbon gas emissions, and the doubling of the fully-thawed fens over this time. From the detailed study of this focal site, IsoGenie3 also aimed to improve model representation of these kinds of sites and processes. To improve predictions of methane transformations, we incorporated acetate and isotope dynamics into the ‘DNDC’ biogeochemistry model. In addition, recovered genomes were grouped into ‘functional groups’, i.e. the genomes that perform a specific function of interest, then used to parameterize maximum growth rate and optimum growth temperature (via signatures in their sequence composition) for the BioCrunch model. The BioCrunch model was then in turn used to test the impact of increasing functional resolution of the microbes, on the carbon gas emissions. Lastly for modeling, the ecosys model was parameterized from the microbial and other data, and used to evaluate drivers of e.g. change in methane emissions. Finally, this project also led to the development of a range of new methods and tools, a new metric of organic matter decomposability, as well as a graph-database solution to multidisciplinary data storage and querying. This project’s ongoing analyses at our focal site also contributed to broader advancements in understanding elements of genetic plasticity and methane metabolism, climate change microbiology and community assembly, global peatland geochemistry and Arctic lakes’ roles in climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Low-latency Jet Tagging for HL-LHC Using Transformer Architectures

Transformers are the state-of-the-art model architectures and widely used in application areas of machine learning. However the performance of such architectures is less well explored in the ultra-low latency domains where deployment on FPGAs or ASICs is required. Such domains include the trigger and data acquisition systems of the LHC experiments. We present a transformer-based algorithm for jet tagging built with the HGQ2 framework, which is able to produce a model with heterogeneous bitwidths for fast inference on FPGAs, as required in the trigger systems at the LHC experiments. The bitwidths are acquired during training by minimizing the total bit operations as an additional parameter. By allowing a bitwidth of zero, the model is pruned in-situ during training. Using this quantization-aware approach, our algorithm achieves state-of-the-art performance while also retaining permutation invariance which is a key property for particle physics applications. Due to the strength of transformers in representation learning, our work also serves as a stepping stone for the development of a larger foundation model for trigger applications.

Laatu, Lauri [Imperial Coll., London]↗
DOE OSTI2022

Characterizing Natural Organic Matter Transformations by Microbial Communities in Terrestrial Subsurface Ecosystems: A Critical Review of Analytical Techniques and Challenges

Determining the mechanisms, traits, and pathways that regulate microbial transformation of natural organic matter (NOM) is critical to informing our understanding of the microbial impacts on the global carbon cycle. The capillary fringe of subsurface soils is a highly dynamic environment that remains poorly understood. Characterization of organo-mineral chemistry combined with a nuanced understanding of microbial community composition and function is necessary to understand microbial impacts on NOM speciation in the capillary fringe. We present a critical review of the popular analytical and omics techniques used for characterizing complex carbon transformation by microbial communities and focus on how complementary information obtained from the different techniques enable us to connect chemical signatures with microbial genes and pathways. This holistic approach offers a way forward for the comprehensive characterization of the formation, transformation, and mineralization of terrestrial NOM as influenced by microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗