Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging

A Class of Sparse Johnson–Lindenstrauss Transforms and Analysis of their Extreme Singular Values

The Johnson–Lindenstrauss (JL) lemma is a powerful tool for dimensionality reduction in modern algorithm design. The lemma states that any set of high-dimensional points in a Euclidean space can be projected into lower dimensions while approximately preserving pairwise Euclidean distances. Random matrices satisfying this lemma are called JL transforms (JLTs). Inspired by existing $s$-hashing JLTs with exactly $s$ nonzero elements on each column, the present work introduces an ensemble of sparse matrices encompassing so-called $s$-hashing-like matrices whose expected number of nonzero elements on each column is $s$. The independence of the sub-Gaussian entries of these matrices and the knowledge of their exact distribution play an important role in their analyses. Using properties of independent sub-Gaussian random variables, these matrices are demonstrated to be JLTs, and their smallest nontrivial singular values and largest singular values are estimated nonasymptotically using a technique from geometric functional analysis. As the dimensions of the matrix grow to infinity, these singular values are proved to converge almost surely to fixed quantities (by using the universal Bai–Yin law) and in distribution to the Gaussian orthogonal ensemble Tracy–Widom law after proper rescalings. Understanding the behaviors of extreme singular values is important in general because they are often used to define a measure of stability of matrix algorithms. For example, JLTs were recently used in derivative-free optimization algorithmic frameworks to select random subspaces in which are constructed random models or poll directions to achieve scalability, and hence estimating their smallest singular value in particular helps determine the dimension of these subspaces.

97 MATHEMATICS AND COMPUTING

High resolution characterization of soil dissolved organic matter with FTICR-MS (Fourier-transform ion cyclotron resonance mass spectrometry) from soil samples in control and warming plots in Blodgett Forest, CA (2014 and 2018)

The pathways of carbon transport and loss through and from soils—soil organic matter (SOM) depolymerization to dissolved organic carbon and mineralization to carbon dioxide (CO2)—are fundamentally driven by microbial activity, which is strongly regulated by environmental conditions. As part of Lawrence Berkeley National Laboratory (LBNL) Terrestrial Ecosystem Science (TES) Belowground Biogeochemistry Science Focus Area (SFA), we have established a novel whole-soil long-term warming experiment at the University of California (UC) Blodgett Forest Research Station (Sierra Nevada) in 2014, where we study the role of biogeochemical, microbial and geochemical process interactions in SOM decomposition and stabilization.This package contains Fourier transform ion cyclotron resonance mass spectrometry (21 Tesla FTICR-MS) data measured in negative and positive ionization mode from water and methanol soil extracts. Soil samples were collected in 2014/06/03 and 2018/06/04 from 3 replicated paired plots that had been subjected to experimental warming since June 2014 to simulate a predicted climate change scenario for northern California. The following files are included: (1) fticr_neg_h2oMeoh_data_raw.csv: raw data from combined water (H2O) and methanol (MeOH) extracts in negative ion mode, (2) fticr_neg_h2oMeoh_data_processed.csv: processed data from combined water (H2O) and methanol (MeOH) extracts in negative ion mode, (3) fticr_neg_metadata.csv: metadata for samples/measurements in negative ion mode, (4) fticr_pos_h2oMeoh_data_raw.csv: raw data from combined water (H2O) and methanol (MeOH) extracts in positive ion mode, (5) fticr_pos_h2oMeoh_data_processed.csv: processed data from combined water (H2O) and methanol (MeOH) extracts in positive ion mode, (6) fticr_pos_metadata.csv: metadata for samples/measurements in positive ion mode.

54 ENVIRONMENTAL SCIENCES

A Scalable Test-Bed for Direct Current Current Transformer Automated Functional Testing and Characterization

This article describes a scalable test-bed for automation of measurements of the direct current current transformers (DCCT). Automation of measurement involves functional measurements, fault event based measurements and data validation. The test-bed is designed to measure up to 20 DCCTs at a time with software based measurement repetition checks and validation of the measurements.

43 PARTICLE ACCELERATORS

Large Power Transformer Supply Chain Gap Analysis and Domestic Content Strategies for Hydropower Rehabilitation: Supplemental Report

Large Power Transformers (LPTs) are indispensable to U.S. hydropower operations, serving as generator step-up (GSU) units that interconnect hydro facilities to the transmission grid. Yet the LPT supply chain faces mounting stress from aging infrastructure, limited domestic production, and long lead times. Currently, more than 80% of LPT demand is met through imports, with primary suppliers including Mexico, South Korea, Brazil, Austria, and Canada. Domestic manufacturers supply only about 20% of units, constrained by bottlenecks in high-grade Grain-Oriented Electrical Steel (GOES), copper conductors, bushings, and on-load tap changers (OLTCs). Hydropower rehabilitation projects in particular face additional challenges due to custom design requirements, remote siting, and regulatory needs around domestic content. Regional cost disparities, driven by transportation logistics, labor markets, and import price volatility, further exacerbate project risks. To address these vulnerabilities, coordinated action is required: strengthening domestic capacity for GOES and secondary components, developing near-site assembly hubs, and leveraging IRS domestic content safe harbors to incentivize U.S. manufacturing. This addendum refines the 2024 NREL Hydropower Supply Chain Gap Analysis by focusing specifically on critical issues related to LPT domestic manufacturing capacity and key considerations for hydropower developers and asset owners.

13 HYDRO ENERGY

Solid State Transformer Controls for Mitigation of E3a High-Altitude Electromagnetic Pulse Insults

This paper explores the use of a solid state transformer (SST) to mitigate the 𝐸 3𝐴 component of a high-altitude electromagnetic pulse (HEMP) insult using external energy storage optimal control techniques. In lieu of conventional passive blocking devices or feedback-controlled energy storage devices, a novel implementation of Hamiltonian error tracking is utilized to develop a feedback control law for the variable converter ratio in an SST. The findings of the simulations performed in this paper suggest that additional energy storage is not necessary to protect an individual load from a HEMP insult. The simulations performed examine the response of a single-phase SST connected to a single voltage source on a long transmission line on the one side and a single linear resistor on the other. The control law is specifically developed for the late-time, low-frequency portion of a HEMP insult, namely the 𝐸 3𝐴 components. The Hamiltonian error-based converter ratio control law is compared with nonlinear optimal feedforward controls to show that the HSSPFC is an external energy storage optimal controller.

HEMP mitigation

MTL_TX: A Multi-Task Transformer Model for Improved Radiation Time-Series Estimation

Controlling radiation doses at potential radioactive facilities is critical to ensuring the safety of both personnel and the public. At the Thomas Jefferson National Accelerator Facility (JLab), multiple sensors are deployed around the three experimental halls to monitor key parameters, including single-beam current, energy levels, current leakage, and radiation values during accelerator operations. In this study, we developed a Multi-task Transformer model, MTL_TX, to accurately estimate radiation doses at sensor locations based on historical data, with the aim of enhancing safety in accelerator facilities and surrounding public areas. To improve estimation accuracy, we integrated two innovative components into the proposed model: hierarchical feature embedding (HFE) and multi-level decomposition attention (MDA). Additionally, the multi-task learning (MTL) framework effectively leverages correlations among multiple sensors, enabling individual estimations for each sensor. MTL_TX achieved outstanding results on data collected in 2018, with an MSE of 0.1464, an RMSE of 0.2353, and an R 2 score of 0.8584. Furthermore, when trained on 2018 data, MTL_TX exhibited excellent generalization capability to unseen datasets from 2016 to 2019, achieving an MSE of 0.1407, an RMSE of 0.2263, and an R 2 score of 0.8831. These results demonstrate a significant improvement over existing state-of-the-art models.

Transformer

Hidden Rotation Symmetry of the Jordan–Wigner Transformation and Its Application to Measurement in Quantum Computation

Using a global rotation by 𝜃 about the z-axis in the spin sector of the Jordan–Wigner transformation rotates Pauli matrices 𝑋̂ and 𝑌̂ in the 𝑥−𝑦 -plane, while it adds a global complex phase to fermionic quantum states that have a fixed number of particles. With the right choice of angles, this relates expectation values of Pauli strings containing products of 𝑋̂ and 𝑌̂ to different products, which can be employed to reduce the number of measurements needed when simulating fermionic systems on a quantum computer. Here, we derive this symmetry and show how it can be applied to systems in Physics and Chemistry that involve Hamiltonians with only single-particle (hopping) and two-particle (interaction) terms. We also discuss the consequences of this for finding efficient measurement circuits in variational ground state preparation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Advanced Flexible Transformers

Advanced grid solutions are comprised of advanced transmission technologies and grid enhancing technologies. In this webinar, experts will provide participants with insights into eight advanced grid solutions. The advanced transmission technologies that will be discussed include point-to-point high voltage direct current and advanced conductoring and the grid enhancing technologies that experts will explore include topology optimization, advanced power flow control, dynamic line rating, energy storage, virtual power plants, and advanced flexible transformers

flexible power transformer, power flow controller,

Geothermal well testing pressure prediction by using a hybrid transformer model system: FORGE well use case

Geothermal has huge potential to become an indispensable component in achieving the goal of sustainable energy economy, given its capability to provide consistent baseload power to the electric grid. Injection tests are crucial in geothermal energy system as they naturally help to evaluate reservoir properties, understand fluid flow and even enhance reservoir performance. In this research, we developed a hybrid model system that integrates machine learning (ML) regression, a physics-based mathematical model, and transformer deep learning. Trained and validated using FORGE injection test dataset, this system can forecast the pressure variations both upward and downward over time. The pressure prediction achieved prediction accuracy within 3-6% variance of true pressure values. The system can significantly save time and reduce costs by testing only a few cycles and then using model predictions for further analysis, instead of conducting additional real injection cycle tests. The developed model system also holds promise for designing injection test processes and maintaining well production in geothermal energy. Presented at the IMAGE ‘25 Conference led by Shell.

FORGE

Affine Transformations to Correlate Experimental and Simulated EDS Spectra for Multi-Element Systems

Energy Dispersive X-ray Spectroscopy (EDS) is an essential technique for determining elemental concentrations and distributions within microstructures, critical for materials discovery, optimization, and qualification. However, most published EDS data is qualitative because current quantitative EDS analysis methods require extensive calibration and post-processing, limiting their practicality and widespread adoption. This work seeks to establish a framework for accelerated EDS characterization and spectrum analysis that can leverage ML to analyze correlations between various elemental compositions and resulting EDS spectra. The complex physics and data result in a high-dimensional problem that grows exponentially with the number of elements in the system and the complexity of the spectrum analysis. ML provides a way to compute and optimize the results of this highly dimensional problem in a flexible way to tailor it to the user’s specific needs and material system. However, the framework emphasizes transparency through a strictly mathematical affine transformation, so the analysis remains understandable and reviewable to facilitate adoption by the scientific community. While currently implemented methods are simplistic and unvalidated, further development and demonstration of this framework could enable high-throughput, accurate, and accessible EDS characterization.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Electronic Excitation‐Driven β‐Ga 2 O 3 Metastability Transformation and Self‐Organization Mechanism: β→κ/γ/δ Phases

Here, irradiation-driven multiphase self-organization presents emergent opportunities for the customization of nanoscale engineering properties, dynamically tuning strain-field distributions and interfacial electronic structures. Responding to intense electronic excitation-induced energy deposition, the dominant phase transformations, with varying Gibbs free energy $Δ,G^o_f$ are confirmed as β → κ → γ → δ that are located in specific microregions for Gallium (III) oxide (Ga 2 O 3 ), as follows: (i) Surface-localized interstitial accumulation under compressive stress triggers β → δ via semi-coherent interface formation. (ii) Tensile stress within latent tracks drives vacancy-mediated oxygen layer truncation (4/12 periodicity along ⟨0001⟩), stabilizing coherent 4H (ABCB) κ and 3C (ABC) β (ABC) interfaces through strain-compensated octahedral distortion. (iii) Screw dislocation-mediated lattice relaxation induces β → γ via cation disordering (Ga 3+ occupancy at β-interstitial sites), forming metastable spinel γ with mixed occupancy across 16d/8a Wyckoff sites. Irradiation-driven β-Ga 2 O 3 →κ/γ/δ transitions, as mechanistically revealed via inelastic thermal spike (i-TS) calculations and molecular dynamics simulations, induce defect-mediated nonlinear photoresponse, critical for optoelectronic engineering.

Han, Xinqing [Shandong Univ., Jinan (China)]

Phase Transformation and Water Adsorption Behavior of As‐Deposited and Annealed Ru Metal Thin Films Prepared by Atomic Layer Deposition

ABSTRACT Surfaces play a central role in catalytic processes, and understanding the transformation of ruthenium metal into ruthenium oxide during annealing is essential for tailoring functional catalytic interfaces. In this study, we systematically investigate ≈22 nm thick Ru metal films deposited by atomic layer deposition (ALD) at 300°C, focusing on their chemical composition, structural evolution, and surface hydration behavior following post‐deposition annealing in air from 400 to 600°C. Lab‐based and synchrotron X‐ray photoelectron spectroscopy (XPS) reveal a gradual conversion from metallic Ru to fully oxidized Ru 4+ with increasing annealing temperature, accompanied by a corresponding increase in lattice oxygen. X‐ray diffraction (XRD) shows amorphous Ru oxide phases at 400°C and 500°C that evolve into crystalline RuO 2 at 600°C, while atomic force microscopy (AFM) indicates enhanced grain growth and surface roughening upon annealing. Ambient‐pressure XPS (AP‐XPS) under controlled H 2 O vapor environments (1–17 Torr) demonstrates that samples annealed at 400°C and 500°C exhibit initially high hydroxyl coverage that decreases with increasing water vapor pressure, concurrent with a rise in molecular H 2 O adsorption. In contrast, the crystalline RuO 2 surface formed at 600°C maintains stable hydroxylation and supports increased water uptake. Overall, this work provides fundamental insight into Ru oxide–H 2 O interactions and establishes design principles for engineering oxide surfaces optimized for electrocatalytic applications.

APXPS

FREDA: A Web Application for the Processing, Analysis, and Visualization of Fourier‐Transform Mass Spectrometry Data

The high-resolution measurement capability of Fourier-transform mass spectrometry (FT-MS) has made it a necessity for exploring the molecular composition of complex organic mixtures, like soil, plant, aquatic, and petroleum samples. This demand has driven a need for informatics tools to explore and analyze FT-MS data in a robust and reproducible manner. FREDA is an interactive web application developed to enable spectrometrists to format, process, and explore their FT-MS data without the need for statistical programming expertise. FREDA was built to explore outputs from a molecular identification tool, like CoreMS, and provide a suite of methods to filter data, compute chemical properties of peaks, statistically compare samples and groups of samples, conduct exploratory data analysis, and download the results with a report detailing all steps conducted. To demonstrate the utility of FREDA, an example analysis was conducted using FT-MS data from a soil microbiology study of samples collected in two different soil depths at the Sphagnum bog forest north of Grand Rapids, Minnesota. Differences between the two depths are observed using Kendrick, Gibbs free energy, and van Krevelen plots. G-tests are used to quantify a significant difference between the groups. All analyses and plotting are conducted using only the FREDA application. FREDA is an open-source and readily available web application that allows users to explore and make statistically valid conclusions about their FT-MS data. The application is available online (https://map.emsl.pnnl.gov/app/freda) with a tutorial web series (https://youtu.be/k5HLE2kNSBY?si=yB6sGoyvzxrFf5MP) and freely accessible code on Github (https://github.com/EMSL-Computing/FREDA).

47 OTHER INSTRUMENTATION

Entanglement Renormalization for Quantum Field Theories with Discrete Wavelet Transforms

We propose an adaptation of Entanglement Renormalization for quantum field theories that, through the use of discrete wavelet transforms, strongly parallels the tensor network architecture of the Multiscale Entanglement Renormalization Ansatz (a.k.a. MERA). Our approach, called wMERA, has several advantages of over previous attempts to adapt MERA to continuum systems. In particular, (i) wMERA is formulated directly in position space, hence preserving the quasi-locality and sparsity of entanglers; and (ii) it enables a built-in RG flow in the implementation of real-time evolution and in computations of correlation functions, which is key for efficient numerical implementations. As examples, we describe in detail two concrete implementations of our wMERA algorithm for free scalar and fermionic theories in (1+1) spacetime dimensions. Possible avenues for constructing wMERAs for interacting field theories are also discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Generalized boost transformations in finite volumes and application to Hamiltonian methods

The investigation of hadron interactions within lattice QCD has been facilitated by the well-known quantisation condition, linking scattering phase shifts to finite-volume energies. Additionally, the ability to utilise systems at finite total boosts has been pivotal in smoothly charting the energy-dependent behaviour of these phase shifts. The existing implementations of the quantization condition at finite boosts rely on momentum transformations between rest and moving frames, defined directly in terms of the energy eigenvalues. This energy dependence is unsuitable in the formulation of a Hamiltonian. In this work, we introduce a novel approach to generalise the three-momentum boost prescription, enabling the incorporation of energy-independent finite-volume Hamiltonians within moving frames. We demonstrate the application of our method through numerical comparisons, employing a phenomenological ππ scattering example.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Graphitization of banana peel – synergistic effect of Ca and other elements of the biomass on carbon structure transformation

Recently, growing interest has been observed in using calcium as an effective catalyst for graphitizing disordered carbon materials derived from biomass and bioprecursors, such as cellulose and lignin, at relatively low tem peratures (<2000 °C). Herein, it is demonstrated that in the presence of elements such as calcium, silicon, sulfur, and potassium, which are abundant in banana peel composed of cellulose and lignin base, graphitization occurs much more effectively. The addition of external calcium source, in the form of calcium carbonate, to the banana peel-derived carbon and heat-treatment of the mixture under protective atmosphere up to 1750 °C results in a significant increase in the degree of the graphitization order and local formation of graphite crystals, whereas the same preparation and heat-treatment procedure applied to carbon material derived from pristine cellulose does not lead to such effective graphitization. It is indicated that the graphitization of banana peel carbon occurs due to the synergistic effect of the external Ca-based catalyst and the internal elements present in the raw biomass, supporting the transformation of the disordered graphene-like layers into graphitic structures. These findings are important for the future production of green graphite from biomass

09 BIOMASS FUELS