Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗

Inverse design for waveguide dispersion with a differentiable mode solver

Inverse design of optical components based on adjoint sensitivity analysis has the potential to address the most challenging photonic engineering problems. However, existing inverse design tools based on finite-difference-time-domain (FDTD) models are poorly suited for optimizing waveguide modes for adiabatic transformation or perturbative coupling, which lies at the heart of many important photonic devices. Among these, dispersion engineering of optical waveguides is especially challenging in ultrafast and nonlinear optical applications involving broad optical bandwidths and frequency-dependent anisotropic dielectric material response. In this work, we develop gradient back-propagation through a general-purpose electromagnetic eigenmode solver and use it to demonstrate waveguide dispersion optimization for second harmonic generation with maximized phase-matching bandwidth. This optimization of three design parameters converges in eight steps, reducing the computational cost of optimization by ∼100x compared to exhaustive search and identifying new designs for broadband optical frequency doubling of laser sources in the 1.3–1.4 µm wavelength range. Furthermore, we demonstrate that the computational cost of gradient back-propagation is independent of the number of parameters, as required for optimization of complex geometries. This technique enables practical inverse design for a broad range of previously intractable photonic devices.

Gray, Dodd (ORCID:000000030469599X)↗

Paradigm for universal quantum information processing with integrated acousto-optic frequency beamsplitters

Frequency-bin encoding offers tremendous potential in quantum photonic information processing, in which a single waveguide can support hundreds of lightpaths in a naturally phase-stable fashion. This stability, however, comes at a cost: arbitrary unitary operations can be realized by cascaded electro-optic phase modulators and pulse shapers, but require nontrivial numerical optimization for design and have thus far been limited to discrete tabletop components. In this article, we propose, formalize, and computationally evaluate a new paradigm for universal frequency-bin quantum information processing using acousto-optic scattering processes between distinct transverse modes. We show that controllable phase matching in intermodal processes enables 2 × 2 frequency beamsplitters and transverse-mode-dependent phase shifters, which together comprise cascadable FRequency-transverse-mODe Operations (FRODOs) that can synthesize any unitary via analytical decomposition procedures. Modeling the performance of both random gates and discrete Fourier transforms, we demonstrate the feasibility of high-fidelity quantum operations with existing integrated photonics technology, highlighting prospects of parallelizable operations achieving 100% bandwidth utilization. Our approach is realizable with CMOS technology, opening the door to scalable on-chip quantum information processing in the frequency domain.

Lukens, Joseph M. [Purdue Univ., West Lafayette, I↗

Generation of waves in magnetized plasma [PowerPoint]

The presentation goes through assumptions made for the study, sections on plasma dispersion, whistler modes for RBR, excitation of plane waves with antenna, dipole vs loop antenna, verification of results, excitation of whistler waves with electron beams, assumptions for the model, distribution of current in space in general case, Fourier transform of current distribution, resonant excitation of waves, and ending with a discussion of generic debunching.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Early detection and uncertainty quantification of rapid sea-level rise from Antarctica

Focal Areas: (i) classification and/or anomaly detection methods applied towards identifying critical climate system thresholds; improved emulator design for (ii) reducing computational costs relative to full-physics models and (iii) improved uncertainty quantification workflows. Rationale: The evolution of the Antarctic ice sheet in response to climate change remains the single largest uncertainty in projecting future sea-level rise (SLR), with risk-averse projections for 2100 spanning between zero and a half meter. During the past decade, DOE has made substantial investments in new ice sheet and Earth system models needed to improve both understanding and predictive capability in this area. Yet major challenges remain, including better understanding when and under what circumstances significant increases in SLR from Antarctica may be initiated and better quantifying uncertainties in model-based SLR projections. Here, we discuss the potential for transformative advances in these areas through the application of machine learning and artificial intelligence (ML and AI, respectively).

54 ENVIRONMENTAL SCIENCES↗

Embedding Sensors in 3D Printed Metal Structures

The Transformational Challenge Reactor (TCR) program is leveraging recent advances in modeling and simulation, materials, and additive manufacturing (AM) technologies to design a modern nuclear reactor. Some of the main TCR technologies include in situ monitoring and the integration of sensors during the manufacturing of quality-significant nuclear reactor components. This report describes the general procedure and process optimization for embedding sensors within generic stainless steel 316 (SS316) components using laser powder bed fusion (LPBF). A more detailed, quality-significant test plan and supporting procedures are available upon request (ORNL/TM-2021/2127). LPBF involves the use of a scanning laser to selectively melt regions of a powder bed, additively building a part layer by layer. This report describes the LPBF processing technique and discusses the effects of LPBF processing parameters on the success of the sensor embedding process. Experiments used machined cavities in the form of channels in an SS316 base for the sensors to lay in while material is additively built over the top, thereby embedding them in an SS316 matrix. A preliminary investigation involved using empty SS316 sheaths as surrogates to explore the effects of various LPBF processing parameters and the dimensional requirements of the machined channels. Microstructural investigations showed that a smaller channel width/depth combination closer to the sensor’s diameter was best for the embedding process. After the desired parameters were selected, Type-K thermocouples were embedded and evaluated post-embedding using nondestructive thermal testing, as well as destructive sectioning and microscopy. Post-build characterization showed that the thermocouples were well-bonded to the SS316 matrix and were fully functional after embedding. During thermal testing to temperatures up to 500 °C, the embedded thermocouples read consistently with one another and deviated only slightly from the readings of a nonembedded thermocouple located within the furnace. This slight discrepancy was most likely due to differences in the thermal time constants for a nonembedded thermocouple vs. a thermocouple embedded in a solid SS316 block. The results presented in this report will serve as the foundation for future work that will focus on embedding sensors in relevant TCR reactor components and eventually testing those components under neutron irradiation.

36 MATERIALS SCIENCE↗

Colorado Residential Resiliency and Managed Charging

Validate and model impacts of electric vehicle (EV) home charging on service transformers; analyze diverse grid locations and configurations to determine 'risk factors'; finalize/deliver new design tools and typical EV load curves; improve/issue new construction standards for transformers, secondaries, and services. To ensure residential charging equity, smart charge management strategies will be studied and analyzed with the goal of creating affordable demand charges for customers.

33 ADVANCED PROPULSION SYSTEMS↗

Time Series Foundation Models and Deep Learning Architectures for Earthquake Temporal and Spatial Nowcasting

Advancing the capabilities of earthquake nowcasting, the real-time forecasting of seismic activities, remains crucial for reducing casualties. This multifaceted challenge has recently gained attention within the deep learning domain, facilitated by the availability of extensive earthquake datasets. Despite significant advancements, the existing literature on earthquake nowcasting lacks comprehensive evaluations of pre-trained foundation models and modern deep learning architectures; each focuses on a different aspect of data, such as spatial relationships, temporal patterns, and multi-scale dependencies. This paper addresses the mentioned gap by analyzing different architectures and introducing two innovative approaches called Multi Foundation Quake and GNNCoder. We formulate earthquake nowcasting as a time series forecasting problem for the next 14 days within 0.1-degree spatial bins in Southern California. Earthquake time series are generated using the logarithm energy released by quakes, spanning 1986 to 2024. Our comprehensive evaluations demonstrate that our introduced models outperform other custom architectures by effectively capturing temporal-spatial relationships inherent in seismic data. The performance of existing foundation models varies significantly based on the pre-training datasets, emphasizing the need for careful dataset selection. However, we introduce a novel method, Multi Foundation Quake, that achieves the best overall performance by combining a bespoke pattern with Foundation model results handled as auxiliary streams.

97 MATHEMATICS AND COMPUTING↗

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

Ultra-heavy cosmic rays: Theoretical implications of recent observations

Extreme ultraheavy cosmic ray observations (Z greater or equal 70) are compared with r-process models. A detailed cosmic ray propagation calculation is used to transform the calculated source distributions to those observed at the earth. The r-process production abundances are calculated using different mass formulae and beta-rate formulae; an empirical estimate based on the observed solar system abundances is used also. There is the continued strong indication of an r-process dominance in the extreme ultra-heavy cosmic rays. However it is shown that the observed high actinide/Pt ratio in the cosmic rays cannot be fit with the same r-process calculation which also fits the solar system material. This result suggests that the cosmic rays probably undergo some preferential acceleration in addition to the apparent general enrichment in heavy (r-process) material. As estimate also is made of the expected relative abundance of superheavy elements in the cosmic rays if the anomalous heavy xenon in carbonaceous chondrites is due to a fissioning superheavy element.

Blake, J. B.↗

Ultraheavy cosmic rays - Theoretical implications of recent observations

The recent extreme ultraheavy cosmic-ray observations (Z greater than or equal to 70) are compared with r-process models. A detailed cosmic ray propagation calculation is used to transform the calculated source distributions to those observed at the earth. The r-process production abundances are calculated using different mass formulae and beta-rate formulae; an empirical estimate based on the observed solar-system abundances is also used. There is the continued strong indication of an r-process dominance in the extreme ultraheavy cosmic rays. It is shown that the observed high actinide/Pt ratio in the cosmic rays cannot be fitted with the same r-process calculation which also fits the solar-system material. This result suggests that the cosmic rays probably undergo some preferential acceleration in addition to the apparent general enrichment in heavy (r-process) material. An estimate is also made of the expected relative abundance of superheavy elements in the cosmic rays if the anomalous heavy xenon in carbonaceous chondrites is due to a fissioning superheavy element.

Blake, J. B.↗

Linear continuous and sampled-data systems

Program performs general analysis of linear and continuous, discrete and sampled-data systems using state-variable techniques. Program is especially suited analysis of linearized control system problems. It also can be used to model system described by combination of differential equations and Laplace transform blocks, such as aircraft control system.

Edwards, J. W.↗

Broad-band polarization in molecular spectra

The rotational lines of the CN(0,0) red system have been observed to show a strongly asymmetric Zeeman profile. Certain molecules are very susceptible to magnetic perturbation because of the weakness of their spin-rotation coupling; a fairly weak magnetic field can cause a complete Paschen-Back effect. The calculation of transition probabilities incorporating this effect into the Hamiltonian is discussed, and the detailed calculation is then given. The resulting transition probabilities are transformed into synthetic line profiles by using the Unno (1956) model of polarized radiation transfer. The dependence of the net polarized flux on magnetic field and equivalent width is investigated. It is shown that entire band systems may be significantly polarized. Broad-band circular polarization of sunspots may be due, in part, to molecular bands. Analysis of the CH G band indicates a magnetic field of 0.25-0.50 x 10 to the 6th gauss in the white dwarf G99-37, an order of magnitude lower than previous estimates.

Illing, R. M. E.↗

NASTRAN forced vibration analysis of rotating cyclic structures

Theoretical aspects of a new capability, developed and added to the general purpose finite element program NASTRAN Level 17.7, to conduct forced vibration analysis of turned cyclic structures rotating about their axis of symmetry, are presented. The effects of Coriolis and centripetal accelerations as well as those due to the translational acceleration of the axis of rotation, are included. The equations of motion are first derived for an arbitrary grid point of the cyclic sector finite element model and then extended for the complete model. The equations are solved by four principal steps: (1) transformation of applied loads at frequency-dependent circumferential harmonic components; (2) application of circumferential harmonic-dependent intersegment compatibility constraints; (3) solution of frequency-dependent circumferential harmonic components of displacements; and (4) recovery of frequency-dependent response in various segments of the total structure. Five interrelated examples are presented to illustrate the various features of the development.

Elchuri, V.↗

Performance analysis of the DSN baseband assembly (Bba) Real-Time Combiner (RTC)

The operation of the BBA Real Time Combiner (RTC) is discussed and its performance investigated in detail. It is shown that each channel of the RTC can be modelled by a simple block diagram in the z-transform domain from which all pertinent transient and steady state behavioral characteristics can be determined. In particular, the characteristic equation of the tracking loop and its equivalent noise bandwidth are found and used to evaluate the closed loop transient response and steady-state mean squared timing jitter. The impact of the totality of these loop jitter contributions on the combiner output SNR is evaluated and illustrated numerically. These results show that for parameters of interest to various space missions, the RTC is capable of providing significant SNR improvement relative to a single receiving antenna.

Simon, M. K.↗

Performance analysis of the DSN baseband assembly (Bba) Real-Time Combiner (RTC)

The operation of the BBA Real Time Combiner (RTC) is discussed and its performance investigated in detail. It is shown that each channel of the RTC can be modelled by a simple block diagram in the z-transform domain from which all pertinent transient and steady state behavioral characteristics can be determined. In particular, the characteristic equation of the tracking loop and its equivalent noise bandwidth are found and used to evaluate the closed loop transient response and steady state mean squared timing jitter. The impact of the totality of these loop jitter contributions on the combiner output SNR is evaluated and illustrated numerically. These results show that for parameters of interest to various space missions, the RTC is capable of providing significant SNR improvement relative to a single receiving antenna.

Simon, M. K.↗