Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Bio-based solutions to transform the climate and clean energy systems [Slides]

The study and use of non-model microbes in both natural and engineered systems, to tackle a range of national and global challenges. Unique combination of expertise from synthetic biology tool development and high throughput screening to aquatic and terrestrial environmental simulation systems.

54 ENVIRONMENTAL SCIENCES↗

Towards Improved Decision Making for the Smarter Grid: Geomagnetic Disturbance Implicit Modeling Uncertainty Quantification

Geomagnetic disturbances can greatly disrupt the power grid operation. This is caused by low-frequency changes in the earth’s magnetic field, which upon interaction with the deep earth conductivity induces a changing electric field at the earth’s surface. This in turn induces quasi-direct currents which have the potential to cause protective devices to operate, widespread damage to high-voltage transformers, or voltage collapse due to induced reactive power losses. While these impacts have been known since the 1940s, only recently have standards for GMD response been implemented. Because these standards are heavily based on models, it is important to understand when it is appropriate to make certain modeling assumptions. In this work, implicit modeling uncertainty is quantified for the purpose of enhanced decision making for disturbance impact mitigation. Considering electromagnetic models, modeling assumptions of non-uniform grounding, imbalanced operation, transformer saturation, and geomagnetically induced currents, voltage estimation values are analyzed. Statistical characteristics of modeling uncertainty are obtained by analysis of synthetically generated data. Results statistically characterize geomagnetic disturbances modeling uncertainty, providing an important tool for impact mitigation.

grid analysis↗

Hyperstealth dark matter and long-lived particles

A new dark matter candidate is proposed that arises as the lightest baryon from a confining 𝑆⁢𝑈⁡(𝑁) gauge theory which equilibrates with the Standard Model only through electroweak interactions. Surprisingly, this candidate can be as light as a few GeV. The lower bound arises from the intersection of two competing requirements: (i) the equilibration sector of the model must be sufficiently heavy, at least several TeV, to avoid bounds from colliders, and (ii) the lightest dark meson (that may be the dark 𝜂′, 𝜎, or the lightest glueball) has suppressed interactions with the SM and must decay before big bang nucleosynthesis. The low-energy dark sector consists of one flavor that is electrically neutral and an almost electroweak singlet. The dark matter candidate is the lightest baryon consisting of 𝑁 of these light flavors leading to a highly suppressed elastic scattering rate with the Standard Model (SM). The equilibration sector consists of vectorlike dark quarks that transform under the electroweak group, ensuring that the dark sector can reach thermal equilibrium with the SM in the early Universe. The lightest dark meson lifetimes vary between 10 −3 ≲ 𝑐⁢𝜏 ≲ 10 7 m, providing an outstanding target for LHC production and experimental detection. We delineate the interplay between the lifetime of the light mesons, the suppressed direct detection cross section of the lightest baryon, and the scale of equilibration sector that can be probed at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Prong Segmentation using Point Set Transformers in Multiple View Neutrino Detectors

NOvA is a long-baseline neutrino experiment studying neutrino oscillations by detecting neutrinos from the NuMI beam at Fermilab. Its physics analysis relies on accurate prong segmentation, which involves matching each hit to its source particle and identifying the particle type. This task has commonly been addressed using a combination of traditional clustering algorithms and convolutional neural networks (CNNs). However, NOvA’s detector design presents data as two sparse and decoupled 2D images (XZ and YZ views) rather than a native 3D representation, posing a significant challenge for traditional CNN-based models. In this talk, we propose a novel neural network based on the Point Set Transformer. By treating detector hits as sparse point clouds and implementing a cross-view attention mechanism, our model enables efficient information mixing between both views. Evaluated on NOvA simulated data, our model achieves superior accuracy while requiring significantly fewer computational resources compared to other models. Furthermore, the model demonstrates great performance when applied to Liquid Argon Time Projection Chamber (LArTPC) data, which shows its potential as a universal prong segmentation algorithm for multiple view neutrino detectors.

Liu, Jiaxi [UC, Irvine]↗

Measurements and model calculations of HCl column amounts and related parameters over McMurdo during the austral spring in 1989

Solar spectra obtained from a ground-based Fourier transform infrared instrument at McMurdo (Antarctica) in the spring of 1989 have been analyzed to determine total HCl column amounts. A one-dimensional photochemical model was used to simulate the rate of recovery of HCl in the springtime. Low column amounts (about 1 x 10 exp 15 molecules/sq cm) were observed in early September and may be attributed to the heterogeneous conversion of HCl to active chlorine species during the polar night. The rate of recovery of HCl is consistent with its production by chlorine atoms reacting with methane and is dependent on concentrations of active chlorine species and NO molecules in the altitude region from 12 to 22 km. High HCl column amounts (about 7 x 10 exp 15 molecules/sq cm) were observed following recovery in late October, suggesting that the lower stratosphere in the polar region had descended relative to mid-latitudes and that the degree of dechlorination of the transported air was very small.

Liu, X.↗

Automated ICRF heating surrogate modeling via machine learning

This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.

Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗

Influence of physical and chemical hydrology on bioremediation of a U-contaminated aquifer informed by reactive transport modeling incorporating 238 U/ 235 U ratios

Microbially-catalyzed reductive immobilization of aqueous uranium (U) as a solid phase has been proposed as a U remediation technique. Both laboratory and field experiments have demonstrated that this reduction reaction alters the 238 U/ 235 U ratio, producing a 238 U-enriched U(IV) solid. In contrast, other major U reactive transport processes fractionate these isotopes much less. This suggests the potential to quantify the extent of bioreduction occurring in groundwater containing U using the 238 U/ 235 U ratio, which would substantially improve upon current practices largely relying on U concentration measurements alone. Current reactive transport models for uranium dynamics include only concentration measurements, which are strongly influenced by highly coupled reactive transformation and aqueous transport processes. The complex physical and chemical behavior of U potentially compromises such quantitative analysis of U storage and release. Here we report the first numerical reactive transport model which explicitly incorporates variations in the 238 U/ 235 U ratio of U and demonstrates improved interpretation of the principal chemical reactions and groundwater transport processes affecting the subsurface mobility and distribution of this widespread contaminant. Recent U bioreduction studies performed in a contaminated aquifer in Rifle, Colorado, USA applied Rayleigh distillation models to interpret U stable isotope fractionation observed as a result of acetate amendment. These simplified models were unable to resolve the spatiotemporal pattern of U isotope fractionation recorded in the aqueous solutes. Here, we employ the multi-component, isotope-enabled CrunchTope reactive transport software to interpret these measured U isotope ratios, and demonstrate accurate reproduction of observed trends in both geochemistry and 238 U/ 235 U ratios for two consecutive years of field experiments. Overall, our results indicate that accurately modeling both the U concentration and isotope ratio distributions greatly constrains the parameter space of the model. We find that the transport properties of U in the Rifle aquifer are governed by the presence of low-permeability regions, which the isotopes are uniquely sensitive to. When U reduction is spatially constrained by these low-permeability regions, the shift in the 238 U/ 235 U ratio becomes more muted. Accurate modeling of observed U isotope ratios thus provides a powerful means to better understand bioremediation, and the current study serves to advance the application of this novel method.

238U/235U↗

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗

An Evaluation of Representation Learning Methods in Particle Physics Foundation Models

We present a systematic evaluation of representation learning objectives for particle physics within a unified framework. Our study employs a shared transformer-based particle-cloud encoder with standardized preprocessing, matched sampling, and a consistent evaluation protocol on a jet classification dataset. We compare contrastive (supervised and self-supervised), masked particle modeling, and generative reconstruction objectives under a common training regimen. In addition, we introduce targeted supervised architectural modifications that achieve state-of-the-art performance on benchmark evaluations. This controlled comparison isolates the contributions of the learning objective, highlights their respective strengths and limitations, and provides reproducible baselines. We position this work as a reference point for the future development of foundation models in particle physics, enabling more transparent and robust progress across the community.

Chen, Michael [Caltech]↗

Time-dependent treatment of scattering - Integral equation approaches using the time-dependent amplitude density

The time-dependent form of the Lippmann-Schwinger integral equation is used as the basis of several new wave packet propagation schemes. These can be formulated in terms of either the time-dependent wave function or a time-dependent amplitude density. The latter is nonzero only in the region of configuratiaon space for which the potential is nonzero, thereby in principle obviating the necessity of large grids or the use of complex absorbing potentials when resonances cause long collision times (leading, consequently, to long propagation times). Transition amplitudes are obtained in terms of Fourier transforms of the amplitude density from the time to the energy domain. The approach is illustrated by an application to a standard potential scattering model problem where, as in previous studies, the action of the kinetic energy operator is evaluated by fast Fourier transform (FFT) techniques.

Hoffman, David K.↗

Combining Satellite Data and Models to Assess the Impacts of Urbanization on the Continental US Surface Climate

Urbanization is one of the most important and long lasting forms of land transformation. Urbanization affects the surface climate in different ways: (1) by reduction of the vegetation fraction causing subsequent reduction in photosynthesis and plant s water transpiration, (2) by alternation of surface runoff and infiltration and their impacts on soil moisture and the water table, (3) by change in the surface albedo and surface energy partitioning, and (4) by transformation of the surface roughness length and modification of surface fluxes. Land cover and land use change maps including urban areas have been developed and will be used in a suite of land surface models of different complexity to assess the impacts of urbanization on the continental US surface climate. These maps and datasets based on a full range of available satellite data and ground observations will be used to characterize distant-past (pre-urban), recent-past (2001), present (2010), and near future (2020) land cover and land use changes. The main objective of the project is to assess the impacts of these land transformation on past, current and near-future climate and the potential feedbacks from these changes on the atmospheric, hydrologic, biological, and socio-economic properties beyond the immediate metropolitan regions of cities and their near suburbs. The WRF modeling system will be used to explore the nature and the magnitude of the two-way interactions between urban lands and the atmosphere and assess the overall regional dynamic effect of urban expansion on the northeastern US weather and climate

Bounoua, L.↗

2040 Vision Study: an Enlargement of Model Based Engineering

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms _ "design of the materials" (material scientist viewpoint) and "design with the materials" (structural analyst viewpoint) _ into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT's hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Arnold, Steven M.↗

2040 Vision Study: NASA’s T3 Implementation Activities

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA’s Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations) and discuss NASA’s TTT implementation activities, with special emphasis on recent accomplishments. The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms – “design of the materials” (material scientist viewpoint) and “design with the materials” (structural analyst viewpoint) – into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT’s hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United State's global competitiveness

Materials↗

Advances in Multiscale Modeling of Lignocellulosic Biomass

Applications and associated processing technologies of lignocellulosic biomass are becoming more important as we endeavor to meet societal demand for fuels, chemicals, and materials from renewable resources. Meanwhile, the rapidly expanding availability and capabilities of high-performance computing present an unprecedented opportunity to accelerate development of technologies surrounding lignocellulose utilization. In order to realize this potential, suitable modeling frameworks must be constructed that effectively capture the multiscale complexity and tremendous variety exhibited by lignocellulosic materials. In our assessment of previous endeavors towards this goal, several important shortcomings have been identified: (1) the lack of multiscale integration strategies that capture emergent properties and behaviors spanning different length scales, and (2) the inability of many modeling approaches to effectively capture the variability and diversity of lignocellulose that arise from both natural and process-induced sources. In this perspective, we survey previous modeling approaches for lignocellulose and simulations processes involving its chemical and mechanical transformation, and suggest opportunities for future development to enhance the utility of computational tools to address barriers to widespread adoption of a renewable bioeconomy.

09 BIOMASS FUELS↗

Excited-State and Nonadiabatic Molecular Dynamics Methods with Broad Applicability

Electronically excited states play a pivotal role in the capture, transformation, storage, and emission of radiative energy. Despite much recent progress for small model systems, excited state properties and dynamics in many larger molecular devices and materials have remained elusive for experiment and theory. Nonadiabatic transitions between electronic states turn radiative energy into heat and are particularly difficult to control. This project aims to develop new electronic structure and nonadiabatic molecular dynamics (NAMD) methods to simulate, predict, and ultimately control the flow and transformation of excitation energy in a wide-range of light-driven molecular devices such as dyes, photocatalysts, and fluorescence emitters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A new system model for radar polarimeters

The validity of the 2 x 2 receive R and transmit T model for radar polarimeter systems, first proposed by Zebker et al. (1987), is questioned. The model is found to be invalid for many practical realizations of radar polarimeters, which can lead to significant errors in the calibration of polarimetric radar images. A more general model is put forward, which addresses the system defects which cause the 2 x 2 model to break down. By measuring one simple parameter from a polarimetric active radar calibration (PARC), it is possible to transform the scattering matrix measurements made by a radar polarimeter to a format compatible with a 2 x 2 R and T matrix model. Alternatively, the PARC can be used to verify the validity of the 2 x 2 model for any polarimetric radar system. Recommendations for the use of PARCs in polarimetric calibration and to measure the orientation angle of the horizontal (H) and vertical (V) coordinate system are also presented.

Freeman, Anthony↗

Jet Noise Modeling for Coannular Nozzles Including the Effects of Chevrons

Development of good predictive models for jet noise has always been plagued by the difficulty in obtaining good quality data over a wide range of conditions in different facilities.We consider such issues very carefully in selecting data to be used in developing our model. Flight effects are of critical importance, and none of the means of determining them are without significant problems. Free-jet flight simulation facilities are very useful, and can provide meaningful data so long as they can be analytically transformed to the flight frame of reference. In this report we show that different methodologies used by NASA and industry to perform this transformation produce very different results, especially in the rear quadrant; this compels us to rely largely on static data to develop our model, but we show reasonable agreement with simulated flight data when these transformation issues are considered. A persistent problem in obtaining good quality data is noise generated in the experimental facility upstream of the test nozzle: valves, elbows, obstructions, and especially the combustor can contribute significant noise, and much of this noise is of a broadband nature, easily confused with jet noise. Muffling of these sources is costly in terms of size as well as expense, and it is particularly difficult in flight simulation facilities, where compactness of hardware is very important, as discussed by Viswanathan (Ref. 13). We feel that the effects of jet density on jet mixing noise may have been somewhat obscured by these problems, leading to the variable density exponent used in most jet noise prediction procedures including our own. We investigate this issue, applying Occam s razor, (e.g., Ref. 14), in a search for the simplest physically meaningful model that adequately describes the observed phenomena. In a similar vein, we see no reason to reject the Lighthill approach; it provides a very solid basis upon which to build a predictive procedure, as we believe we demonstrate in this report. Another feature of our approach is that the analyses are all conducted with lossless spectra, rather than Standard Day spectra, as is often done in industry. We feel that it is important to isolate the effects of as many physical processes as practical. Atmospheric attenuation can then be included using the relations developed for NASA by Shields and Bass (Ref. 15), which are available in both FOOTPR and ANOPP. The current approach to coannular jet noise prediction used in FOOTPR is reported in Reference 16, which updates the earlier conventional-velocity-profile (CVP, Ref. 17) and inverted-velocity-profile (IVP, Ref. 18) models.

Stone, James R.↗

Multi-scale modeling of wastage layer formation in metallic fuel cladding

Fuel-cladding chemical interaction (FCCI) is a major concern for U-Zr metallic fuels' performance, primarily due to the formation of a brittle layer (wastage) in the cladding. This brittle layer, resulting from intermetallic compounds between cladding constituents Fe, Cr, and lanthanide fission products, significantly impacts the cladding's mechanical integrity. Recent efforts focus on developing a mechanistic modeling framework to understand lanthanide production, transport to the fuel-cladding interface, and phase transformation to intermetallic phases. A multi-scale computational approach has been used to calculate lanthanide transport rates, with atomistic calculations determining Nd diffusivities through the solid fuel matrix and along pore surfaces. These diffusivities inform a mesoscale model to determine an effective diffusion coefficient, accounting for porosity and infiltration with bond sodium. This effective diffusivity is used in engineering-scale simulations via the BISON fuel performance code, which has been validated against EBR-II and FFTF reactor experiments.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗