Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Simulation of intense microwave pulse propagation in air breakdown environment

An experiment is conducted to examine the tail erosion phenomenon which occurs to an intense microwave pulse propagating in air breakdown environment. In the experiment, a 1 MW microwave pulse (1.1 microsec) is transmitted through a large plexiglas chamber filled with dry air at about 1-2 torr pressure. Two different degrees of tail erosion caused by two different mechanisms are identified. This experimental effort leads to the understanding of the fundamental behavior of tail erosion and provides a data base for validating the theoretical model. A theoretical model based on two coupled partial differential equations is established to describe the propagation on an intense microwave pulse in air breakdown environment. One is derived from the Poynting theorem, and the other one is the rate equation of electron density. A semi-empirical formula of the ionization frequency is adopted for this model. A transformation of these two equations to local time frame of reference is introduced so that they can be solved numerically with considerably reduced computation time. This model is tested by using it to perform the computer simulation of the experiment. The numerical results are shown to agree well with the experimental results.

Kuo, S. P.↗
DOE OSTI2023

TwoFold: Highly accurate structure and affinity prediction for protein-ligand complexes from sequences

We describe our development of ab initio protein-ligand binding pose prediction models based on transformers and binding affinity prediction models based on the neural tangent kernel (NTK). Folding both protein and ligand, the TwoFold models achieve efficient and quality predictions matching state-of-the-art implementations while additionally reconstructing protein structures. In conclusion, solving NTK models points to a new use case for highly optimized linear solver benchmarking codes on HPC.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Quantifying Impacts of Renewable Electricity Deployment on Air Quality and Human Health in Southeast Asia Based on Aims III Scenarios

Exposure to outdoor air pollution is the largest environmental risk factor for death and disease worldwide, associated with millions of cases of excess deaths (mortality) each year. Although there are many pollutants in the air that affect our health, the most important class of pollutants is fine particulate matter, PM 2.5 , which are airborne particles of diameter ≤2.5 micrometers (µm). These particles are small enough to deposit deep in the respiratory system where they can then enter the bloodstream, traveling and causing damage to other bodily systems. Exposure to outdoor (ambient) PM 2.5 has been found to be the most important environmental risk factor for mortality in Southeast Asia, associated with 130,000 - 320,000 excess deaths in Association of Southeast Asian Nations (ASEAN) member countries in 2019. Southeast Asia, especially its mega-cities, but also other areas, has some of the worst air quality in the world. Almost all human activity emits air pollutants. Fine particulate matter is both directly emitted and formed in the atmosphere through chemical reactions, the latter of which requires modeling to predict. Power generation is one of the major sources of air pollutants that lead to elevated concentrations of fine particulate matter, including in Southeast Asia. Fossil fuel combustion for power generation, especially coal but also diesel, is the main source of air pollutant emissions from power generation. While natural gas burns cleaner than coal or diesel, in the quantities combusted for power generation in Southeast Asia, it is also a significant emitter. This study augments the ASEAN Interconnection Masterplan Study III (AIMS III) by quantifying changes to air quality and human health that result from its renewable integration and transmission interconnection scenarios. Performing this analysis requires translation of the changes in projected generation from different power sector fuel sources in the AIMS III scenarios to changes in air pollutant emissions, developing what's known as an emissions inventory for each scenario and year evaluated. We then use for the first time a new global, reduced-complexity air quality model to transform the changes in emissions to changes in air pollutant concentration of the deadliest air pollutant for human health, fine particulate matter (or PM 2.5 ). The air quality model, Global InMAP, then utilizes the location of human population in ASEAN countries to calculate exposure to PM 2.5 concentration changes and translates that to estimates of excess mortality attributable to the AIMS III scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

A Level Set Model for Structured Mesh Representation of Fibrous Preforms used in Composites Manufacturing

Here, a model for implicit representation of fibrous and woven preforms used for composites manufacturing is described. The method is based on a level set function defined on a structured mesh to implicitly capture the complex fiber and weave geometries. Since most software packages used to model woven preforms are based on unstructured mesh, a numerical model for transforming a discretized surface to a structured mesh representation and vice-a-versa is presented. Specific emphasis is on scalable computation of a level set function for large and complex 3D woven structures from a triangulated surface of the smallest unit (yarn). The model is applied to capture a periodic 3D layered 5-harness satin (5HS) weave geometry on a structured mesh. Geometric transformations needed to efficiently compute the level set function for the 3D structure on a high resolution mesh are described. Effects of mesh resolution on the geometric features such as number of resolved fibers, effective fiber size, and the surface area to volume ratio of the iso-surface are analyzed. Using the distance property of the level set function, an approach to evaluate the structure function resulting from transient evolving topology representing densification due to matrix phase depositions is also presented. The approach captures transition of the geometric characteristic from fiber governed at early stages of densification to yarn governed at the terminal stage.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Survey of Advanced Generation IV Reactor Parameters for Integrated Energy System Modeling Capabilities

This paper is to categorize and characterize advanced Generation IV nuclear reactors that are not water based according to the key parameters for the Integrated Energy Systems (IES) project[1]. A key goal of the IES project is to assess the economic viability of including an advanced nuclear reactor into an IES. The landscape of advanced reactors is heterogeneous: several unique designs with different heat profiles are currently being studied and designed. This report provides a high-level perspective of advanced reactor concepts, including primary loop nuclear output temperatures and operation schemes that could affect secondary side power production or storage. For example, this report addresses the type of thermodynamic system (Brayton, supercritical CO 2 [S-CO 2 ], etc.) and the various pressures and temperatures on the secondary side that are expected to be provided by the various primary side reactor types. Based on these characteristics, it may be possible to determine which type of nuclear power plant could be the most economical for analysis in the IES framework for power production coupled with energy storage and waste heat utilization. The results of this effort will serve as input for model development of various secondary side components, concentrating on off-the-shelf capabilities for current and near future secondary side power generation and heat rejection as simulated in TRANSFORM. Generic models can be created which are agnostic of the nuclear energy supply without violating intellectual property rights of the developer. These models can be used to make informed decisions on the economics of integrating various energy system components with nuclear plant designs. Once complete, conclusions may be drawn regarding (1) the economics, efficiency, and reliability of certain nuclear reactors, (2) certain industry processes and energy storage systems, and (3) prioritization of certain reactor types with the studied industry types.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

DECT-MULTRA: Dual-Energy CT Image Decomposition With Learned Mixed Material Models and Efficient Clustering

Dual-energy computed tomography (DECT) imaging plays an important role in advanced imaging applications due to its material decomposition capability. Image-domain decomposition operates directly on CT images using linear matrix inversion, but the decomposed material images can be severely degraded by noise and artifacts. This paper proposes a new method dubbed DECT-MULTRA for image-domain DECT material decomposition that combines conventional penalized weighted-least squares (PWLS) estimation with regularization based on a mixed union of learned transforms (MULTRA) model. Our proposed approach pre-learns a union of common-material sparsifying transforms from patches extracted from all the basis materials, and a union of cross-material sparsifying transforms from multi-material patches. The common-material transforms capture the common properties among different material images, while the cross-material transforms capture the cross-dependencies. The proposed PWLS formulation is optimized efficiently by alternating between an image update step and a sparse coding and clustering step, with both of these steps having closed-form solutions. The effectiveness of our method is validated with both XCAT phantom and clinical head data. The results demonstrate that our proposed method provides superior material image quality and decomposition accuracy compared to other competing methods.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Multiscale Modeling of the Mechanical Response of Silicon Carbide Composite Within the Accelerated Fuel Qualification Framework

The accelerated fuel qualification (AFQ) framework has been used for the initial development of multiscale modeling of silicon carbide (SiC) fiber reinforced composite (SiC-SiC). The AFQ framework provides a methodology to leverage physics-informed multiscale modeling along with a reduced set of empirical test data to reduce the time and cost of licensing and qualification of new nuclear fuel systems while maintaining the overall nuclear power plant safety case. SiC-SiC is being proposed for in-core applications, most notably fuel cladding, for current and next-generation nuclear reactors because of its high temperature stability, irradiation tolerance, and ability to withstand many accident conditions. As these composites exhibit multiscale architectures and complex microstructure-based fracture mechanics, it is an appealing use case for the AFQ methodology. While the end goal of this work is a single multiscale model that can be used for predictive in-core performance, current focus is on the individual various length scale models. Four individual models have been initially developed from microscale to engineering system level to capture key physics-based effects across different length scales. These models include a microscale homogenized tow model, a mesoscale fast Fourier transform–based weave model that integrates the homogenized tow model, a mesoscale finite element–based weave model, and a system-level BISON fuel performance model. Results of these models have undergone an initial comparison with separate-effects test data showing a good match to experimental results. By using the AFQ framework during model development, several near-term benefits have been secured including a reduction in development time for the SiC-SiC cladding, more targeted irradiation testing, and a better understanding of uncertainty.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

BI-LEVEL OPTIMIZATION FOR ELECTRICITY TRANSACTION IN SMART COMMUNITY WITH MODULAR PUMP HYDRO STORAGE

Grid integration of the increasing distributed energy resources could be challenging in terms of new infrastructure investment, power grid stability, etc. To resolve more renewables locally and reduce the need for extensive electricity transmission, a community energy transaction market is assumed with market operator as the leader whose responsibility is to generate local energy prices and clear the energy transaction payment among the prosumers (followers). The leader and multi-followers have competitive objectives of revenue maximization and operational cost minimization. This non-cooperative leader-follower (Stackelberg) game is formulated using a bi-level optimization framework, where a novel modular pump hydro storage technology (GLIDES system) is set as an upper level market operator, and the lower level prosumers are nearby commercial buildings. The best responses of the lower level model could be derived by necessary optimality conditions, and thus the bi-level model could be transformed into single level optimization model via replacing the lower level model by its Karush-Kuhn-Tucker (KKT) necessary conditions. Several experiments have been designed to compare the local energy transaction behavior and profit distribution with the different demand response levels and different local price structures. The experimental results indicate that the lower level prosumers could benefit the most when local buying and selling prices are equal, while maximum revenue potential for the upper level agent could be reached with non-equal trading prices.

Chen, Yang↗
DOE OSTI2024

Chemical Reactivity Through Adaptive Quantum Mechanics/Many-Body Representations: Theoretical Development, Software Implementation, and Applications (Final Report)

The main objective of this research project was the development and application of a new theoretical/computational framework to model chemical transformations and electronic excitations in fluid mixtures across different phases. Our theoretical/computational framework combines our data-driven many-body (DD-MB) potentials representing molecular interactions with adaptive schemes for modeling chemical reactions in solution. The combination of these two components resulted in an adaptive quantum mechanics/many-body (adQM/MB) method that largely suppresses discontinuities between QM and MM regions, which affect existing QM/MM methods, and thus provides an accurate representation of both quantum mechanical and environmental effects through a rigorous description of mutual polarization between QM and MM regions. The implementation of our DD-MB potentials and adQM/MB method in popular software enabled computer simulations of solvation phenomena, reactive processes, and electronic excitations in fluid mixtures with chemical and spectroscopic accuracy, representing a major step toward realistic computer simulations of a wide range of molecular systems relevant to the DOE mission.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Identification of Blue Horizontal Branch Stars with Multimodal Fusion

Blue Horizontal Branch stars (BHBs) are ideal tracers to probe the global structure of the milky Way (MW), and the increased size of the BHB star sample could be helpful to accurately calculate the MW's enclosed mass and kinematics. Large survey telescopes have produced an increasing number of astronomical images and spectra. However, traditional methods of identifying BHBs are limited in dealing with the large scale of astronomical data. A fast and efficient way of identifying BHBs can provide a more significant sample for further analysis and research. Therefore, in order to fully use the various data observed and further improve the identification accuracy of BHBs, we have innovatively proposed and implemented a Bi-level attention mechanism-based Transformer multimodal fusion model, called Bi-level Attention in the Transformer with Multimodality (BATMM). The model consists of a spectrum encoder, an image encoder, and a Transformer multimodal fusion module. The Transformer enables the effective fusion of data from two modalities, namely image and spectrum, by using the proposed Bi-level attention mechanism, including cross-attention and self-attention. As a result, the information from the different modalities complements each other, thus improving the accuracy of the identification of BHBs. The experimental results show that the F1 score of the proposed BATMM is 94.78%, which is 21.77% and 2.76% higher than the image and spectral unimodality, respectively. It is therefore demonstrated that higher identification accuracy of BHBs can be achieved by means of using data from multiple modalities and employing an efficient data fusion strategy.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2004

Architecting a Simulation Framework for Model Rehosting

The utility of vehicle math models extends beyond human-in-the-loop simulation. It is desirable to deploy a given model across a multitude of applications that target design, analysis, and research. However, the vehicle model alone represents an incomplete simulation. One must also replicate the environment models (e.g., atmosphere, gravity, terrain) to achieve identical vehicle behavior across all applications. Environment models are increasing in complexity and represent a substantial investment to re-engineer for a new application. A software component that can be rehosted in each application is one solution to the deployment problem. The component must encapsulate both the vehicle and environment models. The component must have a well-defined interface that abstracts the bulk of the logic to operate the models. This paper examines the characteristics of a rehostable modeling component from the perspective of a human-in-the-loop simulation framework. The Langley Standard Real-Time Simulation in C++ (LaSRS++) is used as an example. LaSRS++ was recently redesigned to transform its modeling package into a rehostable component.

Madden, Michael M.↗
DOE OSTI2025

A foundation model for atomistic materials chemistry

Atomistic simulations of matter, especially those that leverage first-principles (ab initio) electronic structure theory, provide a microscopic view of the world, underpinning much of our understanding of chemistry and materials science. Over the last decade or so, machine-learned force fields have transformed atomistic modeling by enabling simulations of ab initio quality over unprecedented time and length scales. However, early machine-learning (ML) force fields have largely been limited by (i) the substantial computational and human effort required to develop and validate potentials for each particular system of interest and (ii) a general lack of transferability from one chemical system to the next. Here, we show that it is possible to create a general-purpose atomistic ML model, trained on a public dataset of moderate size, that is capable of running stable molecular dynamics for a wide range of molecules and materials. We demonstrate the power of the MACE-MP-0 model-and its qualitative and at times quantitative accuracy-on a diverse set of problems in the physical sciences, including properties of solids, liquids, gases, chemical reactions, interfaces, and even the dynamics of a small protein. The model can be applied out of the box as a starting or "foundation" model for any atomistic system of interest and, when desired, can be fine-tuned on just a handful of application-specific data points to reach ab initio accuracy. Establishing that a stable force-field model can cover almost all materials changes atomistic modeling in a fundamental way: experienced users obtain reliable results much faster, and beginners face a lower barrier to entry. Foundation models thus represent a step toward democratizing the revolution in atomic-scale modeling that has been brought about by ML force fields.

Batatia, Ilyes↗
NASA NTRS2010

Environmental Impact Specification for Direct Space Weathering of Kuiper Belt and Oort Cloud Objects

The Direct Space Weathering Project of NASA's Outer Planets Research Program addresses specification of the plasma and energetic particle environments for irradiation and surface chemical processing of icy bodies in the outer solar system and the local interstellar medium. Knowledge of the radiation environments is being expanded by ongoing penetration of the twin Voyager spacecraft into the heliosheath boundary region of the outer heliosphere and expected emergence within the next decade into the very local interstellar medium. The Voyager measurements are being supplemented by remote sensing from Earth orbit of energetic neutral atom emission from this boundary region by NASA's Interstellar Boundary Explorer (IBEX). Although the Voyagers long ago passed the region of the Classical Kuiper Belt, the New Horizons spacecraft will encounter Pluto in 2015 and thereafter explore one or more KBOs, meanwhile providing updated measurements of the heliospheric radiation environment in this region. Modeling of ion transport within the heliosphere allows specification of time-integrated irradiation effects while the combination of Voyager and IBEX data supports projection of the in-situ measurements into interstellar space beyond the heliosheath. Transformation of model ion flux distributions into surface sputtering and volume ionization profiles provides a multi-layer perspective for space weathering impact on the affected icy bodies and may account for some aspects of color and compositional diversity. Other important related factors may include surface erosion and gardening by meteoritic impacts and surface renewal by cryovolcanism. Chemical products of space weathering may contribute to energy resources for the latter.

Cooper, John F.↗
NASA NTRS2017

Genetic Algorithm-Guided, Adaptive Model Order Reduction of Flexible Aircrafts

This paper presents a methodology for automated model order reduction (MOR) of flexible aircrafts to construct linear parameter-varying (LPV) reduced order models (ROM) for aeroservoelasticity (ASE) analysis and control synthesis in broad flight parameter space. The novelty includes utilization of genetic algorithms (GAs) to automatically determine the states for reduction while minimizing the trial-and-error process and heuristics requirement to perform MOR; balanced truncation for unstable systems to achieve locally optimal realization of the full model; congruence transformation for "weak" fulfillment of state consistency across the entire flight parameter space; and ROM interpolation based on adaptive grid refinement to generate a globally functional LPV ASE ROM. The methodology is applied to the X-56A MUTT model currently being tested at NASA/AFRC for flutter suppression and gust load alleviation. Our studies indicate that X-56A ROM with less than one-seventh the number of states relative to the original model is able to accurately predict system response among all input-output channels for pitch, roll, and ASE control at various flight conditions. The GA-guided approach exceeds manual and empirical state selection in terms of efficiency and accuracy. The adaptive refinement allows selective addition of the grid points in the parameter space where flight dynamics varies dramatically to enhance interpolation accuracy without over-burdening controller synthesis and onboard memory efforts downstream. The present MOR framework can be used by control engineers for robust ASE controller synthesis and novel vehicle design.

Numerical Analysi↗
NASA NTRS1981

Effects of vegetation on passive microwave estimates of soil moisture

Data collected over plots using a microwave radiometer with a wavelength of 21 cm were used to evaluate a theoretical model of the effect of vegetative cover on the emission of soils. The theoretical model was used as a basis of a simplified model which predicts the emissivity of a soil-vegetation complex with a full canopy cover. This model, when transformed to predict soil moisture, requires measurements of the microwave brightness temperature, surface temperature and vegetation biomass. Since surface temperature can be determined using thermal infrared measurements and vegetation biomass could be estimated with visible and near infrared measurements, the simplified model could be applied using only remotely sensed data.

Jackson, T. J.↗
NASA NTRS1989

Performance of FFT methods in local gravity field modelling

Fast Fourier transform (FFT) methods provide a fast and efficient means of processing large amounts of gravity or geoid data in local gravity field modelling. The FFT methods, however, has a number of theoretical and practical limitations, especially the use of flat-earth approximation, and the requirements for gridded data. In spite of this the method often yields excellent results in practice when compared to other more rigorous (and computationally expensive) methods, such as least-squares collocation. The good performance of the FFT methods illustrate that the theoretical approximations are offset by the capability of taking into account more data in larger areas, especially important for geoid predictions. For best results good data gridding algorithms are essential. In practice truncated collocation approaches may be used. For large areas at high latitudes the gridding must be done using suitable map projections such as UTM, to avoid trivial errors caused by the meridian convergence. The FFT methods are compared to ground truth data in New Mexico (xi, eta from delta g), Scandinavia (N from delta g, the geoid fits to 15 cm over 2000 km), and areas of the Atlantic (delta g from satellite altimetry using Wiener filtering). In all cases the FFT methods yields results comparable or superior to other methods.

Forsberg, Rene↗
DOE OSTI2024

BioRT‐HBV 1.0: A Biogeochemical Reactive Transport Model at the Watershed Scale

Abstract Reactive Transport Models (RTMs) are essential tools for understanding and predicting intertwined ecohydrological and biogeochemical processes on land and in rivers. While traditional RTMs have focused primarily on subsurface processes, recent watershed‐scale RTMs have integrated ecohydrological and biogeochemical interactions between surface and subsurface. These emergent, watershed‐scale RTMs are often spatially explicit and require extensive data, computational power, and computational expertise. There is however a pressing need to create parsimonious models that require minimal data and are accessible to scientists with limited computational background. To that end, we have developed BioRT‐HBV 1.0, a watershed‐scale, hydro‐biogeochemical RTM that builds upon the widely used, bucket‐type HBV model known for its simplicity and minimal data requirements. BioRT‐HBV uses the conceptual structure and hydrology output of HBV to simulate processes including advective solute transport and biogeochemical reactions that depend on reaction thermodynamics and kinetics. These reactions include, for example, chemical weathering, soil respiration, and nutrient transformation. The model uses time series of weather (air temperature, precipitation, and potential evapotranspiration) and initial biogeochemical conditions of subsurface water, soils, and rocks as input, and output times series of reaction rates and solute concentrations in subsurface waters and rivers. This paper presents the model structure and governing equations and demonstrates its utility with examples simulating carbon and nitrogen processes in a headwater catchment. As shown in the examples, BioRT‐HBV can be used to illuminate the dynamics of biogeochemical reactions in the invisible, arduous‐to‐measure subsurface, and their influence on the observed stream or river chemistry and solute export. With its parsimonious structure and easy‐to‐use graphical user interface, BioRT‐HBV can be a useful research tool for users without in‐depth computational training. It can additionally serve as an educational tool that promotes pollination of ideas across disciplines and foster a diverse, equal, and inclusive user community.

Sadayappan, Kayalvizhi↗
NASA NTRS1977

A comparison between the current models of mid-latitude spread F and data from the Arecibo Observatory

The current models of mid-latitude F sub s are studied. The assumptions and derivations of the Reid model, the Scannapieco model, and the Perkins model are presented in detail. Incoherent-scatter data of the density profiles and velocity profiles were obtained in order that the models could be evaluated on the basis of experimental data. Initial studies indicated that the Perkins model was most representative of the data from Arecibo, so a detailed comparison of the predictions of the Perkins model and the data was made. Two of four nights studied are nights with F sub s. The Perkins model is derived in a frame of reference moving with the velocity of the neutral wind; the model is transformed to the rest frame to facilitate comparison with data. Several data handling techniques are introduced. In particular, an integration interval that remains constant in length, but follows the vertical motion of the peak of the F layer is used to obtain the field integrated quantities of the Perkins model.

Imel, G.↗