Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Formation of model polar stratospheric cloud films

Fourier transform infrared spectroscopy was used to examine the competitive growth of films representative of polar stratospheric clouds. These experiments show that either crystalline nitric acid trihydrate (beta-NAT) or amorphous films with H2O:HNO3 ratios close to 3:1 formed at temperatures 3-7 K warmer than the ice frost point under stratospheric pressure conditions. In addition, with higher HNO3 pressure, we observed nitric acid dihydrate (NAD) formation at temperatures warmer than ice formation. However, our experiments also show that NAD surfaces converted to beta-NAT upon exposure to stratospheric water pressures. Finally, we determined that the net uptake coefficient for HNO3 on beta-NAT is close to unity, whereas the net uptake coefficient for H2O is much less.

Middlebrook, Ann M.↗
NASA NTRS2006

Using global aerosol models and satellite data for air quality studies: Challenges and data needs

Aerosol particles, also known as PM2.5 (particle diameter less than 2.5 pm) and PM10 (particle diameter less than 10 pm), are one of the key atmospheric components that determines air quality. Yet, air quality forecasts for PM are still in their infancy and remain a challenging task. It is difficult to simply relate PM levels to local meteorological conditions, and large uncertainties exist in regional air quality model emission inventories and initial and boundary conditions. Especially challenging are periods when a significant amount of aerosol comes from outside the regional modeling domain through long-range transport. In the past few years, NASA has launched several satellites with global aerosol measurement capabilities, providing large-scale chemical weather pictures. NASA has also supported development of global models which simulate atmospheric transport and transformation processes of important atmospheric gas and aerosol species. I will present the current modeling and satellite capabilities for PM2.5 studies, the possibilities and challenges in using satellite data for PM2.5 forecasts, and the needs of future remote sensing data for improving air quality monitoring and modeling.

Chin, Mian↗
DOE OSTI2025

Denoising Seismograms in the Time Domain Using a Deep Learning Model

Deep learning has emerged as a transformative tool for enhancing the extraction of reliable information from seismograms, addressing the increasing demand for precise and efficient seismic data analysis. We introduce an innovative encoder–decoder deep learning model, named WaveDenoiser, designed for noise reduction in the time domain, thereby eliminating the need for spectrogram computations that have been used for existing deep learning tools and significantly improving processing speed. Utilizing the benchmark dataset that is Stanford Earthquake Dataset, we developed three models of varying sizes: base, medium, and large. Notably, the large (referred to as WaveDenoiser) model demonstrated superior performance, achieving a median signal‐to‐noise ratio improvement of 8.8 dB on in‐distribution unseen data (in the same geographic region) and 7.7 dB on out‐distribution unseen data (in a new geographic region), outpacing both the base and medium models. Further evaluation of the WaveDenoiser model revealed a reduction in median arrival‐time errors by 0.02 s for P waves and 0.01 s for S waves when processing waveforms prior to phase picking using PhaseNet on in‐distribution unseen data. When tested on out‐distribution unseen data, the model also effectively reduced the P‐wave median arrival‐time error by 0.02 and 0.01 s in median arrival‐time error for S waves. Importantly, the application of WaveDenoiser resulted in a significant reduction of phase picking outliers by 1.1% to 3.6% for both P and S waves. In addition, we achieved over five times acceleration in processing speed compared with the seisBench implementation of DeepDenoiser. Our findings underscore the potential of WaveDenoiser as a powerful tool for improving seismic data analysis and processing efficiency.

P-waves↗
DOE OSTI2021

HIRM v1.0: a hybrid impulse response model for climate modeling and uncertainty analyses

Simple climate models (SCMs) are frequently used in research and decision-making communities because of their flexibility, tractability, and low computational cost. SCMs can be idealized, flexibly representing major climate dynamics as impulse response functions, or process-based, using explicit equations to model possibly nonlinear climate and Earth system dynamics. Each of these approaches has strengths and limitations. Here we present and test a hybrid impulse response modeling framework (HIRM) that combines the strengths of process-based SCMs in an idealized impulse response model, with HIRM's input derived from the output of a process-based model. This structure enables the model to capture some of the major nonlinear dynamics that occur in complex climate models as greenhouse gas emissions transform to atmospheric concentration to radiative forcing to climate change. As a test, the HIRM framework was configured to emulate the total temperature of the simple climate model Hector 2.0 under the four Representative Concentration Pathways and the temperature response of an abrupt 4 times CO 2 concentration step. HIRM was able to reproduce near-term and long-term Hector global temperature with a high degree of fidelity. Additionally, we conducted two case studies to demonstrate potential applications for this hybrid model: examining the effect of aerosol forcing uncertainty on global temperature and incorporating more process-based representations of black carbon into a SCM. The open-source HIRM framework has a range of applications including complex climate model emulation, uncertainty analyses of radiative forcing, attribution studies, and climate model development.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

Solving The Space Weather Problem: A 15+ Year Roadmap to Revolutionize Space Weather Research, Protect NASA Space Assets, and Enable Robust Operations

The White Paper (WP) describes a roadmap to address the Space Weather (SpWx) problem. It presents a strategic vision of how a community-wide effort could be organized and implemented to enable transformative advancement in SpWx research and ultimately, in applications. We envision a ‘system-of-systems’—an integrated web of SpWx stations and state-ofthe-art modeling facilities to enable a transformative advance in SpWx nowcasting and forecasting (Figure 1). The Space Weather Aggregated Network of Systems (SWANS) will enable space situational awareness for end-users invested in spaceflight operations, infrastructure risk mitigation, and future human endeavors in space exploration while profoundly transforming Heliophysics research.

A Vourrlidas↗
DOE OSTI2022

Uncertainty Quantification in High-Low Dynamic System Coupling using RAVEN and TRANSFORM

This work demonstrates new functionality and applications stemming from the development of high-fidelity to low-fidelity (high-low) coupling for system simulations and to further explore the capabilities of the Risk Analysis Virtual Environment (RAVEN) in the performance of uncertainty quantification in this kind of high-low coupled system models. The work builds from previous work on high-low coupling that utilized COBRA-TF (CTF), the high-fidelity subchannel analysis code, with a low fidelity model built in ORNL’s TRANSFORM, the system analysis code, utilizing the Functional Mock-Up Interface (FMI). Steady-state and transient analysis examples using the high/low coupled models generated from CTF and TRANSFORM/FMI are investigated. The workflows for both steady-state and transient coupled simulations are described. A steady-state parameter sweep and uncertainty analysis of the primary flow rates and reactor power are demonstrated. Likewise, a transient pump trip and power ramp sensitivity studies are also demonstrated. This work elucidates some of the potential benefits and future needs of using RAVEN for high/low system coupling analysis of energy systems. It also shows some of the difficulties that can be encountered in coupling system simulations.

Williams, Wesley↗
DOE OSTI2023

End-to-end AI framework for interpretable prediction of molecular and crystal properties

We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models including CGCNN, PhysNet, SchNet, MPNN, MPNN-transformer, and TorchMD-NET. We employ these AI models along with the benchmark QM9, hMOF, and MD17 datasets to showcase how the models can predict user-specified material properties within modern computing environments. We demonstrate transferable applications in the modeling of small molecules, inorganic crystals and nanoporous metal organic frameworks with a unified, standalone framework. We have deployed and tested this framework in the ThetaGPU supercomputer at the Argonne Leadership Computing Facility, and in the Delta supercomputer at the National Center for Supercomputing Applications to provide researchers with modern tools to conduct accelerated AI-driven discovery in leadership-class computing environments. We release these digital assets as open source scientific software in GitLab, and ready-to-use Jupyter notebooks in Google Colab.

36 MATERIALS SCIENCE↗
NASA NTRS1994

System identification of the Large-Angle Magnetic Suspension Test Fixture (LAMSTF)

The Large-Angle Magnetic Suspension Test Fixture (LAMSTF), a laboratory-scale research project to demonstrate the magnetic suspension of objects over wide ranges of attitudes, has been developed. This system represents a scaled model of a planned Large-Gap Magnetic Suspension System (LGMSS). The LAMSTF consists of a small cylindrical permanent magnet suspended element which is levitated above a planar array of five electromagnets mounted in a circular configuration. The cylinder is a rigid body and can be controlled to move in five independent degrees of freedom. Six position variables are sensed indirectly by using infrared light-emitting diodes and light-receiving phototransistors. The motion of the suspended cylinder is in general nonlinear and hence only the linear, time-invariant perturbed motion about an equilibrium state is considered. One of the main challenges in this project is the control of the suspended element over a wide range of orientations. An accurate dynamic model plays an essential role in controller design. The analytical model is first derived and open-loop characteristics discussed. The system is shown to be highly unstable and requires feedback control for system identification. Projection filters are first proposed to identify the state space model from closed-loop input/output test data in the time domain. This method is then extended to identify linear systems from the frequency test data. A canonical transformation matrix is also derived to transform the identified state space model into the physical coordinate. The LAMSTF system is stabilized by using a linear quadratic regulator (LQR) feedback controller for closed-loop identification. The rate information is obtained by calculating the back difference of the sensed position signals. Only the closed-loop random input/output data are recorded. Preliminary results from numerical simulations demonstrate that the identified system model is fairly accurate from either time domain or frequency-domain data. Experiments will be performed to validate the proposed closed-loop identification algorithms.

Huang, Jen-Kuang↗
DOE OSTI2024

Leveraging generative AI for urban digital twins: a scoping review on the autonomous generation of urban data, scenarios, designs, and 3D city models for smart city advancement

The digital transformation of modern cities by integrating advanced information, communication, and computing technologies has marked the epoch of data-driven smart city applications for efficient and sustainable urban management. Despite their effectiveness, these applications often rely on massive amounts of high-dimensional and multi-domain data for monitoring and characterizing different urban sub-systems, presenting challenges in application areas that are limited by data quality and availability, as well as costly efforts for generating urban scenarios and design alternatives. As an emerging research area in deep learning, Generative Artificial Intelligence (GenAI) models have demonstrated their unique values in content generation. This paper aims to explore the innovative integration of GenAI techniques and urban digital twins to address challenges in the planning and management of built environments with focuses on various urban sub-systems, such as transportation, energy, water, and building and infrastructure. The survey starts with the introduction of cutting-edge generative AI models, such as the Generative Adversarial Networks (GAN), Variational Autoencoders (VAEs), Generative Pre-trained Transformer (GPT), followed by a scoping review of the existing urban science applications that leverage the intelligent and autonomous capability of these techniques to facilitate the research, operations, and management of critical urban subsystems, as well as the holistic planning and design of the built environment. Based on the review, we discuss potential opportunities and technical strategies that integrate GenAI models into the next-generation urban digital twins for more intelligent, scalable, and automated smart city development and management.

3D city modeling↗
DOE OSTI2024

Learning stochastic dynamics and predicting emergent behavior using transformers

We show that a neural network originally designed for language processing can learn the dynamical rules of a stochastic system by observation of a single dynamical trajectory of the system, and can accurately predict its emergent behavior under conditions not observed during training. We consider a lattice model of active matter undergoing continuous-time Monte Carlo dynamics, simulated at a density at which its steady state comprises small, dispersed clusters. We train a neural network called a transformer on a single trajectory of the model. The transformer, which we show has the capacity to represent dynamical rules that are numerous and nonlocal, learns that the dynamics of this model consists of a small number of processes. Forward-propagated trajectories of the trained transformer, at densities not encountered during training, exhibit motility-induced phase separation and so predict the existence of a nonequilibrium phase transition. Transformers have the flexibility to learn dynamical rules from observation without explicit enumeration of rates or coarse-graining of configuration space, and so the procedure used here can be applied to a wide range of physical systems, including those with large and complex dynamical generators.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1993

An introduction to wavelet analysis in oceanography and meteorology - With application to the dispersion of Yanai waves

Wavelet analysis is a relatively new technique that is an important addition to standard signal analysis methods. Unlike Fourier analysis that yields an average amplitude and phase for each harmonic in a dataset, the wavelet transform produces an instantaneous estimate or local value for the amplitude and phase of each harmonic. This allows detailed study of nonstationary spatial or time-dependent signal characteristics. The wavelet transform is discussed, examples are given, and some methods for preprocessing data for wavelet analysis are compared. By studying the dispersion of Yanai waves in a reduced gravity equatorial model, the usefulness of the transform is demonstrated. The group velocity is measured directly over a finite range of wavenumbers by examining the time evolution of the transform. The results agree well with linear theory at higher wavenumber but the measured group velocity is reduced at lower wavenumbers, possibly due to interaction with the basin boundaries.

Meyers, Steven D.↗
NASA NTRS1994

Improved image decompression for reduced transform coding artifacts

The perceived quality of images reconstructed from low bit rate compression is severely degraded by the appearance of transform coding artifacts. This paper proposes a method for producing higher quality reconstructed images based on a stochastic model for the image data. Quantization (scalar or vector) partitions the transform coefficient space and maps all points in a partition cell to a representative reconstruction point, usually taken as the centroid of the cell. The proposed image estimation technique selects the reconstruction point within the quantization partition cell which results in a reconstructed image which best fits a non-Gaussian Markov random field (MRF) image model. This approach results in a convex constrained optimization problem which can be solved iteratively. At each iteration, the gradient projection method is used to update the estimate based on the image model. In the transform domain, the resulting coefficient reconstruction points are projected to the particular quantization partition cells defined by the compressed image. Experimental results will be shown for images compressed using scalar quantization of block DCT and using vector quantization of subband wavelet transform. The proposed image decompression provides a reconstructed image with reduced visibility of transform coding artifacts and superior perceived quality.

Orourke, Thomas P.↗
NASA NTRS1985

Forward and reverse transfer function model synthesis

A process for synthesizing a mathematical model for a linear mechanical system using the forward and reverse Fourier transform functions is described. The differential equation for a system model is given. The Bode conversion of the differential equation, and the frequency and time-domain optimization matching of the model to the forward and reverse transform functions using the geometric simplex method of Nelder and Mead (1965) are examined. The effect of the window function on the linear mechanical system is analyzed. The model is applied to two examples; in one the signal damps down before the end of the time window and in the second the signal has significant energy at the end of the time window.

Houghton, J. R.↗
DOE OSTI2022

Sampling lattices in semi-grand canonical ensemble with autoregressive machine learning

Calculating thermodynamic potentials and observables efficiently and accurately is key for the application of statistical mechanics simulations to materials science. However, naive Monte Carlo approaches, on which such calculations are often dependent, struggle to scale to complex materials in many state-of-the-art disciplines such as the design of high entropy alloys or multi-component catalysts. To address this issue, we adapt sampling tools built upon machine learning-based generative modeling to the materials space by transforming them into the semi-grand canonical ensemble. Furthermore, we show that the resulting models are transferable across wide ranges of thermodynamic conditions and can be implemented with any internal energy model U, allowing integration into many existing materials workflows. We demonstrate the applicability of this approach to the simulation of benchmark systems (AgPd, CuAu) that exhibit diverse thermodynamic behavior in their phase diagrams. Finally, we discuss remaining challenges in model development and promising research directions for future improvements.

36 MATERIALS SCIENCE↗
NASA NTRS2014

Advanced Mirror & Modelling Technology Development

The 2020 Decadal technology survey is starting in 2018. Technology on the shelf at that time will help guide selection to future low risk and low cost missions. The Advanced Mirror Technology Development (AMTD) team has identified development priorities based on science goals and engineering requirements for Ultraviolet Optical near‐Infrared (UVOIR) missions in order to contribute to the selection process. One key development identified was lightweight mirror fabrication and testing. A monolithic, stacked, deep core mirror was fused and replicated twice to achieve the desired radius of curvature. It was subsequently successfully polished and tested. A recently awarded second phase to the AMTD project will develop larger mirrors to demonstrate the lateral scaling of the deep core mirror technology. Another key development was rapid modeling for the mirror. One model focused on generating optical and structural model results in minutes instead of months. Many variables could be accounted for regarding the core, face plate and back structure details. A portion of a spacecraft model was also developed. The spacecraft model incorporated direct integration to transform optical path difference to Point Spread Function (PSF) and between PSF to modulation transfer function. The second phase to the project will take the results of the rapid mirror modeler and integrate them into the rapid spacecraft modeler.

Effinger, Michael↗
NASA NTRS1972

Spin stability of dual-spin spacecrafts.

The spin-axis attitude stability in torque-free environment of dual-spin spacecrafts with energy losses in both bodies is studied by analytical means. A new mathematical model, which assumes the high speed rotor to be symmetrical, is introduced and analyzed. The linearized variational system of equations for the model with periodic coefficients is transformed to a kinematically similar autonomous system (according to Floquet and Liapunov) which can be analyzed routinely using established procedure. As an example, this technique is used on a recent mathematical model of the SAS-A spacecraft to establish steady state stability over a wide range of speeds.

Guha, A. K.↗
NASA NTRS1989

Development of a funding, cost, and spending model for satellite projects

The need for a predictive budget/funging model is obvious. The current models used by the Resource Analysis Office (RAO) are used to predict the total costs of satellite projects. An effort to extend the modeling capabilities from total budget analysis to total budget and budget outlays over time analysis was conducted. A statistical based and data driven methodology was used to derive and develop the model. Th budget data for the last 18 GSFC-sponsored satellite projects were analyzed and used to build a funding model which would describe the historical spending patterns. This raw data consisted of dollars spent in that specific year and their 1989 dollar equivalent. This data was converted to the standard format used by the RAO group and placed in a database. A simple statistical analysis was performed to calculate the gross statistics associated with project length and project cost ant the conditional statistics on project length and project cost. The modeling approach used is derived form the theory of embedded statistics which states that properly analyzed data will produce the underlying generating function. The process of funding large scale projects over extended periods of time is described by Life Cycle Cost Models (LCCM). The data was analyzed to find a model in the generic form of a LCCM. The model developed is based on a Weibull function whose parameters are found by both nonlinear optimization and nonlinear regression. In order to use this model it is necessary to transform the problem from a dollar/time space to a percentage of total budget/time space. This transformation is equivalent to moving to a probability space. By using the basic rules of probability, the validity of both the optimization and the regression steps are insured. This statistically significant model is then integrated and inverted. The resulting output represents a project schedule which relates the amount of money spent to the percentage of project completion.

Johnson, Jesse P.↗
NASA NTRS2020

On Boundary-Value Problems for RANS Equations and Two-Equation Turbulence Models

Currently, in engineering computations for high Reynolds number turbulent flows, turbulence modeling continues to be the most frequently used approach to represent the effects of turbulence. Such models generally rely on solving either one or two transport equations along with the Reynolds-Averaged Navier–Stokes (RANS) equations. The solution of the boundary-value problem of any system of partial differential equations requires the complete delineation of the equations and the boundary conditions, including any special restrictions and conditions. In the literature, such a description is often incomplete, neglecting important details related to the boundary conditions and possible restrictive conditions, such as how to ensure satisfying prescribed values of the dependent variables of the transport equations in the far field of a finite domain. In this article, we discuss the possible influence of boundary values, as well as near-field and far-field behavior, on the solution of the RANS equations coupled with transport equations for turbulence modeling. In so doing, we defne the concept of a welldefined boundary-value problem. Additionally, a three-dimensional, rather than a simpler one-dimensional analysis is performed to analyze the near-wall and far-field behavior of the turbulence model variables. This allows an assessment of the decay rate of these variables required to realize the boundary conditions in the far field. This paper also addresses the impact of various transformations of two-equation models (e.g., the model of Wilcox) to remove the singular behavior of the dissipation rate (ω) at the surface boundary. Finally, the issue of well-posedness regarding the governing equations is considered. A compelling argument (although not a proof) for ill-posedness is made for both direct and inverse problems.

Navier–Stokes equations↗