Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Semantic Search with Sentence-BERT for Design Information Retrieval

Managing and referencing design knowledge is a critical activity in the design process. However, reliably retrieving useful knowledge can be a frustrating experience for users of knowledge management systems due to inherent limitations of standard keyword-based searches. In this research, we consider the task of retrieving relevant lessons learned from the NASA Lessons Learned Information System (LLIS). To this end, we apply a state-of-the-art natural language processing (NLP) technique for information retrieval (IR): semantic search with sentence-BERT, which is a modification of a Bidirectional Encoder Representations from Transformers (BERT) model that uses siamese and triplet network architectures to obtain semantically meaningful sentence embeddings. While the pre-trained sBERT model performs well out-of-the-box, we further fine-tune the model on data from the LLIS so that it learns on design engineering-relevant vocabulary. We quantify the improvement in query results using both standard sBERT and fine-tuned sBERT over a keyword search. Our use case throughout the paper is to use queries related to specific requirements from a NASA project. Fine tuning the sBERT model on LLIS data yields a mean average precision (MAP) of 0.807 on queries based on information needs from a real NASA project. Results indicate that applying state-of-the-art natural language processing techniques, especially when finetuned using engineering data, to design information retrieval tasks shows significant promise in modernizing design knowledge management systems.

Hannah S. Walsh↗
NASA NTRSDate not supplied

Semantic Search with Sentence-BERT for Design Information Retrieval

Managing and referencing design knowledge is a critical activity in the design process. However, reliably retrieving useful knowledge can be a frustrating experience for users of knowledge management systems due to inherent limitations of standard keyword-based searches. In this research, we consider the task of retrieving relevant lessons learned from the NASA Lessons Learned Information System (LLIS). To this end, we apply a state-of-the-art natural language processing (NLP) technique for information retrieval: semantic search with sentence-BERT, which is a modification of a Bidirectional Encoder Representations from Transformers (BERT) model that uses siamese and triplet network architectures to obtain semantically meaningful sentence embeddings. While the pretrained sBERT model shows excellent out-of-the-box performance, we further fine-tune the model on data from the LLIS so that it learns on design engineering-relevant vocabulary. We quantify the improvement in query results using both standard sBERT and fine-tuned sBERT over the LLIS’s built-in keyword search. Additionally, we demonstrate a use case for the query system by searching for lessons learned relevant to specific requirements from a NASA project as part of a broader knowledge management and retrieval system. Results indicate that applying state-of-the-art natural language processing techniques, especially when fine-tuned using engineering data, to design information retrieval tasks shows significant promise in modernizing design knowledge management systems.

Hannah S. Walsh↗
NASA NTRSDate not supplied

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden C. Szeto↗
NASA NTRSDate not supplied

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden Szeto↗
NASA NTRS1991

A nested grid, nonhydrostatic, elastic model using a terrain-following coordinate transformation - The radiative-nesting boundary conditions

This study presents a nested-grid nonhydrostatic and elastic model using a terrain-following coordinate transformation as well as a unique application of grid-nesting techniques to the time-splitting elastic model. A simulation of the 10-m-high Witch of Agnesi Mountain provides the control to test this new model. The results show that the model produces the same solution as that derived from a simple linear analytic model. It is demonstrated that the new nested-grid model improves model resolution without resorting to the costly method of placing a fine-resolution grid over the entire domain. Since the wave reflection from the boundaries of the fine-grid model is well controlled, the boundary of the nested fine-grid model can be located even at the wave-active region. The model can be used to simulate various weather systems in which scale interactions are important.

Chen, Chaing↗
NASA NTRS1991

Transform methods for precision continuum and control models of flexible space structures

An open loop optimal control algorithm is developed for general flexible structures, based on Laplace transform methods. A distributed parameter model of the structure is first presented, followed by a derivation of the optimal control algorithm. The control inputs are expressed in terms of their Fourier series expansions, so that a numerical solution can be easily obtained. The algorithm deals directly with the transcendental transfer functions from control inputs to outputs of interest, and structural deformation penalties, as well as penalties on control effort, are included in the formulation. The algorithm is applied to several structures of increasing complexity to show its generality.

Lupi, Victor D.↗
NASA NTRS2010

Experiment and Modeling of Simultaneous Creep, Plasticity and Transformation of High Temperature Shape Memory Alloys During Cyclic Actuation

The present work is focused on studying the cycling actuation behavior of HTSMAs undergoing simultaneous creep and transformation. For the thermomechanical testing, a high temperature test setup was assembled on a MTS frame with the capability to test up to temperatures of 600 C. Constant stress thermal cycling tests were conducted to establish the actuation characteristics and the phase diagram for the chosen HTSMA. Additionally, creep tests were conducted at constant stress levels at different test temperatures to characterize the creep behavior of the alloy over the operational range. A thermodynamic constitutive model is developed and extended to take into account a) the effect of multiple thermal cycling on the generation of plastic strains due to transformation (TRIP strains) and b) both primary and secondary creep effects. The model calibration is based on the test results. The creep tests and the uniaxial tests are used to identify the viscoplastic behavior of the material. The parameters for the SMA properties, regarding the transformation and transformation induced plastic strain evolutions, are obtained from the material phase diagram and the thermomechanical tests. The model is validated by predicting the material behavior at different thermomechanical test conditions.

Kumar, Parikshith K.↗
NASA NTRS1981

Sample data effects of high-pass filters

Four mathematical models of linear first and second order high pass washout filters were analyzed. These models were Euler's Integration, Zero-Order Hold, Bilinear Transformation, and Second-Order Adams-Bashforth Integration. Bode responses for each model at various sample rates were compared to the continuous filter response. Higher sample rates produced Bode responses approaching the continuous response and the Bilinear Transformation model produced the best responses over the frequency spectrum and sample rates. Pole location analysis of each model in the z-plane showed the Bilinear Transformation and Zero-Order Hold models gave stable poles regardless of time step size, whereas the other models did not display stable poles. A near constant gain error over the entire frequency spectrum was discovered in the Zero-Order Hold cases and a correction gain was calculated for the first-order high-pass filter case.

Chin, D. O.↗
NASA NTRS2010

ICER-3D Hyperspectral Image Compression Software

Software has been developed to implement the ICER-3D algorithm. ICER-3D effects progressive, three-dimensional (3D), wavelet-based compression of hyperspectral images. If a compressed data stream is truncated, the progressive nature of the algorithm enables reconstruction of hyperspectral data at fidelity commensurate with the given data volume. The ICER-3D software is capable of providing either lossless or lossy compression, and incorporates an error-containment scheme to limit the effects of data loss during transmission. The compression algorithm, which was derived from the ICER image compression algorithm, includes wavelet-transform, context-modeling, and entropy coding subalgorithms. The 3D wavelet decomposition structure used by ICER-3D exploits correlations in all three dimensions of sets of hyperspectral image data, while facilitating elimination of spectral ringing artifacts, using a technique summarized in "Improving 3D Wavelet-Based Compression of Spectral Images" (NPO-41381), NASA Tech Briefs, Vol. 33, No. 3 (March 2009), page 7a. Correlation is further exploited by a context-modeling subalgorithm, which exploits spectral dependencies in the wavelet-transformed hyperspectral data, using an algorithm that is summarized in "Context Modeler for Wavelet Compression of Hyperspectral Images" (NPO-43239), which follows this article. An important feature of ICER-3D is a scheme for limiting the adverse effects of loss of data during transmission. In this scheme, as in the similar scheme used by ICER, the spatial-frequency domain is partitioned into rectangular error-containment regions. In ICER-3D, the partitions extend through all the wavelength bands. The data in each partition are compressed independently of those in the other partitions, so that loss or corruption of data from any partition does not affect the other partitions. Furthermore, because compression is progressive within each partition, when data are lost, any data from that partition received prior to the loss can be used to reconstruct that partition at lower fidelity. By virtue of the compression improvement it achieves relative to previous means of onboard data compression, this software enables (1) increased return of hyperspectral scientific data in the presence of limits on the rates of transmission of data from spacecraft to Earth via radio communication links and/or (2) reduction in spacecraft radio-communication power and/or cost through reduction in the amounts of data required to be downlinked and stored onboard prior to downlink. The software is also suitable for compressing hyperspectral images for ground storage or archival purposes.

Xie, Hua↗
NASA NTRS2010

Automata learning algorithms and processes for providing more complete systems requirements specification by scenario generation, CSP-based syntax-oriented model construction, and R2D2C system requirements transformation

Systems, methods and apparatus are provided through which in some embodiments, automata learning algorithms and techniques are implemented to generate a more complete set of scenarios for requirements based programming. More specifically, a CSP-based, syntax-oriented model construction, which requires the support of a theorem prover, is complemented by model extrapolation, via automata learning. This may support the systematic completion of the requirements, the nature of the requirement being partial, which provides focus on the most prominent scenarios. This may generalize requirement skeletons by extrapolation and may indicate by way of automatically generated traces where the requirement specification is too loose and additional information is required.

Hinchey, Michael G.↗
NASA NTRS2008

Optical-Microphysical Cirrus Model

A model is presented that permits the simulation of the optical properties of cirrus clouds as measured with depolarization Raman lidars. It comprises a one-dimensional cirrus model with explicit microphysics and an optical module that transforms the microphysical model output to cloud and particle optical properties. The optical model takes into account scattering by randomly oriented or horizontally aligned planar and columnar monocrystals and polycrystals. Key cloud properties such as the fraction of plate-like particles and the number of basic crystals per polycrystal are parameterized in terms of the ambient temperature, the nucleation temperature, or the mass of the particles. The optical-microphysical model is used to simulate the lidar measurement of a synoptically forced cirrostratus in a first case study. It turns out that a cirrus cloud consisting of only monocrystals in random orientation is too simple a model scenario to explain the observations. However, good agreement between simulation and observation is reached when the formation of polycrystals or the horizontal alignment of monocrystals is permitted. Moreover, the model results show that plate fraction and morphological complexity are best parameterized in terms of particle mass, or ambient temperature which indicates that the ambient conditions affect cirrus optical properties more than those during particle formation. Furthermore, the modeled profiles of particle shape and size are in excellent agreement with in situ and laboratory studies, i.e., (partly oriented) polycrystalline particles with mainly planar basic crystals in the cloud bottom layer, and monocrystals above, with the fraction of columns increasing and the shape and size of the particles changing from large thin plates and long columns to small, more isometric crystals from cloud center to top. The findings of this case study corroborate the microphysical interpretation of cirrus measurements with lidar as suggested previously.

Reichardt, J.↗
NASA NTRS1990

Shock induced polymorphic transition in quartz, carbon, and boron nitride

The model proposed by Ahrens (1988) to explain the mechanism of the polymorphism in silicates is revised, and the revised model is applied to the quartz/stishovite, graphite/diamond, and graphite-boron nitride (g-BN) phase transformations. In this model, a key assumption is that transformation to a high-density amorphous or possibly liquid phase which rapidly crystallized to the high-pressure phase is triggered by the high temperatures in the shear band and upon crossing the metastable extension of a melting curve. Good agreement between the calcualted results and published data is obtained. The present theory predicts the standard entropy for cubic BN to be 0.4-0.5 J/g K.

Tan, Hua↗
NASA NTRS1986

An introduction to three-dimensional climate modeling

The development and use of three-dimensional computer models of the earth's climate are discussed. The processes and interactions of the atmosphere, oceans, and sea ice are examined. The basic theory of climate simulation which includes the fundamental equations, models, and numerical techniques for simulating the atmosphere, oceans, and sea ice is described. Simulated wind, temperature, precipitation, ocean current, and sea ice distribution data are presented and compared to observational data. The responses of the climate to various environmental changes, such as variations in solar output or increases in atmospheric carbon dioxide, are modeled. Future developments in climate modeling are considered. Information is also provided on the derivation of the energy equation, the finite difference barotropic forecast model, the spectral transform technique, and the finite difference shallow water waved equation model.

Washington, W. M.↗
NASA NTRS2015

Computational Modeling and Experimental Characterization of Martensitic Transformations in Nicoal for Self-Sensing Materials

Fundamental changes to aero-vehicle management require the utilization of automated health monitoring of vehicle structural components. A novel method is the use of self-sensing materials, which contain embedded sensory particles (SP). SPs are micron-sized pieces of shape-memory alloy that undergo transformation when the local strain reaches a prescribed threshold. The transformation is a result of a spontaneous rearrangement of the atoms in the crystal lattice under intensified stress near damaged locations, generating acoustic waves of a specific spectrum that can be detected by a suitably placed sensor. The sensitivity of the method depends on the strength of the emitted signal and its propagation through the material. To study the transition behavior of the sensory particle inside a metal matrix under load, a simulation approach based on a coupled atomistic-continuum model is used. The simulation results indicate a strong dependence of the particle's pseudoelastic response on its crystallographic orientation with respect to the loading direction and suggest possible ways of optimizing particle sensitivity. The technology of embedded sensory particles will serve as the key element in an autonomous structural health monitoring system that will constantly monitor for damage initiation in service, which will enable quick detection of unforeseen damage initiation in real-time and during onground inspections.

Wallace, T. A.↗
NASA NTRS2012

Transforming Community Access to Space Science Models

Researching and forecasting the ever changing space environment (often referred to as space weather) and its influence on humans and their activities are model-intensive disciplines. This is true because the physical processes involved are complex, but, in contrast to terrestrial weather, the supporting observations are typically sparse. Models play a vital role in establishing a physically meaningful context for interpreting limited observations, testing theory, and producing both nowcasts and forecasts. For example, with accurate forecasting of hazardous space weather conditions, spacecraft operators can place sensitive systems in safe modes, and power utilities can protect critical network components from damage caused by large currents induced in transmission lines by geomagnetic storms.

MacNeice, Peter↗
NASA NTRS1985

A statistical-dynamical study of empirically determined modes of atmospheric variability

The observed wintertime intraseasonal variability of the northern hemisphere midtropospheric circulation is analyzed within the framework of an equivalent barotropic model. The data set and the form of the eigenvalue/vector problem in the wave domain are described, and the statistical significance of the empirical orthogonal functions (EOFs) is discussed, and some selected modes are briefly described. The anomaly model and the transformation to the EOF domain are presented together with a discussion of the model coefficients and forcing term. The fitting procedure for the parameterized terms are described and the level of correspondence between the modelled and observed streamfunction tendencies as a function of the EOFs is examined. The stability of the time mean flow and other base states is investigated.

Schubert, S. D.↗
NASA NTRS2010

Planetary Image Geometry Library

The Planetary Image Geometry (PIG) library is a multi-mission library used for projecting images (EDRs, or Experiment Data Records) and managing their geometry for in-situ missions. A collection of models describes cameras and their articulation, allowing application programs such as mosaickers, terrain generators, and pointing correction tools to be written in a multi-mission manner, without any knowledge of parameters specific to the supported missions. Camera model objects allow transformation of image coordinates to and from view vectors in XYZ space. Pointing models, specific to each mission, describe how to orient the camera models based on telemetry or other information. Surface models describe the surface in general terms. Coordinate system objects manage the various coordinate systems involved in most missions. File objects manage access to metadata (labels, including telemetry information) in the input EDRs and RDRs (Reduced Data Records). Label models manage metadata information in output files. Site objects keep track of different locations where the spacecraft might be at a given time. Radiometry models allow correction of radiometry for an image. Mission objects contain basic mission parameters. Pointing adjustment ("nav") files allow pointing to be corrected. The object-oriented structure (C++) makes it easy to subclass just the pieces of the library that are truly mission-specific. Typically, this involves just the pointing model and coordinate systems, and parts of the file model. Once the library was developed (initially for Mars Polar Lander, MPL), adding new missions ranged from two days to a few months, resulting in significant cost savings as compared to rewriting all the application programs for each mission. Currently supported missions include Mars Pathfinder (MPF), MPL, Mars Exploration Rover (MER), Phoenix, and Mars Science Lab (MSL). Applications based on this library create the majority of operational image RDRs for those missions. A Java wrapper around the library allows parts of it to be used from Java code (via a native JNI interface). Future conversions of all or part of the library to Java are contemplated.

Deen, Robert C.↗
NASA NTRS1998

Parameterization of Model Validating Sets for Uncertainty Bound Optimizations

Given experimental data and a priori assumptions on nominal model and a linear fractional transformation uncertainty structure, feasible conditions for model validation is given. All unknown but bounded exogenous inputs are assumed to occur at the plant outputs. With the satisfaction of the feasible conditions for model validation, it is shown that a parameterization of all model validating sets of plant models is possible. The new parameterization can be used as a basis for the development of a systematic way to construct model validating uncertainty models which have specific linear fractional transformation structure for use in robust control design and analysis. The proposed feasible condition (existence) test and the parameterization is computationally attractive as compared to similar tests currently available.

Lim, K. B.↗