Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Comprehensive Database of Environmental Mitigations Extracted from FERC-Licensed Hydropower Projects Using Artificial Intelligence Techniques, 1998-2023

This dataset provides a comprehensive inventory of environmental mitigation measures required by Federal Energy Regulatory Commission (FERC) licensed hydropower facilities from 461 licenses that were issued from 1998 to 2023. These licenses constitute 446 of the 1015 FERC projects that were active at the end of 2023. 17,612 mentions of environmental mitigations were identified and categorized in 128 unique categories. Mitigations were identified using a Natural Language Processing (NLP) approach, specifically with a Bidirectional Encoder Representations from Transformer (BERT) model. Model-derived results were then reviewed and updated by a subject matter expert as needed. This dataset introduces important enhancements to previous efforts to inventory environmental mitigations, such as including associated license text for each mitigation, tracking the number of instances a mitigation was identified within a license, and providing improved location information. These enhancements significantly expand the dataset's utility, offering greater analytical capabilities and ensuring reproducibility. The dataset is downloadable as a zip file containing the metadata and dataset files.

Ruggles, Thomas [Oak Ridge National Laboratory (OR↗
DOE OSTI2021

Transforming a Simple Structure Model to Represent a Complex Dynamic System with Unknown Boundary Restraints

Imposing a boundary condition on a structure can significantly alter its dynamic properties. However, sometimes the specifics of the new boundary conditions are not known. When the effects of a boundary condition are uncertain or there is not enough information, engineers need to excite the complex structure to obtain these modified properties. In order to experimentally obtain the new properties, engineers need multiple experiments and many outputs for interpolation in order to sufficiently represent the entire structure. In this study, the researchers attached a stinger to a cantilever beam, acting as a new transverse restraint of unknown properties. This paper presents a conversion expression that predicts the dynamic behavior of any point in the system with the new boundary condition. This expression relies only on one impact hammer experiment with one output and the model of the stinger-free cantilever beam, referred to as the simple structure. Researchers estimated the Transfer Function (TRF) of the beam and compared it with an experimentally measured TRF to validate the method. The mean absolute error of the estimated TRF compared to the experimental TRF is 1.99 dB. This demonstrates the use of the proposed method for estimating unmeasured TRFs in a system with an uncertain boundary condition using a single input, single output (SISO) test and a model of the simple structure.

42 ENGINEERING↗
NASA NTRS1981

Photolysis of CH4-NH3 mixtures and PH3 as models for the photochemical transformations on the primitive earth and Jupiter

Methane, ammonia and phosphine are some of the possible constituents of the atmospheres of the Jovian planets and their satellites. Photolysis of NH3 in the presence of CH4 at 185 nm in the temperature range of 25 C to -100 C results in the decomposition of CH4. The reaction is inhibited by added H2 or SF6. These findings are consistent with the reaction of hot hydrogen atoms with CH4 to give the CH3 radical. P2H4 is the initial product formed by the photolysis of PH3 at 206 nm. Kinetic studies established that it is the intermediate in the formation of P4 from PH3. The potential significance of these reactions to the atmospheric photochemistry of the Jovian planets and moons is discussed.

Ferris, J. P.↗
NASA NTRS1990

Model checking for linear temporal logic: An efficient implementation

This report provides evidence to support the claim that model checking for linear temporal logic (LTL) is practically efficient. Two implementations of a linear temporal logic model checker is described. One is based on transforming the model checking problem into a satisfiability problem; the other checks an LTL formula for a finite model by computing the cross-product of the finite state transition graph of the program with a structure containing all possible models for the property. An experiment was done with a set of mutual exclusion algorithms and tested safety and liveness under fairness for these algorithms.

Sherman, Rivi↗
NASA NTRS1994

Turbulence models for compressible boundary layers

It is shown that to satisfy the general accepted compressible law of the wall derived from the Van Driest transformation, turbulence modeling coefficients must actually be functions of density gradients. The transformed velocity profiles obtained by using standard turbulence model constants have too small a value of the effective von Karman constant kappa in the log-law region (inner layer). Thus, if the model is otherwise accurate, the wake component is overpredicted and the predicted skin friction is lower than the expected value.

Huang, P. G.↗
NASA NTRSDate not supplied

Language Model For Earth Science: Exploring Potential Downstream Applications As Well As Current Challenges

The use of deep learning techniques to build transformer language models such as SciBERT and GPT3 have transformed the natural language technology (NLT) landscape. These new NLTs are being used in speech to text and vice versa, auto-mated text classification, sentiment analysis, topic modeling, text summarization, and cognitive assistants. While Earth science has no shortage of unstructured data such as journal and conference papers, little efforts have focused on harnessing NLTs for knowledge extraction and supporting the scientific process. This paper surveys the use of language models in different science. BERT-E, a new Earth science-specific language model, is presented. BERT-E is generated using a transfer learning solution. A language model that has already been trained for general Science (SciBERT) is fine-tuned using abstracts and full text extracted from various Earth science-related articles. A downstream keywords classification application is used for evaluation, and the use of BERT-E shows improved performance. The need to develop a robust set of benchmarks in evaluating the language model such as BERT-E is discussed. Finally, example applications are presented to inspire additional ideas for applications using domain-specific language models.

R Ramachandran↗
NASA NTRS1984

Inversion of vegetation canopy reflectance models for estimating agronomic variables. II - Use of angle transforms and error analysis as illustrated by Suits' model

The technique for inverting a vegetation canopy reflectance model described earlier (Goel and Strebel, 1983) is investigated further. The novel concept of an 'angle transform' is introduced. This concept allows the formation of functions of reflectances at different view zenith and azimuth angles, which are either sensitive or insensitive to a certain agronomic parameter. A proper combination of these functions can allow determination of all the important agronomic and spectral parameters from measured canopy reflectance data. The technique is demonstrated using Suits' (1972) model for homogeneous canopies. It is shown that leaf area index, leaf reflectance and transmittance, and average leaf angle all can be determined from the canopy reflectance at a set of selected view zenith and azimuth angles. A sensitivity analysis of the calculated values to the errors in the data is also carried out. Guidelines are formulated for the number and types of observations required to obtain the values of a particular canopy variable to within a given degree of accuracy for a given level of error in the measurement of canopy reflectance.

Goel, N. S.↗
DOE OSTI2020

Broadband Characterization and Circuit Model Development of Transmission-Scale Transformers

This report describes broadband measurements of transmission-scale transformers typical in the electric power grid. This work was performed as part of the EMP Resilient Grid LDRD project at Sandia National Laboratories to generate circuit models that can be used for high-altitude electromagnetic pulse (HEMP) coupling simulations and response predictions. The objective of the work was to obtain characterization data of substation yard equipment across a frequency range relevant to HEMP. Vector network analyzer measurements up to 100 MHz were performed on two power transformers at ABB-Hitachi and a single ITEC potential transformer. Custom cable breakouts were designed to interface with the transformer terminals and provide ground connections to the chassis at the base of the transformer bushings. The three-phase terminals of the power transformers were measured as a common mode impedance using a parallel resistive splitter, and the single-phase terminals of the potential transformer were measured directly. A vector fitting algorithm was used to empirically fit circuit models to the resulting two-port networks and input impedances of the measured objects. Simplified circuit representations of the input impedances were also generated to assess the degree of precision needed for high-altitude electromagnetic pulse response predictions, which were performed in Sandia's XYCE circuit simulator platform. HEMP coupling simulations using the transformer models showed significant reduction in the voltage peak and broadening in the pulse width seen at the power transformer compared to the traveling wave voltage. This indicated the importance of the load condition when defining the coupled insult in an electric power substation. Simplified circuit models showed a similar voltage at the transformer with a smoothed waveform. The presence of potential transformers in the simulation did not significantly change the simulated voltage at the power transformer. Single-port input impedance models were also developed to define load conditions when transfer characteristics were not necessary.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

On the effectiveness of neural operators at zero-shot weather downscaling

Machine-learning (ML) methods have shown great potential for weather downscaling. These data-driven approaches provide a more efficient alternative for producing high-resolution weather datasets and forecasts compared to physics-based numerical simulations. Neural operators, which learn solution operators for a family of partial differential equations, have shown great success in scientific ML applications involving physics-driven datasets. Neural operators are grid-resolution-invariant and are often evaluated on higher grid resolutions than they are trained on, i.e., zero-shot super-resolution. Given their promising zero-shot super-resolution performance on dynamical systems emulation, we present a critical investigation of their zero-shot weather downscaling capabilities, which is when models are tasked with producing high-resolution outputs using higher upsampling factors than are seen during training. To this end, we create two realistic downscaling experiments with challenging upsampling factors (e.g., 8x and 15x) across data from different simulations: the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5) and the Wind Integration National Dataset Toolkit. While neural operator-based downscaling models perform better than interpolation and a simple convolutional baseline, we show the surprising performance of an approach that combines a powerful transformer-based model with parameter-free interpolation at zero-shot weather downscaling. We find that this Swin-Transformer-based approach mostly outperforms models with neural operator layers in terms of average error metrics, whereas an Enhanced Super-Resolution Generative Adversarial Network-based approach is better than most models in terms of capturing the physics of the ground truth data. We suggest their use in future work as strong baselines.

17 WIND ENERGY↗
DOE OSTI2020

Addressing Human and Organizational Factors in Nuclear Industry Modernization: An Operationally Focused Approach to Process and Methodology

Utility owners and operators of commercial nuclear power plants in the United States (U.S.) are and will be modernizing their nuclear power plants by performing a digital transformation involving design of an integrated set of systems that together enable a technology centric operating plant. The Plant Modernization Pathway of the U.S. Department of Energy Light Water Reactor Sustainability Program has a strategic action plan that lays the groundwork for a digital transformation of the nuclear industry. The model for this transformation is an advanced concept of operations, with an end point vision, “To achieve the maximum aggregate benefit enabled by this digital transformation.” To achieve this, the digital infrastructure for a nuclear plant must be designed as an integrated set of systems that together enable a technology centric operating model. The digital transformation process obviously needs to involve technology considerations and systems engineering, but it also needs to include human and organizational expertise. Thus, human and organizational factors, including sociotechnical systems methods and techniques (e.g., Cognitive Systems Engineering, Systems Theoretic Accident Modeling and Processes, human systems integration, and Macroergonomics) need to be considered for digital transformation projects in order to effectively integrate human and organizational expertise efforts into the new work system that results from nuclear power plant digital modernization. That is, the work system is the basic unit of sociotechnical systems analysis and contains three components: personnel, technical, and organization and management. These components should be jointly optimized with respect to the interdependence of systems performance criteria of effectiveness, efficiency and safety. Joint optimization can be achieved through the application of three human and organization functions: knowledge representation, knowledge elicitation, and cross-functional integration. This report provides a strategic framework for effective integration of human and organizational expertise within nuclear power plant digital modernization efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗
NASA NTRS2023

SafeAeroBERT: Towards a Safety-Informed Aerospace-Specific Language Model

As aviation systems continue to operate with high traffic, large amounts of documents containing safety-relevant data continue to be generated via reporting systems such as the ASRS. Advanced natural language processing techniques, specifically pre-trained language models, have shown great success in domain-specific applications; however, the text in aviation safety reports is inundated with jargon and thus not fully utilized by general pre-trained models. In this research, we work towards developing a safety-informed aerospace-specific language model by pre-training a Bidirectional Encoder Representations from Transformer (BERT) model on reports from the Aviation Safety Reporting System and the National Transportation Safety Board. The resulting model, called SafeAeroBERT, is fine-tuned for the specific task of document classification, and can be further tuned for named-entity recognition, relation detection, information retrieval, and summarization. Results from the classification task are compared between SafeAeroBERT, the base BERT, and SciBERT models and show SafeAeroBERT outperforms the general BERT and SciBERT on classifying reports about human factors, aircraft, and procedure. SafeAeroBERT can be used on custom tasks, not limited to document classification, and is intended to aid an intelligent knowledge manager for safety report repositories.

Aviation↗
NASA NTRSDate not supplied

SafeAeroBERT: Towards a Safety-Informed Aerospace-Specific Language Model

As aviation systems continue to operate with high traffic, large amounts of documents containing safety-relevant data continue to be generated via reporting systems such as the Aviation Safety Reporting System (ASRS). Advanced natural language processing techniques, specifically pre-trained language models, have shown great success in domain-specific applications; however, the text in aviation safety reports is inundated with jargon and thus not fully utilized by general pre-trained models. In this research, we work towards developing a safety-informed aerospace-specific language model by pre-training a Bidirectional Encoder Representations from Transformer (BERT) model on reports from the Aviation Safety Reporting System and the National Transportation Safety Board. The resulting model, called SafeAeroBERT, is fine-tuned for the specific task of document classification, and can be further tuned for named-entity recognition, relation detection, information retrieval, and summarization. Results from the classification task are compared between SafeAeroBERT, the base BERT, and SciBERT models and show SafeAeroBERT outperforms the general BERT and SciBERT on classifying reports about weather and procedure. SafeAeroBERT can be used on custom tasks, not limited to document classification, and is intended to aid an intelligent knowledge manager for safety report repositories.

Aviation↗