Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Adaptive Neuron Model: An architecture for the rapid learning of nonlinear topological transformations

A method for the rapid learning of nonlinear mappings and topological transformations using a dynamically reconfigurable artificial neural network is presented. This fully-recurrent Adaptive Neuron Model (ANM) network was applied to the highly degenerate inverse kinematics problem in robotics, and its performance evaluation is bench-marked. Once trained, the resulting neuromorphic architecture was implemented in custom analog neural network hardware and the parameters capturing the functional transformation downloaded onto the system. This neuroprocessor, capable of 10(exp 9) ops/sec, was interfaced directly to a three degree of freedom Heathkit robotic manipulator. Calculation of the hardware feed-forward pass for this mapping was benchmarked at approximately 10 microsec.

Tawel, Raoul↗

Radiometric Modeling and Calibration of the Geostationary Imaging Fourier Transform Spectrometer (GIFTS)Ground Based Measurement Experiment

The ultimate remote sensing benefits of the high resolution Infrared radiance spectrometers will be realized with their geostationary satellite implementation in the form of imaging spectrometers. This will enable dynamic features of the atmosphere s thermodynamic fields and pollutant and greenhouse gas constituents to be observed for revolutionary improvements in weather forecasts and more accurate air quality and climate predictions. As an important step toward realizing this application objective, the Geostationary Imaging Fourier Transform Spectrometer (GIFTS) Engineering Demonstration Unit (EDU) was successfully developed under the NASA New Millennium Program, 2000-2006. The GIFTS-EDU instrument employs three focal plane arrays (FPAs), which gather measurements across the long-wave IR (LWIR), short/mid-wave IR (SMWIR), and visible spectral bands. The GIFTS calibration is achieved using internal blackbody calibration references at ambient (260 K) and hot (286 K) temperatures. In this paper, we introduce a refined calibration technique that utilizes Principle Component (PC) analysis to compensate for instrument distortions and artifacts, therefore, enhancing the absolute calibration accuracy. This method is applied to data collected during the GIFTS Ground Based Measurement (GBM) experiment, together with simultaneous observations by the accurately calibrated AERI (Atmospheric Emitted Radiance Interferometer), both simultaneously zenith viewing the sky through the same external scene mirror at ten-minute intervals throughout a cloudless day at Logan Utah on September 13, 2006. The accurately calibrated GIFTS radiances are produced using the first four PC scores in the GIFTS-AERI regression model. Temperature and moisture profiles retrieved from the PC-calibrated GIFTS radiances are verified against radiosonde measurements collected throughout the GIFTS sky measurement period. Using the GIFTS GBM calibration model, we compute the calibrated radiances from data collected during the moon tracking and viewing experiment events. From which, we derive the lunar surface temperature and emissivity associated with the moon viewing measurements.

Tian, Jialin↗

A new method for obtaining model-free viscoelastic material properties from atomic force microscopy experiments using discrete integral transform techniques

Viscoelastic characterization of materials at the micro- and the nanoscale is commonly performed with the aid of force–distance relationships acquired using atomic force microscopy (AFM). The general strategy for existing methods is to fit the observed material behavior to specific viscoelastic models, such as generalized viscoelastic models or power-law rheology models, among others. Here we propose a new method to invert and obtain the viscoelastic properties of a material through the use of the Z-transform, without using a model. We present the rheological viscoelastic relations in their classical derivation and their z-domain correspondence. We illustrate the proposed technique on a model experiment involving a traditional ramp-shaped force–distance AFM curve, demonstrating good agreement between the viscoelastic characteristics extracted from the simulated experiment and the theoretical expectations. We also provide a path for calculating standard viscoelastic responses from the extracted material characteristics. The new technique based on the Z-transform is complementary to previous model-based viscoelastic analyses and can be advantageous with respect to Fourier techniques due to its generality. Additionally, it can handle the unbounded inputs traditionally used to acquire force–distance relationships in AFM, such as ramp functions, in which the cantilever position is displaced linearly with time for a finite period of time.

36 MATERIALS SCIENCE↗

Dark matter in a mirror solution to the strong C P problem

We study thermal production of dark matter (DM) in a realization of the minimal models of Bonnefoy [], where parity is used to solve the strong C P problem by transforming the entire Standard Model (SM) into a mirror copy. Although the mirror electron e ′ is a good DM candidate, its viability is mired by the presence of the mirror up quark u ′ , whose abundance is intimately related to the e ′ abundance and must be suppressed. This can be achieved through a sequential freeze-in mechanism, where mirror photons are first produced from SM gluons, and then the mirror photons produce e ′ . After computing the details of this double freeze-in, we discuss the allowed parameter space of the model, which lies at the threshold of experimental observations. We find that this origin of e ′ DM requires a low reheating temperature after inflation and is consistent with the baryon asymmetry arising from leptogenesis, providing mirror neutrinos have a significant degeneracy. Finally, we show that this e ′ DM is not compatible with Higgs parity, the simplest scheme with exact parity, unless SM parameters deviate significantly from their central values or the minimal model is extended. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Eddy Current Loss Model Unifying the Effects of Reaction Field and Non-Homogeneous 3-D Magnetic Field

In this article, a new analytical method is proposed to estimate eddy currents inside linear conductive materials. The novel closed-form formulation takes into account the effects of both conductor reaction field that dominates at high frequencies as well as the spatially non-homogeneous nature of the magnetic field penetrating the material. Although the model is suitable for most kinds of permanent magnet machines, it is particularly useful for Surface-mounted Permanent Magnet (SPM) machines where both of these phenomena are prominent. The numerical implementation of the proposed model, which consists of a combination of the method of images and 4-D Fourier transform, is presented. The model is then validated against 2-D and 3-D finite element models (FEMs) for a simple magnetic circuit, showing good agreement. Finally, the eddy current magnet loss in an SPM synchronous machine is evaluated and results are discussed.

Sahu, Raj↗

Establishment of a genome editing tool using CRISPR-Cas9 ribonucleoprotein complexes in the non-model plant pathogen Sphaerulina musiva

CRISPR-Cas9 is a versatile genome editing system widely used since 2013 to introduce site-specific modifications into the genomes of model and non-model species. This technology is used in various applications, from gene knock-outs, knock-ins, and over-expressions to more precise changes, such as the introduction of nucleotides at a targeted locus. CRISPR-Cas9 has been demonstrated to be easy to establish in new species and highly efficient and specific compared to previous gene editing strategies such as Zinc finger nucleases and transcription activator-like effector nucleases. Grand challenges for emerging CRISPR-Cas9 tools in filamentous fungi are developing efficient transformation methods for non-model organisms. In this paper, we have leveraged the establishment of CRISPR-Cas9 genome editing tool that relies on Cas9/sgRNA ribonucleoprotein complexes (RNPs) in the model species Trichoderma reesei and developed the first protocol to efficiently transform the non-model species, Sphaerulina musiva. This fungal pathogen constitutes a real threat to the genus Populus, a foundational bioenergy crop used for biofuel production. Herein, we highlight the general considerations to design sgRNAs and their computational validation. We also describe the use of isolated protoplasts to deliver the CRISPR-Cas9 RNP components in both species and the screening for targeted genome editing events. The development of engineering tools in S. musiva can be used for studying genes involved in diverse processes such as secondary metabolism, establishment, and pathogenicity, among many others, but also for developing genetic mitigation approaches. The approach described here provides guidance for potential development of transformation systems in other non-model spore-bearing ascomycetes.

59 BASIC BIOLOGICAL SCIENCES↗

The reference genome and abiotic stress responses of the model perennial grass Brachypodium sylvaticum

Abstract Perennial grasses are important forage crops and emerging biomass crops and have the potential to be more sustainable grain crops. However, most perennial grass crops are difficult experimental subjects due to their large size, difficult genetics, and/or their recalcitrance to transformation. Thus, a tractable model perennial grass could be used to rapidly make discoveries that can be translated to perennial grass crops. Brachypodium sylvaticum has the potential to serve as such a model because of its small size, rapid generation time, simple genetics, and transformability. Here, we provide a high-quality genome assembly and annotation for B. sylvaticum, an essential resource for a modern model system. In addition, we conducted transcriptomic studies under 4 abiotic stresses (water, heat, salt, and freezing). Our results indicate that crowns are more responsive to freezing than leaves which may help them overwinter. We observed extensive transcriptional responses with varying temporal dynamics to all abiotic stresses, including classic heat-responsive genes. These results can be used to form testable hypotheses about how perennial grasses respond to these stresses. Taken together, these results will allow B. sylvaticum to serve as a truly tractable perennial model system.

59 BASIC BIOLOGICAL SCIENCES↗

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗

Concept Lens: Visual Comparison and Evaluation of Generative Model Manipulations

Generative models are becoming a transformative technology for the creation and editing of images. However, it remains challenging to harness these models for precise image manipulation. These challenges often manifest as inconsistency in the editing process, where both the type and amount of semantic change, depend on the image being manipulated. Moreover, there exist many methods for computing image manipulations, whose development is hindered by the matter of inconsistency. This paper aims to address these challenges by improving how we evaluate, compare, and explore the space of manipulations offered by a generative model. We present Concept Lens, a visual interface that is designed to aid users in understanding semantic concepts carried in image manipulations, and how these manipulations vary over generated images. Given the large space of possible images produced by a generative model, Concept Lens is designed to support the exploration of both generated images, and their manipulations, at multiple levels of detail. To this end, the layout of Concept Lens is informed by two hierarchies: a hierarchical organization of (1) original images, grouped by their similarities, and (2) image manipulations, where manipulations that induce similar changes are grouped together. This layout allows one to discover the types of images that consistently respond to a group of manipulations, and vice versa, manipulations that consistently respond to a group of codes. We show the benefits of this design across multiple use cases, specifically, studying the quality of manipulations for a single method, and offering a means of comparing different methods.

clustering↗

Smart manufacturing maturity models and their applicability: a review

The purpose of this paper is to review existing smart manufacturing (SM) maturity models' dimensions and maturity levels to assess their applicability and drawbacks. There are many maturity models available but many of them have not been validated or do not provide a useful guide or tool for applications. This gap creates the need for a review of the existing maturity model's applicability. Nineteen peer-reviewed maturity models related to “Digital Transformation,” “Industry 4.0” or “Smart Manufacturing” were selected based on a systematic literature review and five consulting firm models were selected based on the author's industry knowledge. The chosen models were analyzed to determine 10 categories of dimensions. Then they are assessed on a 1–5 scale for how applicable they are in the 10 categories of dimensions. The five “consulting firm” models have a first-mover advantage, are more widely used in industry and are more applicable, but some require payment, and they lack published details and validation. The 19 “peer reviewed” models are not as widely used, lack awareness in the industry and are not as easy to apply because of no web tool for self-assessment, but they are improving. The categories defined to characterize the models and facilitate comparisons for users include “Information Technology (IT) and Cyber-Physical System (CPS) and Data,” “Strategy and Organization,” “Supply Chain and Logistics,” “Products and Services,” “Culture and Employees,” “Technology and Capabilities,” “Customer and Market,” “Cybersecurity and Risk,” “Leadership and Management” and “Governance and Compliance.” The analyzed maturity models were particularly weak in the areas of cybersecurity, leadership and governance. Researchers and practitioners can use this review with consideration of their specific needs to determine if a maturity model is applicable or if a new model needs to be developed. The review can also aid in the development of maturity models through the discussion of each of the dimension categories. Finally, compared to existing reviews of SM maturity models, this research determines comprehensive dimension categories and focuses on applicability and drawbacks.

42 ENGINEERING↗

Waveform retrieval for ultrafast applications based on convolutional neural networks

Electric field waveforms of light carry rich information about dynamical events on a broad range of timescales. The insight that can be reached from their analysis, however, depends on the accuracy of retrieval from noisy data. In this article, we present a novel approach for waveform retrieval based on supervised deep learning. We demonstrate the performance of our model by comparison with conventional denoising approaches, including wavelet transform and Wiener filtering. The model leverages the enhanced precision obtained from the nonlinearity of deep learning. The results open a path toward an improved understanding of physical and chemical phenomena in field-resolved spectroscopy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Symposium MT02: Statistical Mechanics-Based Computational Tools for the Study of Phase Transformation in Complex Materials (Final Report)

Symposium MT02 brought together a diverse and interdisciplinary community of scientists specializing in Statistical Mechanics-based computational modeling to investigate phase transformations in materials exhibiting complex disordered structures. As the demand for materials with extreme performance metrics grows—from aerospace components to next-generation optical fibers—the ability to predict microstructural evolution under non-equilibrium conditions has become paramount. The primary goal of this symposium was to identify, evaluate, and discuss advanced computational tools capable of designing precise manufacturing conditions to tailor material properties efficiently. By fostering a dialogue between computational theorists and experimentalists, the symposium sought to establish new protocols for predicting how processing history—such as cooling rates or strain paths—dictates the final microstructure.

36 MATERIALS SCIENCE↗

A piezoelectric transformer

This work describes a modeling and design method whereby a piezoelectric system is formulated by two sets of second-order equations, one for the mechanical system, and the other for the electrical system, coupled through the piezoelectric effect. The solution to this electromechanical coupled system gives a physical interpretation of the piezoelectric effect as a piezoelectric transformer that is a part of the piezoelectric system, which transfers the applied mechanical force into a force-controlled current source, and short circuit mechanical compliance into capacitance. It also transfers the voltage source into a voltage-controlled relative velocity input, and free motional capacitance into mechanical compliance. The formulation and interpretation simplify the modeling of smart structures and lead to physical insight that aids the designer. Due to its physical realization, the smart structural system can be unconditional stable and effectively control responses. This new concept has been demonstrated in three numerical examples for a simple piezoelectric system.

Won, C. C.↗

Analyses Made to Order: Using Transformation to Rapidly Configure a Multidisciplinary Environment

Aerospace problems are highly multidisciplinary. Four or more major disciplines are involved in analyzing any particular vehicle. Moreover, the choice of implementation technology of various subsystems can lead to a change of leading domain or reformation of the driving equations. An excellent example is the change of expertise required to consider aircraft built from composite or metallic structures, or those propelled by chemical or electrical thrusters. Another example is in the major reconfiguration of handling and stability equations with different control surface configuration (e.g., canards, t-tail v four-post tail). Combinatorial problems are also commonplace anytime that a major system is to be designed. If there are only 5 attributes of a design to consider with 4 different options, this is already 1024 options. Adding just 5 more dimensions to the study explodes the space to over one million. Even generous assumptions like the idea that only 10% of the combinations are physically feasible can only contain the problem for so long. To make matters worse, the simple number of combinations is only the beginning. Combining the issue of trade space size with the need to reformulate the design problem for many of the possibilities makes life exponentially more difficult. Advances in software modeling approaches have led to the development of model-driven architecture. This approach uses the transformation of models into inferred models (e.g. inferred execution traces from state machines) or the skeletons for code generation. When the emphasis on transformation is applied to aerospace, it becomes possible to exploit redundancy in the information specified in multiple domain models into a unified system model. F1urther, it becomes possible to overcome the combinatorial nature of specifying integrated system behavior by manually combining the equations governing a given component technology. Transformations from a system specification combined with a system-analysis mapping specification enable one-click combination of domain analyses. This is a flexibility that has been missing from many engineering codes, which often entangle design specification and physical examination much more than is required to conduct the analysis. This capability has been investigated and cultivated within the DARPA F6 program by a team of JPL and Phoenix Integration engineers building the Adapatable Systems Design and Analysis (ASDA) framework. By embracing system modeling with SysML and the Query-View-Transformation (QVT) language, the ASDA team has been able to build a flexible, easily reconfigurable framework for building up and solving large tradespaces. Examples of application and lessons learned in building the framework will be described in this paper. In addition, the motivation will be laid for various tool vendors to develop open model description standards while being able to maintain competitive advantage through proprietary algorithms and approaches. These standards will also be compared to the underpinnings of model-driven architecture and the OMG standards of the Meta-Object Facility (MOF), SysML, and QVT.

Cole, Bjorn↗

HT Model Dataset

This website contains the dataset that was used for writing the manuscript "HT Model: Using the Molecular Transformer for predicting hydrotreating reactions" (PNNL-SA-186589) The dataset includes a collection of hydrotreating reactions compiled from 41 peer-reviewed literature sources. These sources contain experimental data related to hydrotreating reactions. These reactions involve the reaction of chemical compounds with hydrogen gas in the presence of a catalyst to remove heteroatoms or to convert specific functional groups. The dataset contains reactions both with and without reaction conditions. Reaction conditions refer to the specific parameters under which the reaction takes place, such as temperature and pressure. For each reaction, the dataset includes both SMILES and SELFIES representations. SMILES (Simplified Molecular Input Line Entry System) and SELFIES (SELF-referencIng Embedded Strings) are two popular notations used to represent chemical structures in a compact and standardized format. The dataset was created with the aim of training a predictive model, specifically using the Molecular Transformer architecture.

bioprocessing, hydrotreating, deep learning algori↗

Analysis and Planning Framework for Nuclear Plant Transformation

Commercial nuclear power in the United States has been an unqualified success by any measure, providing low cost, carbon-free, and safe baseload electricity for decades. The industry today is at the peak of its historical performance in terms of generation output, reliable operations, and demonstrated nuclear safety. However, it is no longer among the lowest-cost electric generation sources with the emergence of subsidized renewables and shale gas generation. The business model that has served the operating nuclear fleet so well over its life is now a drag on cost performance due to its reliance on a large highly skilled labor force. In contrast, digital technology and innovation are enabling dramatic efficiencies in energy production, resulting in fierce competition for a commodity such as electricity. The nuclear power industry has responded to this challenge with many initiatives to improve efficiency and modernize plant equipment, especially where reliability and obsolescence issues are pressing. However, it would be a missed opportunity to merely modernize the plant components and the work processes of an outdated business model that was formulated to manage the technology of the 1960s. Rather, the greater opportunity is to transform that business model to one that fully exploits the capabilities of modern digital technology, resulting in substantially lower production costs and sustainable market viability. One successful example of such transformation is the concept of Integrated Operations, which was introduced into the North Sea oil and gas industry a couple of decades ago when the profitability of operating these fields was severely threatened by low world petroleum prices and the high overhead of operating the offshore oil and gas platforms. This effort resulted in significant changes to how these oil fields were operated and allowed the industry to continue profitable operation of these platforms. This example has some remarkable parallels to the U.S. commercial nuclear industry as described in the next section. This report provides an analysis and planning framework for such a nuclear plant operating model transformation based on the transferable learnings from the North Sea transformation. This framework is termed Integrated Operations for Nuclear or ION. This report describes the key principles and methods of Integrated Operations and how they are being applied in a collaboration between the DOE Light Water Reactor Sustainability Program and Xcel Energy in an initiative to transform its operating model for performance improvement and long-term sustainability. It describes a method to bring the operating costs of a nuclear fleet in line with market-based pricing, transforming work functions to reduce cost with technology innovations. This initiative will continue over the next several years in the detailed development of transformative concepts for nuclear plants, which will be published as follow-up to this initial report on Integrated Operations for Nuclear.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗