Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

Joint Modeling of Quasar Variability and Accretion Disk Reprocessing Using Latent Stochastic Differential Equations

Quasars are bright active galactic nuclei powered by the accretion of matter around supermassive black holes at the center of galaxies. Their stochastic brightness variability depends on the physical properties of the accretion disk and black hole. The upcoming Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to observe tens of millions of quasars, so there is a need for efficient techniques like machine learning that can handle the large volume of data. Quasar variability is believed to be driven by an X-ray corona, which is reprocessed by the accretion disk and emitted as UV/optical variability. We are the first to introduce an auto-differentiable simulation of the accretion disk and reprocessing. We use the simulation as a direct component of our neural network to jointly model the driving variability and reprocessing, trained with supervised learning on simulated LSST-like 10 yr quasar light curves. We encode the light curves using a transformer encoder, and the driving variability is reconstructed using latent stochastic differential equations, a physically motivated generative deep learning method that can model continuous-time stochastic dynamics. By embedding the physical processes of the driving signal and reprocessing into our network, we achieve a model that is more robust and interpretable. We demonstrate that our model outperforms a Gaussian process regression baseline and can infer accretion disk parameters and time delays between wave bands, even for out-of-distribution driving signals. Our approach provides a powerful framework that can be adapted to solve other inverse problems in multivariate time series.

Fagin, Joshua [City Univ. of New York (CUNY), NY (↗

Anticipating Technical Expertise and Capability Evolution in Research Communities Using Dynamic Graph Transformers

The ability to anticipate global technical expertise and capability evolution trends is essential for national and global security, especially in safety-critical domains such as nuclear nonproliferation (NN) and rapidly emerging fields like artificial intelligence (AI). Here, in this work, we extend traditional statistical relational learning approaches (e.g., link prediction in collaboration networks) and formulate a problem of anticipating technical expertise and capability evolution using dynamic heterogeneous graph representations. We develop novel capabilities to forecast collaboration patterns, authorship behavior, and technical capability evolution at different granularities (e.g., scientist and institution levels) in two distinct research fields. We implement a dynamic graph transformer (DGT) neural architecture, which pushes the state-of-the-art graph neural network models by: 1) forecasting heterogeneous (rather than homogeneous) nodes and edges; and 2) relying on both discrete- and continuous-time inputs. We demonstrate that our DGT models predict collaboration, partnership, and expertise patterns with 0.26, 0.73, and 0.53 mean reciprocal rank values for AI and 0.48, 0.93, and 0.22 for NN domains. DGT model performance exceeds the best-performing static graph baseline models by 30%–80% across AI and NN domains. Our findings demonstrate that DGT models boost inductive task performance when previously unseen nodes appear in the test data for the domains with emerging collaboration patterns (e.g., AI). Specifically, models accurately predict which established scientists will collaborate with early career scientists and vice versa in the AI domain.

97 MATHEMATICS AND COMPUTING↗

Aging Wire Insulation Assessment by Phase Spectrum Examination of Ultrasonic Guided Waves

Wire integrity has become an area of concern to the aerospace community including DoD, NASA, FAA, and Industry. Over time and changing environmental conditions, wire insulation can become brittle and crack. The cracks expose the wire conductor and can be a source of equipment failure, short circuits, smoke, and fire. The technique of using the ultrasonic phase spectrum to extract material properties of the insulation is being examined. Ultrasonic guided waves will propagate in both the wire conductor and insulation. Assuming the condition of the conductor remains constant then the stiffness of the insulator can be determined by measuring the ultrasonic guided wave velocity. In the phase spectrum method the guided wave velocity is obtained by transforming the time base waveform to the frequency domain and taking the phase difference between two waveforms. The result can then be correlated with a database, derived by numerical model calculations, to extract material properties of the wire insulator. Initial laboratory tests were performed on a simple model consisting of a solid cylinder and then a solid cylinder with a polymer coating. For each sample the flexural mode waveform was identified. That waveform was then transformed to the frequency domain and a phase spectrum was calculated from a pair of waveforms. Experimental results on the simple model compared well to numerical calculations. Further tests were conducted on aircraft or mil-spec wire samples, to see if changes in wire insulation stiffness can be extracted using the phase spectrum technique.

Anastasi, Robert F.↗

Identification and interpretation of tectonic features from ERTS-1 imagery

The author has identified the following significant results. The transverse faults observed in the central Coast Ranges of California are believed to represent the remnants of a major system of shear faults older than the San Andreas system. The transverse shear system is believed to have developed in the Mesozoic when the Pacific Plate was advancing under the North American Plate. Shear faults thus developed due to unequal rates of underthrusting. This tectonic model indicates that the intrusive belt of the proto-Sierra Nevada and the belt of eugeosynclinal sedimentary belt (Franciscan group) which lay to the west were both subjected to regional left-handed shear. Later development of the San Andreas system as transform faults of the East Pacific Rise changes the tectonic style to right-lateral tangential. The model explains the peculiar distribution of the Franciscan rocks in the Diablo Range east of the San Andreas fault and in Santa Lucia Range west of Nacimiento fault and the presence of Sierra Nevada type granitic blocks in between the two faults in the Salinia block. This model is also consistent with an analysis of the Texas and Parras shears which indicates that the southwestern part of North America has been subjected to a major left-lateral regional shear before the development of the San Andreas fault system.

Abdel-Gawad, M.↗

Detection and Signal Processing for Near-Field Nanoscale Fourier Transform Infrared Spectroscopy

Researchers from a broad spectrum of scientific and engineering disciplines are increasingly using scattering-type near-field infrared spectroscopic techniques to characterize materials non-destructively with nanoscale spatial resolution. However, a sub-optimal understanding of a technique's implementation can complicate data interpretation and act as a barrier to entering the field. Here the key detection and processing steps involved in producing scattering-type near-field nanoscale Fourier transform infrared spectra (nano-FTIR) are outlined. The self-contained mathematical and experimental work derives and explains: i) how normalized complex-valued nano-FTIR spectra are generated, ii) why the real and imaginary components of spectra qualitatively relate to dispersion and absorption respectively, iii) a new and generally valid equation for spectra which can be used as a springboard for additional modeling of the scattering processes, and iv) an algebraic expression that can be used to extract an approximation to the sample's local extinction coefficient from nano-FTIR. The algebraic model for weak oscillators is validated with nano-FTIR and attenuated total reflectance Fourier transform infrared (ATR-FTIR) spectra on samples of polystyrene and Kapton and further provides a pedagogical pathway to cementing some of the technique's key qualitative attributes.

36 MATERIALS SCIENCE↗

Analysis of eccentric annular incompressible seals. I - A new solution using fast Fourier transforms for determining hydrodynamic force

A new analysis procedure is presented which solves for the flow variables of an incompressible-flow annular pressure seal in which the rotor has a large static displacement from the centered position. The analysis begins with a set of governing equations based on a turbulent bulk-flow model and Moody's friction equation. No simplification of these bulk-flow equations is required for the solution procedure. Perturbation of the flow variables yields a set of zeroth and first-order equations. The zeroth-order equations (which model the large static displacement) are integrated by means of an efficient new method which employs fast Fourier transforms. Further integration of the zeroth-order pressures yields the hydrodynamic reactive force. Predictions for the hydrodynamic forces from this analysis procedure are in excellent agreement with available experimental results.

Nelson, C. C.↗

Formal Requirements-Based Programming for Complex Systems

Computer science as a field has not yet produced a general method to mechanically transform complex computer system requirements into a provably equivalent implementation. Such a method would be one major step towards dealing with complexity in computing, yet it remains the elusive holy grail of system development. Currently available tools and methods that start with a formal model of a system and mechanically produce a provably equivalent implementation are valuable but not sufficient. The gap that such tools and methods leave unfilled is that the formal models cannot be proven to be equivalent to the system requirements as originated by the customer For the classes of complex systems whose behavior can be described as a finite (but significant) set of scenarios, we offer a method for mechanically transforming requirements (expressed in restricted natural language, or appropriate graphical notations) into a provably equivalent formal model that can be used as the basis for code generation and other transformations. While other techniques are available, this method is unique in offering full mathematical tractability while using notations and techniques that are well known and well trusted. We illustrate the application of the method to an example procedure from the Hubble Robotic Servicing Mission currently under study and preliminary formulation at NASA Goddard Space Flight Center.

Rash, James L.↗

NASA Lunar Surface Innovation Initiative: Ensuring a Cohesive, Executable Strategy for Technology Development

Establishing a sustainable human presence on the Moon allows NASA to develop and test new approaches, technologies, and systems that will enable us to function in other, more challenging environments. The Lunar Surface Innovation Initiative (LSII) was established in 2019 and has evolved into a key agency asset to spur technology development and provide risk reduction for lunar surface system development and flight demonstrations. LSII coordinates activities implemented through a combination of in-house activities, competitive programs, and public-private partnerships to create transformative technologies needed for lunar surface exploration. This paper will outline the LSII model used to develop a technology pipeline that will retire the primary technology hurdles in six capability areas. In-situ resource utilization technologies for collecting, processing, storing, and using material found or manufactured on the Moon. Surface power technologies that provide the capability for sustainable, continuous power throughout the day and night for lunar missions. Dust mitigation strategies that diminish lunar dust hazards on lunar surface systems such as cameras, solar panels, space suits, habitats, and instrumentation. Extreme environments technologies that enable systems to operate throughout the full range of lunar surface conditions, including lunar noon (up to 150 at the equator), night (down to - 180 at the equator), multiple day/night cycles, and in permanently shadowed regions (down to -250). Extreme access technologies that enable humans or robotic systems to access, navigate, and explore previously inaccessible lunar surface or subsurface areas. Excavation and construction technologies that will allow affordable, autonomous manufacturing or construction. We outline key results, including milestones and achievements related to the capability areas and outcomes from partnerships with the commercial sector. A key tenet of the LSII is the Lunar Surface Innovation Consortium (LSIC), a collaboration across industry, academia, and government to successfully develop the transformative capabilities for lunar surface exploration. LSIC provides a forum for NASA to communicate technological requirements, needs, and opportunities and for the community to share existing capabilities and identify critical gaps with NASA. By working side by side with commercial enterprises and our international partners, NASA is able to combine the knowledge and expertise needed to explore the lunar surface and make technical advances that will feed technological and economic growth. Since its inception, LSII has engaged over 600 organizations across the United States and 46 countries to shape the technologies and systems needed to explore the lunar surface and stimulate a lunar surface economy.

lunar, lunar surface, technology development, ISRU↗

NASA Lunar Surface Innovation Initiative: Ensuring a Cohesive, Executable Strategy for Technology

Establishing a sustainable human presence on the Moon allows NASA to develop and test new approaches, technologies, and systems that will enable us to function in other, more challenging environments. The Lunar Surface Innovation Initiative (LSII) was established in 2019 and has evolved into a key agency asset to spur technology development and provide risk reduction for lunar surface system development and flight demonstrations. LSII coordinates activities implemented through a combination of in-house activities, competitive programs, and public-private partnerships to create transformative technologies needed for lunar surface exploration. This paper will outline the LSII model used to develop a technology pipeline that will retire the primary technology hurdles in six capability areas. In-situ resource utilization technologies for collecting, processing, storing, and using material found or manufactured on the Moon. Surface power technologies that provide the capability for sustainable, continuous power throughout the day and night for lunar missions. Dust mitigation strategies that diminish lunar dust hazards on lunar surface systems such as cameras, solar panels, space suits, habitats, and instrumentation. Extreme environments technologies that enable systems to operate throughout the full range of lunar surface conditions, including lunar noon (up to 150 at the equator), night (down to - 180 at the equator), multiple day/night cycles, and in permanently shadowed regions (down to -250). Extreme access technologies that enable humans or robotic systems to access, navigate, and explore previously inaccessible lunar surface or subsurface areas. Excavation and construction technologies that will allow affordable, autonomous manufacturing or construction. We outline key results, including milestones and achievements related to the capability areas and outcomes from partnerships with the commercial sector. A key tenet of the LSII is the Lunar Surface Innovation Consortium (LSIC), a collaboration across industry, academia, and government to successfully develop the transformative capabilities for lunar surface exploration. LSIC provides a forum for NASA to communicate technological requirements, needs, and opportunities and for the community to share existing capabilities and identify critical gaps with NASA. By working side by side with commercial enterprises and our international partners, NASA is able to combine the knowledge and expertise needed to explore the lunar surface and make technical advances that will feed technological and economic growth. Since its inception, LSII has engaged over 600 organizations across the United States and 46 countries to shape the technologies and systems needed to explore the lunar surface and stimulate a lunar surface economy.

Lunar↗

On the electric field model for an open magnetosphere

We have developed a new canonical separator line type magnetospheric magnetic field and electric field model for use in magnetospheric calculations, we determine the magnetic and electric field by controlling the reconnection rate at the subsolar magnetopause. The model is applicable only for purely southward interplanetary magnetic field (IMF). We have obtained a more realistic magnetotail configuration by applying a stretch transformation to an axially symmetric field solution. We also discuss the Stern singularity in which there is an electric field singlarity in the canonical separate line models for B(sub y) not = to 0 by using a new technique that solves for the electric field along a field line directly instead of determining it by a potential mapping. The singularity not only causes an infinite electric field on the polar cap, but also causes the boundary conditions at plus infinity and minus infinity in the solar wind to contradict each other. This means that the canonical separator line models do not represent the open magnetosphere well, except for the case of purely southward IMF.

Wang, Zhi↗

Comparison between the performance of two classes of fuzzy controllers

This paper presents an application comparison between two classes of fuzzy controllers: the Clearness Transformation Fuzzy Controller (CTFC) and the CRI-based Fuzzy Controller. The comparison is performed by studying the application of the controllers to simulation examples of nonlinear systems. The CTFC is a new approach for the organization of fuzzy controllers based on a cognitive model of parameter driven control, the notion of fuzzy patterns to represent fuzzy knowledge and the Clearness Transformation Rule of Inference (CTRI) for approximate reasoning. The approach facilitates the implementation of the basic modules of the controller: the fuzzifier, defuzzifier, and the control protocol in a rule-based architecture. The CTRI scheme for approximate reasoning does not require the formation of fuzzy relation matrices yielding improved performance in comparison with the traditional organization of fuzzy controllers.

Janabi, T. H.↗

NASA Enterprise Digital Transformation Initiative Strategic Framework & Implementation Approach

Since 1958, NASA has delivered its enduring bold purpose, characterized in the 2022 NASA Strategic Plan as a mission to discover, explore, innovate, and advance solutions to the problems of flight, within and outside the Earth’s atmosphere, for the benefit of humankind. The NASA Strategic Plan also recognizes that this mission will be delivered differently as it looks to a future marked by radical global change, which is in part being driven by digital advances. For this reason, in late 2020 NASA established an Enterprise Digital Transformation (DT) agency-level strategic initiative to accelerate and coordinate leveraging digital advances to transform the way the Agency works, the experience of its workforce and the agility of its workplace. This paper documents NASA’s DT strategic framework and associated implementation approach, with the DT strategic initiative serving to ignite, connect, integrate, and facilitate DT progress across a federated organizational operating model.

digital transformation↗

Transformer Health Monitoring Using Dissolved Gas Analysis

As integral components of any power plant, transformers supply the generated electricity to the grid. However, a transformer’s cellulose-based paper insulation and the mineral oil in which it is immersed break down over time under standard operating conditions—or more rapidly due to potential faults within the system. As the transformer’s mineral oil breaks down, gases are released that can be measured and monitored. This technical brief exhibits a collection of diagnostic and prognostic techniques that utilities can adopt in lieu of labor-intensive periodic preventive maintenance routines. Furthermore, prognostic models have been incorporated using the latest version of the Institute of Electrical and Electronics Engineers (IEEE) standard (IEEE, 2019) for dissolved gas analysis (DGA), thus expanding it to include estimation of the time to maintenance. Overall, four different methodologies are explained, each of which aids in determining a transformer’s state of health. These methodologies include the Chendong model, the IEEE thermal life consumption model (IEEE, 2012), a diagnostic model for DGA, and a prognostic model for DGA that uses an autoregressive integrated moving average (ARIMA) model. An additional improvement for estimating missing system parameters by using monitoring data (i.e., a tool for parameter estimation utilizing Powell’s method) is presented, enabling the IEEE thermal life consumption model to benefit not only the collaborating power plant, but also the power industry at large.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Percolation effect in thick film superconductors: Using a Bi(Pb)SrCaCuO based paste to prepare a superconducting planar transformer

A thick film superconductor paste has been developed to study the properties of granulated superconductor materials, to observe the percolation effect and to confirm the theory of the conducting mechanism in the superconducting thick films. This paste was also applied to make a superconducting planar transformer. Due to the T(sub c) and advantageous current density properties the base of the past was chosen to be of Bi(Pb)SrCaCu) system. For contacts a conventional Ag/Pt paste was used. The critical temperature of the samples were between 110 K and 115 K depending on the printed layer thickness. The critical current density -at the boiling temperature of the liquid He- was between 200 - 300 A/sq cm. The R(T) and V(I) functions were measured with different parameters. The results of the measurements have confirmed the theory of conducting mechanism in the material. The percolation structure model has been built and described. As an application, a superconducting planar thick film transformer was planned and produced. Ten windings of the transformer were printed on one side of the alumina substrate and one winding was printed on the other side. The coupling between the two sides was possible through the substrate. The samples did not need special drying and firing parameters. After the preparation, the properties of the transformer were measured. The efficiency ans the losses were determined. Finally, some fundamental advantages and problems of the process were discussed.

Sali, Robert↗

Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems

The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.

DER integration↗

Association Between Injection and Microseismicity in Geothermal Fields With Multiple Wells: Data-Driven Modeling of Rotokawa, New Zealand, and Húsmúli, Iceland

Understanding injection-induced microseismicity in geothermal systems can provide insight into reservoir connectedness. However, fault and reservoir complexity are difficult to represent in simple analytical models, which makes it difficult to discern clear relationships from incidental associations. Here, we have used data-driven models to study how fluid injection and microseismicity are related in the Rotokawa (New Zealand) and Hellisheiði (Iceland) geothermal fields. We tested two classes of model: (a) lagged linear regression of seismicity rate as a function of well injection rates; and (b) systematic extraction of injection time series features that are then evaluated for associations with the seismicity. These models allowed us to determine which wells had the greatest correlation with microseismicity and to explain this association in a reservoir context. Finally, exploring different data types and transformations, we were unable to establish a link between rapid changes in injection rate and seismicity spikes, as suggested by some theoretical models.

15 GEOTHERMAL ENERGY↗

FFT-local gravimetric geoid computation

Model computations show that changes of sampling interval introduce only 0.3 cm changes, whereas zero padding provides an improvement of more than 5 cm in the fast Fourier transformation (FFT) generated geoid. For the Global Positioning System (GPS) survey of Franklin County, Ohio, the parameters selected as a result of model computations, allow large reduction in local data requirements while still retaining the cm accuracy when tapering and padding is applied. The results are shown in tables.

Nagy, Dezso↗

Model system for plant cell biology: GFP imaging in living onion epidermal cells

The ability to visualize organelle localization and dynamics is very useful in studying cellular physiological events. Until recently, this has been accomplished using a variety of staining methods. However, staining can give inaccurate information due to nonspecific staining, diffusion of the stain or through toxic effects. The ability to target green fluorescent protein (GFP) to various organelles allows for specific labeling of organelles in vivo. The disadvantages of GFP thus far have been the time and money involved in developing stable transformants or maintaining cell cultures for transient expression. In this paper, we present a rapid transient expression system using onion epidermal peels. We have localized GFP to various cellular compartments (including the cell wall) to illustrate the utility of this method and to visualize dynamics of these compartments. The onion epidermis has large, living, transparent cells in a monolayer, making them ideal for visualizing GFP. This method is easy and inexpensive, and it allows for testing of new GFP fusion proteins in a living tissue to determine deleterious effects and the ability to express before stable transformants are attempted.

NASA Discipline Plant Biology↗