Modeling Coordinate Transformations in the Dragonfly Nervous System
Explore the source record for details and available documents.
Plunkett, Claire Elizabeth↗
SEARCH · Engineering Papers
Results for “Transformer model”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Surface Roughness Modeling for Transformational Challenge Reactor Fuel Form
Explore the source record for details and available documents.
Weinmeister, Justin↗
Modelica-json: Transforming energy models to digitize the control delivery process
Building simulation models are typically not used to generate the documentation required for bidding and project delivery of commercial building systems, or for their semantic modeling and commissioning. This paper presents a software tool that aids in digitizing the control delivery process, spanning simulation during design to implementation and formal verification during commissioning. The tool can generate from Modelica models digital documentation of control sequences. This digital documentation, along with other project drawings and specifications can be used for project bidding. It can also be used for implementation of control sequences through machineto-machine translation to commercial legacy control products, for which we are currently developing the proposed ASHRAE Standard 231P based on the presented work. Moreover, as-installed control sequences can be formally verified against the design specification, and a semantic model in Brick can be exported to aid in configuration of building analytics and fault detection. The paper presents what we believe is the first translation of a Modelica-implemented control sequence to a native implementation on a commercial control platform, using the webCTRL product line from Automated Logic. The paper also shows how a webCTRL implementation can be formally verified against its Modelica specification. These use cases have all been demonstrated with a prototype implementation that is now being further developed.
Wetter, Michael↗
Modeling Coordinate Transformations in the Dragonfly Nervous System
Explore the source record for details and available documents.
Plunkett, Claire Elizabeth↗
Image Separation Using Transformer Attention Models
Explore the source record for details and available documents.
Mathematics and Computing↗
Discrete modeling of a transformer with ALEGRA
We report progress on a task to model transformers in ALEGRA using the “Transient Magnetics” option. We specifically evaluate limits of the approach resolving individual coil wires. There are practical limits to the number of turns in a coil that can be numerically modeled, but calculated inductance can be scaled to the correct number of turns in a simple way. Our testing essentially confirmed this “turns scaling” hypothesis. We developed a conceptual transformer design, representative of practical designs of interest, and that focused our analysis. That design includes three coils wrapped around a rectangular ferromagnetic core. The secondary and tertiary coils have multiple layers. The tertiary has three layers of 13 turns each; the secondary has five layers of 44 turns; the primary has one layer of 20 turns. We validated the turns scaling of inductance for simple (one-layer) coils in air (no core) by comparison to available independent calculations for simple rectangular coils. These comparisons quantified the errors versus reduced number of turns modeled. For more than 3 turns, the errors are <5%. The magnetic field solver failed to converge (within 5000 iterations) for >10 turns. Including the core introduced some complications. It was necessary to capture the core surfaces in thin grid sheaths to minimize errors in computed magnetic energy. We do not yet have quantitative benchmarks with which to compare, but calculated results are qualitatively reasonable.
42 ENGINEERING↗
EMP-Resilient Electric Grid Transformer Analysis
The response of a high - voltage (HV) transformer to fast rise time voltages, such as that from a electromagnetic pulse (EMP) can result in interruption of power distribution and possibly system failure. To help identify these potential occurrences, it is necessary to develop a transformer model that not only captures the input/output response of the transformer but also the internal behavior. The model constructed should cover the frequency band of interest while capturing the internal physical and electrical characteristics. This broad-band, high-fidelity model would enable the prediction of unwanted effects through simulation. A proposed modeling scheme for a HV transformer is described in Part 1 of this report. Part 2 of this report details assessments of internal voltage and electrical field holdoff testing of transformer insulation dielectric breakdown, including comparison of low frequency (DC/60 Hz) holdoff to rise times characteristic of lightning (1 s) and EMP E1 transients (10 - 30 ns). This initial project is a path toward establishing electrical grid transformer failure criteria for EMP voltage transients. We developed modeling methods and measured breakdown electrical field statistical distributions for direct current, 60 Hz, lightning and EMP characteristic voltage rise times. Methods of nanosecond-scale capacitive discharge unit high voltage source development, suggestions for derating of 60 Hz insulation maximum electrical fields for EMP nanosecond pulse voltage withstand rating, and potential methods for increasing transformer resilience to such fast rise time pulses are described.
24 POWER TRANSMISSION AND DISTRIBUTION↗
TransPolymer: a Transformer-based language model for polymer property predictions
Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer models, equipped with self-attention mechanisms, have exhibited superior performance in natural language processing. However, such methods have not been investigated in polymer sciences. Herein, we report TransPolymer, a Transformer-based language model for polymer property prediction. Our proposed polymer tokenizer with chemical awareness enables learning representations from polymer sequences. Rigorous experiments on ten polymer property prediction benchmarks demonstrate the superior performance of TransPolymer. Moreover, we show that TransPolymer benefits from pretraining on large unlabeled dataset via Masked Language Modeling. Experimental results further manifest the important role of self-attention in modeling polymer sequences. We highlight this model as a promising computational tool for promoting rational polymer design and understanding structure-property relationships from a data science view.
36 MATERIALS SCIENCE↗
Deep Learning Methods for Symbolic Calculations in HEP
This project develops machine learning methods to accelerate symbolic calculations in high-energy physics. Using sequence-to-sequence transformer models, we construct frameworks to predict squared amplitudes and related quantities for Standard Model processes, including quantum electrodynamics, quantum chromodynamics, and electroweak interactions. The results demonstrate that deep learning can successfully learn complex symbolic relationships and provide a scalable approach to symbolic computation with potential applications in precision calculations and collider phenomenology.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Coupling of CTF and TRANSFORM using the Functional Mockup Interface
An in-memory coupling between the sub-channel thermal hydraulics code COBRA-TF (CTF), which is included in the Virtual Environment for Reactor Applications (VERA), and the systems code Transient Simulation Framework of Reconfigurable Models (TRANSFORM) was developed in this work. Data exchange is accomplished by using the Functional Mock-Up Interface (FMI), an open standard for coupling dynamic systems models together. The FMI-based coupling necessitated the development of a novel FORTRAN wrapper for communicating with Functional Mock-Up Units. This wrapper will facilitate future FMI-based code couplings with other FORTRAN-based programs. CTF-TRANSFORM is exercised on a simplified Molten Salt Reactor Experiment (MSRE) model in steady-state and transient configurations. The coupled CTF-TRANSFORM model is shown to predict core temperature deltas similar to those available in historical MSRE operational data and is shown to be robust to fast power transients.The coupling paves the way to performing sensitivity and design studies impossible with VERA/CTF alone, in which secondary and tertiary loop operating conditions and design parameters may be perturbed and their impact on the core operating conditions studied.
97 MATHEMATICS AND COMPUTING↗
ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability
Earth system predictability is challenged by the complexity of environmental dynamics and the multitude of variables involved. Current AI foundation models, although advanced by leveraging large and heterogeneous data, are often constrained by their size and data integration, limiting their effectiveness in addressing the full range of Earth system prediction challenges. To overcome these limitations, we introduce the Oak Ridge Base Foundation Model for Earth System Predictability (ORBIT), an advanced vision transformer model that scales up to 113 billion parameters using a novel hybrid tensor-data orthogonal parallelism technique. As the largest model of its kind, ORBIT surpasses the current climate AI foundation model size by a thousandfold. Performance scaling tests conducted on the Frontier supercomputer have demonstrated that ORBIT achieves 684 petaFLOPS to 1.6 exaFLOPS sustained throughput, with scaling efficiency maintained at 41% to 85% across 49,152 AMD GPUs. These breakthroughs establish new advances in AI-driven climate modeling and demonstrate promise to significantly improve the Earth system predictability.
Wang, Xiao↗
Performance Comparison of Object Detection Networks for Shrapnel Identification in Ultrasound Images
Ultrasound imaging is a critical tool for triaging and diagnosing subjects but only if images can be properly interpreted. Unfortunately, in remote or military medicine situations, the expertise to interpret images can be lacking. Machine-learning image interpretation models that are explainable to the end user and deployable in real time with ultrasound equipment have the potential to solve this problem. We have previously shown how a YOLOv3 (You Only Look Once) object detection algorithm can be used for tracking shrapnel, artery, vein, and nerve fiber bundle features in a tissue phantom. However, real-time implementation of an object detection model requires optimizing model inference time. Here, we compare the performance of five different object detection deep-learning models with varying architectures and trainable parameters to determine which model is most suitable for this shrapnel-tracking ultrasound image application. We used a dataset of more than 16,000 ultrasound images from gelatin tissue phantoms containing artery, vein, nerve fiber, and shrapnel features for training and evaluating each model. Every object detection model surpassed 0.85 mean average precision except for the detection transformer model. Overall, the YOLOv7tiny model had the higher mean average precision and quickest inference time, making it the obvious model choice for this ultrasound imaging application. Other object detection models were overfitting the data as was determined by lower testing performance compared with higher training performance. In summary, the YOLOv7tiny object detection model had the best mean average precision and inference time and was selected as optimal for this application. Next steps will implement this object detection algorithm for real-time applications, an important next step in translating AI models for emergency and military medicine.
60 APPLIED LIFE SCIENCES↗
Interpreting Transformers for Jet Tagging
Machine learning (ML) algorithms, particularly attention-based transformer models, have become indispensable for analyzing the vast data generated by particle physics experiments like ATLAS and CMS at the CERN LHC. Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging tasks, which are critical for identifying particles resulting from proton collisions. This study focuses on interpreting ParT by analyzing attention heat maps and particle-pair correlations on the $\eta$-$\phi$ plane, revealing a binary attention pattern where each particle attends to at most one other particle. At the same time, we observe that ParT shows varying focus on important particles and subjets depending on decay, indicating that the model learns traditional jet substructure observables. These insights enhance our understanding of the model's internal workings and learning process, offering potential avenues for improving the efficiency of transformer architectures in future high-energy physics applications.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
datacenterCoolingModel
ExaDigiT is a framework for developing comprehensive digital twins of liquid-cooled supercomputers, which has three main modules: (1) a python-based Resource Allocator and Power Simulator (RAPS), (2) a Modelica-based Thermo-Fluidic cooling model, and (3) a C++-based augmented reality model built on Unreal Engine 5. The Modelica-based cooling model is primarily built-on the open-source Transient Simulation Framework of Reconfigurable Models (TRANSFORM) library and the open-source autocsm library. The library follows the templating architecture developed in the TRANSFORM and the autocsm libraries. This tool can be easily extended to model other Frontier-like liquid cooled supercomputers.
Kumar, Vineet [Oak Ridge National Laboratory (ORNL↗
Anomaly Detection On Network Traffic Using A Sequence Model Approach
The code ingests Zeek logs derived from network packet captures, applies a DBSCAN model, Gower distance to build a feature set as input into a transformer model that will output anomaly scores and provides the option to set a threshold as to what’s considered an anomaly.
Quach, Anna [Idaho National Laboratory (INL), Idah↗
Report on the Use and Function of the Integrated Operations Capability Analysis Platform (ICAP) and the LWRS Innovation Portal (IP)
The commercial nuclear power industry has achieved excellent safety and reliability performance but is struggling to survive in an electricity market that is increasingly dominated by subsidized renewables and cheap natural gas. These challenges have forced utilities to explore previously uncharted avenues to drastically reduce the operations and maintenance costs of their plants which are the primary drivers of the total cost to produce electricity. The petrochemical industry faced similar challenges some years ago as the costs of extraction and processing were rising while their reservoirs were being depleted along with a drop-in commodity prices that resulted in unsustainable operations. In this challenging climate, they developed a business model called Integrated Operations (IO) that sought to utilize technology to enable news ways of working through the integration of people, technology, process and governance changes. The Light Water Reactor Sustainability (LWRS) program, working with IFE have developed an operating model via transferable learnings from the North Sea O&G industry. This framework is termed “Integrated Operations for Nuclear” (ION). ION is a transformation model that integrates the benefits and features of four principal factors: People, Technology, Process and Governance. The purpose of this report is to describe how to generate an ION business process analysis and utilize this information to reduce O&M costs. In order to make this job easier, DOE LWRS has created a suite of tools that will allow a person who is involved in a transformation effort at their company to build a solid documented business case for embarking on a major transformation effort. These tools, the Integrated Operations Capability Analysis Model (ICAP) and the LWRS Innovation Portal (IP) are described herein with instructions on their use. Instructions on how the interface with the EPRI Business Case Analysis Method (BCAM) are also provided.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Development of an Assessment Methodology That Enables the Nuclear Industry to Evaluate Adoption of Advanced Automation
Nuclear power has a crucial role in providing safe, reliable, and economical carbon-free electricity for today and the future. For continued operation, many of the existing United States nuclear power plants will begin the subsequent license renewal process for extending their operating license periods. As plants extend their expected operating lifetimes, there is a significant opportunity to modernize. These plants have a much stronger business case with these extended mission periods to modernize and significantly enhance their economic viability in current and future energy markets by implementing digital technologies that support innovation, efficiency gains, and business-model transformation. Ensuring continued safety and reliability is crucial. Transformative digital technologies—including automation—that fundamentally change the concept of operation for the nuclear power plant operating model requires a critical focus on the human and technology integration element. Further, the nuclear industry has historically been reluctant to modernize due to having a risk adverse culture and lack of clarity for a transformative new state vision (Joe & Remer, 2019; Thomas et al., 2020). Common barriers include (1) the perceived value and return on investment (ROI) of digital technology, (2) the perceived risk associated with licensing, regulatory, and cybersecurity, and (3) insufficient guidance for performing digital modifications to power generation systems. This work presents a methodology to address these barriers and support the industry in adopting advanced automation and digital technology through developing a transformative vision and implementation strategy that will address the human and technology integration element. This research leverages previous LWRS Program and industry results. It draws specifically on previous LWRS Program research in the areas of advanced alarm systems, computer-based procedures, model informed decision support, and advanced human-system interface displays (e.g., overviews and task-based). The modernization methodology can be used to guide transformative thinking when integrating a set of vendor-specific capabilities to support a new concept of operations and a utility’s end-state vision. The results of this research are organized into six major sections: - Section 1 introduces the need for supporting large-scale digital modifications that will renew the technology base for extended operating life beyond 60 years - Section 2 describes the challenges that the nuclear industry is enduring with modernizing. - Section 3 summarizes the primary standards and guidance. - Section 4 presents earlier work from the LWRS Program regarding the development of a transformative conceptual design for an advanced control room of a hybrid plants. - Section 5 presents a methodology that is designed at addressing the challenges in the industry today in achieving a transformative new state vision and concept of operations. - Conclusions and next steps of this research are provided in Section 6.
99 GENERAL AND MISCELLANEOUS↗
Integrated edge-to-exascale workflow for real-time steering in neutron scattering experiments
We introduce a computational framework that integrates artificial intelligence (AI), machine learning, and high-performance computing to enable real-time steering of neutron scattering experiments using an edge-to-exascale workflow. Focusing on time-of-flight neutron event data at the Spallation Neutron Source, our approach combines temporal processing of four-dimensional neutron event data with predictive modeling for multidimensional crystallography. At the core of this workflow is the Temporal Fusion Transformer model, which provides voxel-level precision in predicting 3D neutron scattering patterns. The system incorporates edge computing for rapid data preprocessing and exascale computing via the Frontier supercomputer for large-scale AI model training, enabling adaptive, data-driven decisions during experiments. This framework optimizes neutron beam time, improves experimental accuracy, and lays the foundation for automation in neutron scattering. Although real-time experiment steering is still in the proof-of-concept stage, the demonstrated potential of this system offers a substantial reduction in data processing time from hours to minutes via distributed training, and significant improvements in model accuracy, setting the stage for widespread adoption across neutron scattering facilities and more efficient exploration of complex material systems.
97 MATHEMATICS AND COMPUTING↗