Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “YIn”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Pixel-Resolved Long-Context Learning for Turbulence at Exascale: Resolving Small-scale Eddies Toward the Viscous Limit

Turbulence plays a crucial role in multiphysics applications, including aerodynamics, fusion, and combustion. Accurately capturing turbulence's multiscale characteristics is essential for reliable predictions of multiphysics interactions, but remains a grand challenge even for exascale supercomputers and advanced deep learning models. The extreme-resolution data required to represent turbulence, ranging from billions to trillions of grid points, pose prohibitive computational costs for models based on architectures like vision transformers. To address this challenge, we introduce a multiscale hierarchical Turbulence Transformer that reduces sequence length from billions to a few millions and a novel RingX sequence parallelism approach that enables scalable long-context learning. We perform scaling and science runs on the Frontier supercomputer. Our approach demonstrates excellent performance up to 1.1 EFLOPS on 32,768 AMD GPUs, with a scaling efficiency of 94\%. To our knowledge, this is the first AI model for turbulence that can capture small-scale eddies down to the dissipative range in three-dimensional turbulence at high Reynolds numbers.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗

Learning to Scale the Summit: AI for Science on a Leadership Supercomputer

The Summit system at Oak Ridge National Lab-oratory (ORNL) has been the world's top AI for science su-percomputer for several years, ranked world's fastest computer at its 2018 launch and currently top system in the US and #2 on the TOP5OO list. Summit's purposeful design to handle both conventional modeling and simulation science and emerging AI workloads has made it a leading destination for AI-powered computational science. We report here on AI for science usage on Summit near the midpoint of its lifespan. We review AI usage across the many science projects that have used Summit. We then examine in detail a set of applications scaling AI to full system as well as projects implementing AI-coordinated science discovery workflows on Summit. Finally, we offer some observations regarding the future of advancing scientific knowledge and understanding via AI, especially in the context of leadership-class scientific computing.

Joubert, Wayne↗

Strategies for Integrating Deep Learning Surrogate Models with HPC Simulation Applications

The emerging trend of the convergence of high performance computing (HPC), machine learning/deep learning (ML/DL), and big data analytics presents a host of challenges for large-scale computing campaigns that seek best practices to interleave traditional scientific simulation-based workloads with ML/DL models. A portfolio of systematic approaches to incorporate deep learning into modeling and simulation serves a vital need when we support AI for science at a computing facility. In this paper, we evaluate several strategies for deploying deep learning surrogate models in a representative physics application on supercomputers at the Oak Ridge Leadership Computing Facility (OLCF). We discuss a set of recommended deployment architectures and implementation approaches. We analyze and evaluate these alternatives and show their performance and scalability up to 1000 GPUs on two mainstream platforms equipped with different deep learning hardware and software stacks.

Yin, Junqi↗

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗

A Benchmark Suite for Evaluating Scientific AI Workloads on GPUs

AI applications have been steadily increasing in the allocation portfolio among leadership computing facilities. These applications depend on deep learning frameworks with hardware acceleration and underlying software systems. With the rapid development of applications, software stacks, and hardware devices, it is essential to evaluate the performance of core operations in AI workloads for direction of optimizations and procurement of next-generation high-performance computing (HPC) infrastructures. Currently, most benchmarks lack scientific AI workloads. So, we present DeepKernelBench and the experimental results of evaluating the benchmark suite for early observations and performance comparisons on datacenter GPUs using representative workloads for scientific AI, including Attentions, General matrix multiplications, Geometrics and Fourier neural operations.

Jin, Zheming [Advanced Micro Devices (AMD)]↗

Real-Time Inertia Estimation Tool Implementation Based on Probing Signals

As renewable energy penetration increases and the traditional generators retire in power grids, system inertia decreases and exhibits significant daily fluctuations. Furthermore, fast frequency responses (FFRs) provided by the inverter-based resources (IBRs) begin to playa very critical role and bring new challenges to real-time system inertia monitoring due to the difficulties of quantifying its artificial inertia contribution. Thus, necessitating an accurate real-time inertia estimation tool will not only benefit the secure power grid operations, but also provide insights on assessing the artificial inertia contribution from the IBRs. This paper presents a probing-based real-time inertia estimation tool that has been validated through a power-hardware-in-the-Ioop (PHIL) test system using identical hardware battery energy storage system (BESS) and control in an actual power grid. Preliminary results indicate high estimation accuracy of the developed tool and pave the way for the field test and deployment.

inverter-based resources↗

Precise Timing Based on Pulsar Observation for Grid Synchronization

While Global Positioning System signals are widely used as the synchronized timing Sources for wide-area measurement systems for power grid monitoring and control, they are vulnerable to failures and malicious attacks. To address this Problem, an alternative kind of timing sources, the millisecond pulsars, were proposed to serve the power grid as they are more precise and physically indestructible. Millisecond pulsars are a kind of neutron stars that emit radio pulse signals that have extremely stable periods of milliseconds. However, the observed pulse Signals from pulsars cannot be directly used for timing because of their low signal-to-noise ratio and the dispersion effects of interstellar medium. In this paper, the precise timing method based on pulsar observation data is proposed to interpret the pulsar observation data and therefrom to generate precise timing signal for the power grid synchronization. In our proposed method,. incoherent de-dispersion is used on the observation data to mitigate the effect of interstellar medium. dispersion. Then spectrum analysis and segment folding are used to precisely estimate the local pulsar period. Finally the standard pulse per second signal is generated from. the estimated pulsar period and its precision. is analyzed. Experiments with the observation data of the pulsar based timing signal can be more accurate compared to GPS timing signals.

Luo, Xiqian↗

An Experiment-based Distribution Level Performance Comparison among PMUs

This paper presents a experiment-based distribution level performance comparison among three Phasor Measurement Units (PMUs). Several evaluation criteria, including the total vector error, the phase angle error, the frequency error, the rate of change of frequency, the response time, the settling time, the overshoot, and the algorithm window size, are selected to compare the static and dynamic performances of the PMUs under steady state and step response test conditions. In order to have a more realistic test environment, a test is setup in which PMUs under evaluation have exactly the same input signals. The quantitative experiment result analysis gives an end-user guideline to the PMU selection regarding distribution level applications.

Yin, He↗

Data Security Defense: Modeling and Detection of Synchrophasor Data Spoofing Attack for Grid Edge

Data security and cyberattack have become critical issues in the distributed power system where adversaries can swap the source information of sensors or even spoof and alter measurements. However, the cyber security of the power system is challenged by the unpredictability and stealth of the spoofing attacks. Here, to protect the data security at the grid edge, this paper developed a synchrophasor data spoofing attack detection framework based on the time-frequency feature extraction techniques including the short-time Fourier transform (STFT) and object detection network for real-time synchrophasor data categorization and spoofing attack localization. The proposed approach outperforms earlier work in terms of spoofing attack detection and offers a vital localization function employing distributed synchrophasor sensors.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Topographic Correction of Optical Remote Sensing Images in Mountainous Areas: A systematic review

Rugged terrain distorts optical remote sensing observations and subsequently impacts land cover classification and biophysical and biochemical parameter retrieval over mountainous areas. Therefore, topographic correction (TC) is a prerequisite for many remote sensing applications. Although various TC methods have been explored over the past four decades to mitigate topographic effects, a systematic and global review of these studies is still lacking. Using a multicomponent bibliometric approach, we extracted bibliometric metadata from 426 publications identified by searching titles, keywords, and abstracts for research on “topographic correction” and “topographic effects” in Scopus and Web of Science (WoS) from 1980 to 2022. Here this systematic review revealed a rapid growth in the number of TC studies since the 1980s, primarily driven by the availability of decametric-resolution remote sensing observations and digital elevation models (DEMs). Most of the research has focused on relatively low-elevation regions, with increasing attention beyond American and European regions, particularly in China. The seasonal distribution of satellite acquisition for TC showed considerable imbalance, mainly concentrated in months with favorable solar illumination conditions (e.g., May to October). Important themes emerged from the keyword analysis, including satellite sensors, DEMs, TC methods, evaluation criteria, and applications.

58 GEOSCIENCES↗

Surf-Deformer: Mitigating Dynamic Defects on Surface Code via Adaptive Deformation

In this paper, we introduce Surf-Deformer, a code deformation framework that seamlessly integrates adaptive defect mitigation functionality into the current surface code workflow. It crafts several basic deformation instructions based on fundamental gauge transformations, which can be combined to explore a larger design space than previous methods. This enables more optimized deformation processes tailored to specific defect situations, restoring the QEC capability of deformed codes more efficiently with minimal qubit resources. Additionally, we design an adaptive code layout that accommodates our defect mitigation strategy while ensuring efficient execution of logical operations. Our evaluation shows that Surf-Deformer outperforms previous methods by significantly reducing the end-to-end failure rate of various quantum programs by 35× to 70×, while requiring only about 50% of the qubit resources compared to the previous method to achieve the same level of failure rate. Ablation studies show that Surf-Deformer surpasses previous defect removal methods in preserving QEC capability and facilitates surface code communication by achieving nearly optimal throughput.

Yin, Keyi↗

Providing Ancillary Services with Photovoltaic Generation in Multi- Timescale Grid Operation

With penetration levels of photovoltaic (PV) generation substantially increasing, electric power systems need more flexible resources that can provide ancillary services to mitigate the variability and uncertainty of the PV. On one hand, the increase in PV generation necessitates more flexible resources; on the other hand, because of its low operation cost, PV generation has been replacing conventional generation, which is currently the main flexible resource. Consequently, there is a trend to require renewable generation, including PV, to provide flexible ancillary services. This paper proposes a multi-timescale grid operation model considering the various control strategies of PV providing different ancillary services. Numerical case studies demonstrate that with PV providing both regulation reserve and primary frequency reserve, the system operating costs and PV curtailment will be reduced significantly. Results show that not only the system reliability can be improved but also PV profitability with PV providing more ancillary services.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Recent Development of Frequency Estimation Methods for Future Smart Grid

The frequency estimated by the Phasor Measurement Unit (PMU) is a critical index of power system status and supports many smart grid applications. The future smart grid features high penetration of renewables and more fast-moving power electronics inverters but raises challenges to the reliable frequency estimation. This article presents three methods to address these challenges. First, an enhanced zero-crossing algorithm was developed to track the fast-changing frequency in system dynamics. Second, we propose a technology that can tolerate the system transient and suppress the outliers. Third, an algorithm was developed to export high time-resolution frequency estimations with minimum computational effort. All of the proposed methods are realized in hardware and compared with classical frequency estimation methods. The testing results indicate that the proposed methods have excellent performance. They can be used in future PMUs and provide reliable and high time resolution data for smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Grid Integration of Offshore Wind Power: Standards, Control, Power Quality and Transmission

Offshore wind is expected to be a major player in the global efforts toward decarbonization, leading to exceptional changes in modern power systems. Understanding the impacts and capabilities of the relatively new and uniquely positioned assets in grids with high integration levels of inverter-based resources, however, is lacking, raising concerns about grid reliability, stability, power quality, and resilience, with the absence of updated grid codes to guide the massive deployment of offshore wind. To help fill the gap, this paper presents an overview of the state-of-the-art technologies of offshore wind power grid integration. First, the paper investigates the most current grid requirements for wind power plant integration, based on a harmonized European Network of Transmission System Operators (ENTSO-E) framework and notable international standards, and it illuminates future directions. The paper discusses the wind turbine and wind power plant control strategies, and new control approaches, such as grid-forming control, are presented in detail. The paper reviews recent research on the ancillary services that offshore wind power plants can potentially provide, which, when harmonized, will not only comply with regulations but also improve the value of the asset. The paper explores topics of wind power plant harmonics, reviewing the latest standards in detail and outlining mitigation methods. The paper also presents stability analysis methods for wind power plants, with discussions centered on validity and computational efficiency. Finally, the paper discusses wind power plant transmission solutions, with a focus on high-voltage direct-current topologies and controls.

17 WIND ENERGY↗