Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud type detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Micropulse Lidar Cloud Mask Machine-Learning Value-Added Product Report

Cloud detection algorithms of various techniques have been developed and applied to atmospheric ground-based lidar data to identify cloud boundaries and produce clouds masks. While these algorithms are able to identify a wide variety of cloud types and conditions, it is often observed that the algorithms can still fail to accurately detect clouds that are readily discernible when inspecting the lidar imagery. Based on this observation, an alternative approach for cloud detection is to take advantage of machine-learning capabilities and the trained human eye as an interpreter of lidar images, and in turn, to train a neural network to recognize the desired features in the lidar data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Object Detection and Recognition with PointPillars in LiDAR Point Clouds – Comparisions

In the field of autonomous systems, neural networks have been leveraged for object detection and recognition in 2-dimensional images captured by cameras. Other types of sensors are available for sensing surroundings, including LiDAR sensors, and corresponding networks have been developed to perform detection and recognition in the point clouds generated by these sensors. The approaches are similar, both perform convolutions, but have distinct characteristics and challenges. In designing and configuring autonomous systems, a variety of LiDAR sensors are available, along with configurable deep neural networks to leverage their data. This work presents a review of the PointPillars network, an evolution of the seminal PointNet, comparing accuracy and training time relative to different LiDAR sensors, network and training parameters, CPU and GPU hardware, and the criticality of the use of reflective intensity as a feature. The value of using reflectivity as a predictive feature is explored and quantified to determine if it makes a significant difference in accuracy of the PointPillars network. Two separate LiDAR sensors are utilized, a 16-plane and a 32-plane, and corresponding accuracies and training times with the PointPillars network are evaluated.

LiDAR, machine learning, neural network, object re↗
DOE OSTI2024

Enhancing Cloud Cybersecurity: Prescriptive Controls for Operational Technology

This whitepaper provides strategic insights and recommendations into security cloud-based solutions for electric utilities, encompassing operational technology (OT), virtual power plants (VPP), distributed energy resources (DERs), applications, networks, and data storage as they transition to and leverage cloud infrastructure through managed service providers (MSPs) and cloud service providers (CSPs). Principles derived from established frameworks serve as a foundation for best practices across cybersecurity projects and remove the constraints of settling on a single framework. For organizations that prefer not to integrate a specific framework altogether, elements of the proposed approach could be adopted or tailored to best fit defined requirements and expected functionalities. The Cirrus assessment, a utility cloud feasibility tool, and the roadmap it provides serve as a precursor to this paper, which seeks to be a valuable resource for defining next steps following cloud technology integration feasibility appraisal. With its comprehensive approach to adoption, the Cirrus framework offers strategic guidance on responsibly preparing for or deploying a utility cloud solution. The previously published whitepaper, “Use Case-Informed Framework for Utility Cloud Migration,” details the guiding strategy, research, and deployment of cloud solutions within electric and interconnected grid systems. Before implementing the controls suggested in this document, it is recommended that stakeholders complete Cirrus's cloud integration assessment and pair the results with their unique cybersecurity controls to form a comprehensive cloud-based utility cybersecurity plan. The Cirrus outcome will consider a series of future architectures for the grid before and after the energy transition and evaluate the arguments for and against cloud applications for each electric and interconnected grid layer. This document is a companion to the original whitepaper, "Use Case-Informed Framework for Utility Cloud Migration" to further identify and recommend security controls based on Cirrus’s cloud integration assessment output. The following whitepaper outlines the cybersecurity controls that secure cloud-service models pertinent to the electric sector using the predefined categories identify, protect, detect, and respond and recover. The objective is to outline prescriptive security controls based on the type of architecture and data stored in the cloud. The focus includes dissecting the shared responsibility model and elucidating what on-premises Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) entail. A pivotal consideration in this context is allocating responsibility for foundational cybersecurity aspects—having used Cirrus for the cloud integration assessment. The ensuing controls detailed herein also represent a checklist of controls necessary for a secure cloud transition, equipping utilities with the knowledge to navigate this digital transformation with confidence and strategic foresight in a safe and responsible manner.

42 ENGINEERING↗
DOE OSTI2022

BFSVBF (BatFinder Smart Video BioFilter) [SWR-22-87] and Multi-class BatFinder Smart Video BioFilter Keras

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).

Yarbrough, John↗
DOE OSTI2024

Radar and lidar based cloud type product at the ARM ENA observatory

Following methods outlined in Remillard et al. (2012), we classify seven cloud types using radar reflectivity, best-estimated cloud base, and cloud-layer product from the Active Remotely Sensed Cloud Locations (ARSCL) product (Kollias et al. 2007). A cloud mask is created based on the detectable radar reflectivity (>-40 dBZ) combined with the best-estimated cloud base height. Each cloud object is analyzed individually as contiguous cloudy pixels, and its type is determined based on the cloud’s boundaries and duration. Focusing on marine boundary-layer clouds, low clouds are further classified into four types: shallow cumulus, broken stratocumulus (Sc) or cumulus clouds, single-layer Sc, and multi-layer Sc or Sc coupled with cumulus. The remaining three categories are middle clouds, high clouds, and deep convective clouds. For detailed definition of each cloud type, please refer to Zheng et al. (2024).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

FORTE Measurements of Global Optical Lightning Waveforms and Implications for Optical Lightning Detection

Lightning processes generate a diverse collection of optical pulses from current traversing the lightning channels. These signals are then broadened spatially and temporally via scattering in the clouds. The resulting waveforms measured from space with instruments like the photodiode detector (PDD) on the Fast On-orbit Recording of Transient Events (FORTE) satellite have a variety of shapes. In this study, we use coincident optical and Radio-Frequency measurements to document the properties of optical PDD waveforms associated with different types of lightning, estimate delays from scattering in the clouds, and comment on how pulse shape impacts optical lightning detection. We find that the attributes of optical pulses recorded by the PDD are consistent with prior studies, but vary globally and with event amplitude. The most powerful lightning tends to be single-peaked with faster rise times (median: ~100 µs) and shorter effective widths (median: ~400 µs) than normal lightning. Particularly dim events, meanwhile, include cases of broad optical waveforms with sustained optical emission throughout the PDD record, which the pixelated FORTE Lightning Location System (LLS) instrument has difficulty detecting. We propose that this is due to the optical signal being divided between individual LLS pixels that are each, individually, not bright enough to trigger. We use PDD waveforms and Monte Carlo radiative transfer modeling to demonstrate that increasing the temporal and spatial resolution of a pixelated lightning imager will make it more difficult to detect these broad/dim pulses as their energy becomes divided between additional pixels/integration frames.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Development and validation of a supervised machine learning radar Doppler spectra peak-finding algorithm

In many types of clouds, multiple hydrometeor populations can be present at the same time and height. Studying the evolution of these different hydrometeors in a time–height perspective can give valuable information on cloud particle composition and microphysical growth processes. However, as a prerequisite, the number of different hydrometeor types in a certain cloud volume needs to be quantified. This can be accomplished using cloud radar Doppler velocity spectra from profiling cloud radars if the different hydrometeor types have sufficiently different terminal fall velocities to produce individual Doppler spectrum peaks. Here we present a newly developed supervised machine learning radar Doppler spectra peak-finding algorithm (named PEAKO). In this approach, three adjustable parameters (spectrum smoothing span, prominence threshold, and minimum peak width at half-height) are varied to obtain the set of parameters which yields the best agreement of user-classified and machine-marked peaks. The algorithm was developed for Ka-band ARM zenith-pointing radar (KAZR) observations obtained in thick snowfall systems during the Atmospheric Radiation Measurement Program (ARM) mobile facility AMF2 deployment at Hyytiälä, Finland, during the Biogenic Aerosols – Effects on Clouds and Climate (BAECC) field campaign. The performance of PEAKO is evaluated by comparing its results to existing Doppler peak-finding algorithms. The new algorithm consistently identifies Doppler spectra peaks and outperforms other algorithms by reducing noise and increasing temporal and height consistency in detected features. In the future, the PEAKO algorithm will be adapted to other cloud radars and other types of clouds consisting of multiple hydrometeors in the same cloud volume.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluation of WRF-Solar Cloud Forecast Using the NSRDB: Preprint

Cloud forecast is a crucial component in predicting solar irradiance from numerical weather prediction (NWP) models. Assessing cloud properties from the NWP models requires significant work due to the need for high-quality data, spatial analysis covering model extent, and detailed analysis of model performance for different types of clouds. This study presents an evaluation of the WRF-Solar cloud forecast using the National Solar Radiation Database (NSRDB). We propose an evaluation framework applied to a single model prediction as well as ensemble-based forecasts. Various cloud detection metrics are calculated when comparing with the satellite-derived dataset. The mismatched clouds from the WRF-Solar model are quantified using nine cloud types classified by cloud top height and cloud optical depth. The results based on the WRF-Solar forecasts covering the entire U.S. for the full year of 2018 shows mismatched cloud frequency in the range of 8% - 46% for thick and high-level (deep convective) to thin and low-level (cumulus) clouds.

cloud mask forecast↗
DOE OSTI2021

Quality control and crop characterization framework for multi-temporal UAV LiDAR data over mechanized agricultural fields

Recent developments in remote sensing are enabling automatic, high resolution, and non-destructive survey of agriculture fields, providing the key basis for advancing plant breeding. Among the used remote sensing modalities, LiDAR has attracted wide attention for its ability to directly provide accurate 3D information. Despite the increasing utilization of LiDAR technology in phenotyping, there is still a lack of effective quality control strategies, in particular, quality control of LiDAR data collected on a multi-temporal basis. This study proposes a targetless framework for multi-temporal LiDAR data quality control and crop characterization in mechanized agricultural fields. Features extracted from the fields – terrain patches and row/alley locations – are utilized for evaluating the vertical and planimetric relative accuracy of the point clouds. Row/alley locations in the field are automatically identified from the point clouds based on the assumption that higher point density and/or higher elevation correspond to plant locations. The performance of the proposed quality control strategies is evaluated using multi-temporal datasets collected in agricultural fields of different sizes, orientation, crops, and growth stages. The result shows that the net vertical and planimetric discrepancies between multi-temporal point clouds are ±3 cm and ±8 cm, respectively. While the former reflects the actual accuracy of the point clouds, the latter is a combined effect of the LiDAR point cloud accuracy, rasterization artifacts, crop type, growth pattern, and wind condition during data acquisition. In terms of row and alley detection, the result shows that the proposed strategy achieves high performance and can deal with different planting orientation, crop types, growth stages, canopy cover, and planting density. In conclusion, this study presents a quality control framework for multi-temporal LiDAR data. Finally, the row and alley detection leads to automated extraction of plots, and hence facilitates the use of remotely sensed data for automated phenotyping.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Significant H i and Metal Differences around the z = 0.83 Lens Galaxy toward the Doubly Lensed Quasar SBS 0909+532

We report a large difference in neutral hydrogen (H i) and metal column densities between the two sight lines probing opposite sides of the lensing galaxy at z {sub lens} = 0.83 toward the doubly lensed quasar SBS 0909+532. Using archival HST-STIS and Keck HIRES spectra of the lensed quasar images, we measure log N {sub H I} = 18.77 ± 0.12 cm{sup −2} toward the brighter image (A) at an impact parameter of r {sub A} = 3.15 kpc and log N {sub H I} = 20.38 ± 0.20 cm{sup −2} toward the fainter image (B) at an impact parameter of r {sub B} = 5.74 kpc. This difference by a factor of ∼41 is the highest difference between sight lines for a lens galaxy in which H i has been measured, suggesting patchiness and/or anisotropy on these scales. We estimate an average Fe abundance gradient between the sight lines to be ≥+0.35 dex kpc{sup −1}. The N {sub Fe II}/N {sub Mg II} ratios for the individual components detected in the Keck HIRES spectra have supersolar values for all components in sight line A and for 11 out of 18 components in sight line B, suggesting that Type Ia supernovae may have contributed to the chemical enrichment of the galaxy’s environment. Additionally, these observations provide complementary information to detections of cold gas in early-type galaxies and the tension between these and some models of cloud survival.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Observational Evidence of State‐Dependent Positive and Negative Land Surface Feedback on Afternoon Deep Convection Over the Southern Great Plains

Abstract The detection of soil moisture‐precipitation feedback is complicated by the dependence of feedback sign on atmospheric state and cloud types. We evaluated responses of convective clouds to changes in surface evaporative fraction (EF) from satellite and ground‐based measurements over the Southern Great Plains in summer months. Strong responses to EF were inferred only after accounting for tropospheric states supporting systematically positive or negative responses. State dependence (inferred from controlled model experiments) explains the weak response found in previous studies. The probability of transitions from shallow to deep cumulus, and subsequent precipitation onset, increases by 58% over drier surfaces in weakly stratified environments having deeper boundary layers. Boundary layer dynamics play a more important role than low‐level relative humidity in these environments. Wetter surfaces yield increased deep convection in moist and thermally stratified environments. The distinct pathways of convective initiation over dry and wet land surfaces can play important roles in drought onset and termination.

Qiu, Shaoyue↗
DOE OSTI2020

Revisiting the Detection of Optical Lightning Superbolts

This study uses Fast On-Orbit Detection of Transient Events (FORTE) satellite observations to identify superbolt-class optical lightning events and evaluate their origins. Superbolts have been defined by Turman as lightning pulses whose peak optical power exceeds 1011 W. However, it has been unclear whether superbolts resulted from particular types of high-energy lightning process or whether they were the result of measurement bias. In the latter case, any decently bright lightning process could be recorded as a superbolt if the sensor had a particularly clear sight line to the hot channel without thick clouds diluting the optical signals. Here, our 12-year analysis of FORTE superbolt detections indicates that the lower optical superbolt energy range (~100 GW) is dominated by normal lightning, but brighter cases are predominantly strong +CG strokes that originate from specific types of storms. Oceanic storm systems, particularly during the winter, and especially those located around Japan are shown to produce these intense superbolts. We suggest that some optical superbolts result from favorable viewing conditions and would not be identified as such by another instrument located elsewhere and that others are associated with a unique set of physics that may merit the “superbolt” distinction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Insights on sources and formation mechanisms of liquid-bearing clouds over MOSAiC examined from a Lagrangian framework

Understanding Arctic stratiform liquid-bearing cloud life cycles and properly representing these life cycles in models is crucial for evaluations of cloud feedbacks as well as the faithfulness of climate projections for this rapidly warming region. Examination of cloud life cycles typically requires analyses of cloud evolution and origins on short time scales, on the order of hours to several days. Measurements from the recent Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition provide a unique view of the current state of the central Arctic over an annual cycle. Here, we use the MOSAiC radiosonde measurements to detect liquid-bearing cloud layers over full atmospheric columns and to examine the cloud-generating air masses’ properties. We perform 5-day (120 h) back-trajectory calculations for every detected cloud and cluster them using a unique set of variables extracted from these trajectories informed by ERA5 reanalysis data. This clustering method enables us to separate between the air mass source regions such as ice-covered Arctic and midlatitude open water. We find that moisture intrusions into the central Arctic typically result in multilayer liquid-bearing cloud structures and that more than half of multilayer profiles include overlying liquid-bearing clouds originating in different types of air masses. Finally, we conclude that Arctic cloud formation via prolonged radiative cooling of elevated stable subsaturated air masses circulating over the Arctic can occur frequently (up to 20% of detected clouds in the sounding data set) and may lead to a significant impact of ensuing clouds on the surface energy budget, including net surface warming in some cases.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

AEPF: Attention-Enabled Point Fusion for 3D Object Detection

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class’s easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Chemistry↗
DOE OSTI2022

Evaluating WRF-Solar EPS cloud mask forecast using the NSRDB

Improving the accuracy of day-ahead solar forecasts using numerical weather prediction models requires improving the forecasting of cloud occurrence and properties. Validating cloud forecasts is challenging because this requires evaluating different types of clouds over a wide variety of regions. This study analyzes the cloud occurrence (or cloud mask) over the contiguous United States (CONUS), predicted by the Weather Research and Forecasting-Solar Ensemble Prediction System (WRF-Solar EPS), to identify the strengths and limitations of the model in reproducing cloud fields. To enable the in-depth analysis of cloud mask forecasts covering CONUS, we use satellite observations from the National Solar Radiation Database (NSRDB). Two evaluation methods are implemented to consider all clouds and partially removed clouds from the 2-km NSRDB in evaluating the 9-km WRF-Solar EPS cloud mask. Cloud detection metrics as well as the frequency of cloud occurrence are used to quantify the monthly performance of WRF-Solar EPS. Mismatched cloud frequency (MCF) is used to assess the model's capability to predict different types of clouds, which are classified using three levels of cloud optical depth (COD) and cloud top height (CTH). The day-ahead forecasts covering the full year of 2018 demonstrate that WRF-Solar EPS produces MCFs ranging from 27%-46%, 13%-34%, and 8%-19% for thin, mid-thickness, and thick clouds, respectively. For three CTH levels, the model shows MCFs ranging from 19%-46%, 16%-33%, and 8%-27% for low-level, middle-level, and high-level clouds, respectively. This comprehensive characterization of model performance helps identify model weakness and will eventually lead to improvements in cloud and solar radiation forecasting.

14 SOLAR ENERGY↗
DOE OSTI2023

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗
DOE OSTI2022

The 2175 Å bump features in FeLoBAL quasars: One indicator of MW-like dust in the nuclear region of quasars

To investigate the properties of dust in the nuclear region of quasars, we explored the extinction curves of the iron low-ionisation broad absorption line (FeLoBAL) quasar SDSS J163004.29+311957.6 and its two analogues. The parametrised extinction curves indicated the Milky Way-like 2175 Å bump features in underlying extinction, which are similar to those seen in the Local Group and in a subset of high-redshift star-forming galaxies. Compared to the bump features in the Large Magellanic Cloud (LMC), the detections in this work are much closer to those in the Milky Way (MW). These bump features, as well as those in the high- and low-ionisation broad absorption line (BAL) quasars with 2175 Å bumps, are probably the counterpart of the 2175 Å bump features in the quasar environment. This type of dust grain is generally small, easily disrupted by high-energy photons, and has difficulty surviving in the radiation field of the active galactic nucleus. However, due to the presence of absorption-line outflows, the 2175 Å bump feature in quasars, which should be rare, is seen many times in BAL quasars. The shielding effect of outflow clouds allows the MW-like dust grains to be assembled or extends the survival period in the quasar nuclear region. The process and physical and chemical conditions deserve further observational study and investigation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

MindSynchro

This report presents the developments and results of MindSynchro project as part of DOE OE FOA 1861. DOE and Pacific Northwest National Laboratory (PNNL) have made available to FOA awardees datasets containing years of real historical data recorded from various phasor measurement units (PMUs) which are installed in three large US interconnections: Texas (IC A), Western (IC B), and Eastern (IC C). The main goal of the project, which was successfully achieved, was to develop methods for detection and identification of events which are relevant for power grid operation. Tasks performed for achieving the project goals included data exploration and pre-processing, the development and application of physics-based features, data analysis and labeling based on unsupervised learning approaches, training and testing of DSSL models for classification of events which are relevant for power grid operation, and deployment of solutions to cloud environments. The methods developed in the project can potentially provide relevant benefits to power grid asset owners/operators in general in terms of situational awareness. Two main types of outcomes can be provided by these tools: Identification of specific relevant power grid event types: Semi-supervised ML methods developed in the project can adequately employ not only the relatively scarce labeled data but also the large amount of available unlabeled data to train models for detection of specific event types. Such methods enable the application of trained models for the detection of events in a population of PMUs much larger than that associated to the labeled events. Support in data labeling / label validation: Labels are critical for training of models for identification of specific types of events. However, labeling large amounts of data is a manual and tedious process. This means that such process is error prone and is not scalable. Methods developed in the project, based on ensembles of clustering models, have been successfully employed for turning manual labeling into a scalable process. Accurate identification of specific relevant events can provide the operators with immediate situational awareness that could otherwise require hours or days of analysis from domain experts. We envision that such methods could be initially employed in support of post-mortem analysis of events and, as confidence is gained, they could be employed for online/real-time support, providing, among other benefits, insights for avoiding major events which could happen due to a combination of smaller ones. On the longer term, related methods could potentially be employed to improve protection and control.

24 POWER TRANSMISSION AND DISTRIBUTION↗