Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Effects of 9.5 Years of Whole-Soil Warming on the Fatty Acid and n-Alkanes Composition in Bulk Soil and Density Fractions at Blodgett Experimental Forest, California, USA

Original data of molecular data (fatty acids and n-alkanes) including concentrations and calculated molecular proxies in a whole-soil warming experiment at the Blodgett Forest Research Station after 9.5 years of warming. The study site has a Mediterranean climate with annual average temperature of 12.5 ℃ and annual average precipitation of 1774 mm. The study site is characterized by a mesic Ultic Alfisol formed from granitic parent material, corresponding to a Dystric Cambisol under the World Reference Base for Soil Resources (WRB) classification system. Experimental warming is applied throughout the soil profile to a depth of 1 m using vertically embedded heating cables that raise soil temperature by 4 °C relative to ambient conditions. Soil samples were collected on 1 May 2023, after the experiment had been operating continuously for about 9.5 years since its initiation in January 2014.The data has been processed from raw data and cross-validated by other peers. The dataset includes: - Bulk_Fattyacid_9.5-year_Soil_Warming_Blodgett, California, USA: fatty acid concentrations and proxies including Carbon Preference Index (CPI) and Average Chain Length (ACL) of bulk soil organic carbon; - Fractions_Fattyacid_9.5-year_Soil_Warming_Blodgett, California, USA: fatty acid concentrations and proxies including CPI and ACL of free particulate organic matter (fPOM) and mineral-associated organic matter (MAOM); - Bulk_Alkanes_9.5-year_Soil_Warming_Blodgett, California, USA: n-alkanes concentrations and proxies including CPI and ACL of bulk soil organic carbon; - Fractions_Alkanes_9.5-year_Soil_Warming_Blodgett, California, USA: n-alkanes concentrations and proxies including CPI and ACL of fPOM and MAOM; - n-Alkanes_All_Monomer_Concentration_9.5-year_Soil_Warming_Blodgett, California, USA: concentration of all the n-alkane monomers identified and integrated for bulk soil, fPOM and MAOM; - Fattyacid_All_Monomer_Concentration_9.5-year_Soil_Warming_Blodgett, California, USA: concentration of all the fatty acid monomers including diacids identified and integrated for bulk soil, fPOM, and MAOM. All data are provided in CSV format and can be viewed using Microsoft Excel. We specifically look at fatty acids (FA) and n-alkanes in bulk soil, fPOM and MAOM and calculated molecular proxies such as CPI and ACL to understand the source of oragnic carbon (with ACL) and degree of decomposition (CPI) of each soil fraction. Due to lack of long-chain fatty acids (carbon number ⩾ 20), microorganism-derived organic carbon is characterized by shorter ACL in comparison to plant-derived organic carbon. Fresh SOC is characterized by even-over-odd dominance for fatty acids and odd-over-even dominance for n-alkanes. Therefore, CPI indicates whether soil organic carbon (SOC) represents fresh input (CPI > 10) or is strongly decomposed (close to 1). The research questions should be then, after 9.5-year warming: 1. whether the relative contribution between microorganism-derived and plant-derived SOC in each soil fraction? 2. whether fPOM became more decomposed whereas MAOM remained relatively persistent in each soil fraction across the soil depth?

Carbon↗
DOE OSTI2021

Subfield crop yields and temporal stability in thousands of US Midwest fields

Understanding subfield crop yields and temporal stability is critical to better manage crops. Several algorithms have proposed to study within-field temporal variability but they were mostly limited to few fields. In this study, a large dataset composed of 5520 yield maps from 768 fields provided by farmers was used to investigate the influence of subfield yield distribution skewness on temporal variability. The data are used to test two intuitive algorithms for mapping stability: one based on standard deviation and the second based on pixel ranking and percentiles. The analysis of yield monitor data indicates that yield distribution is asymmetric, and it tends to be negatively skewed (p < 0.05) for all of the four crops analyzed, meaning that low yielding areas are lower in frequency but cover a larger range of low values. The mean yield difference between the pixels classified as high-and-stable and the pixels classified as low-and-stable was 1.04 Mg ha –1 for maize, 0.39 Mg ha –1 for cotton, 0.34 Mg ha –1 for soybean, and 0.59 Mg ha —1 for wheat. The yield of the unstable zones was similar to the pixels classified as low-and-stable by the standard deviation algorithm, whereas the two-way outlier algorithm did not exhibit this bias. Furthermore, the increase in the number years of yield maps available induced a modest but significant increase in the certainty of stability classifications, and the proportion of unstable pixels increased with the precipitation heterogeneity between the years comprising the yield maps.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗
DOE OSTI2022

Integrating very-high-resolution UAS data and airborne imaging spectroscopy to map the fractional composition of Arctic plant functional types in Western Alaska

Widespread changes in vegetation cover and composition are driving strong impacts on Arctic ecosystem functioning and global climate feedbacks. An accurate characterization of tundra vegetation composition is required to understand how the Arctic will respond to future climate change. However, quantifying tundra vegetation composition over large areas is challenging as commonly-used satellite observations are too coarse, spatially and spectrally, to differentiate low-lying tundra vegetation types. Recent airborne and spaceborne imaging spectroscopy platforms provide better data to characterize vegetation composition. Yet, our ability to characterize vegetation composition with imaging spectroscopy remains largely unexplored in the Arctic, particularly due to a lack of ground observations needed to train and test classification models. To address this problem, we collected very-high-resolution (VHR, ~5 cm) unoccupied aerial system (UAS) imagery at three low-Arctic tundra sites located on the Seward Peninsula, western Alaska. In this paper, we examine the feasibility of integrating imagery from the UAS and the hyperspectral Airborne Visible/Infrared Imaging Spectrometer, Next Generation (AVIRIS-NG) airborne instrument to map the fractional composition of 12 key Arctic plant functional types (PFTs). To this end, we first mapped the 12 PFTs from our VHR UAS imagery using random forest classification. We then used these UAS-derived PFT maps as ground truth to develop partial least squares regression (PLSR) models to predict the fractional cover (FCover) of each PFT from AVIRIS-NG imagery. Further, we evaluated the performance of our PLSR models using reserved UAS samples, as well as by mapping PFT FCover and dominant PFT for large tundra landscapes. Our results show that 1) Arctic PFTs can be effectively mapped using VHR UAS imagery, with overall accuracy between 86% and 92%, 2) when the UAS mapped PFTs were used to inform PLSR scaling models, the FCover of the 12 PFTs could be effectively estimated from AVIRIS-NG imagery with a mean absolute error (MAE) <0.13, and 3) our PLSR models outperformed traditional, fully constrained least-squares (FCLS) linear mixture analysis and produced high-quality, spatially contiguous PFT FCover and PFT maps that captured vegetation spatial patterns with similar accuracy to those developed from UAS imagery. The developed PLSR models have the potential to be broadly applied for quantifying vegetation composition with AVIRIS-NG images to help monitor tundra vegetation dynamics and improve process-based modeling of tundra ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A new hypothesis for the origin of Amazonian Dark Earths

Amazonian Dark Earths (ADEs) are unusually fertile soils characterised by elevated concentrations of microscopic charcoal particles, which confer their distinctive colouration. Frequent occurrences of pre-Columbian artefacts at ADE sites led to their ubiquitous classification as Anthrosols (soils of anthropic origin). However, it remains unclear how indigenous peoples created areas of high fertility in one of the most nutrient-impoverished environments on Earth. Here, we report new data from a well-studied ADE site in the Brazilian Amazon, which compel us to reconsider its anthropic origin. The amounts of phosphorus and calcium—two of the least abundant macronutrients in the region—are orders of magnitude higher in ADE profiles than in the surrounding soil. The elevated levels of phosphorus and calcium, which are often interpreted as evidence of human activity at other sites, correlate spatially with trace elements that indicate exogenous mineral sources rather than in situ deposition. Stable isotope ratios of neodymium, strontium, and radiocarbon activity of microcharcoal particles also indicate exogenous inputs from alluvial deposition of carbon and mineral elements to ADE profiles, beginning several thousands of years before the earliest evidence of soil management for plant cultivation in the region. Our data suggest that indigenous peoples harnessed natural processes of landscape formation, which led to the unique properties of ADEs, but were not responsible for their genesis. If corroborated elsewhere, this hypothesis would transform our understanding of human influence in Amazonia, opening new frontiers for the sustainable use of tropical landscapes going forward.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

GALAXY CRUISE: Spiral and ring classifications for bright galaxies at z = 0.01–0.3

Abstract This paper presents a morphology classification catalog of spiral and ring features of 59854 magnitude-limited galaxies (r < 17.8 mag, and additional 628005 subsamples down to r = 20 mag) at z = 0.01–0.3 based on the Third Public Data Release of the Hyper Suprime-Cam Subaru Strategic Program. We employ two deep-learning classifiers to determine the spiral and ring structures separately based on GALAXY CRUISE Data Release 1, which is dedicated to Hyper Suprime-Cam data. The number of spiral and ring galaxies contain 31864 and 8808 sources, respectively, which constitute 53% and 15% of the sample. A notable result of this study is the construction of a large sample of ring galaxies utilizing high-quality imaging data delivered by the Subaru Hyper Suprime-Cam. However, the accurate identification of ring galaxies remains difficult at a limited seeing resolution. Additionally, we confirm that most spiral galaxies are located on the star-forming main sequence, whereas ring galaxies preferentially reside in the green valley at stellar masses of 1010.5–1011 solar mass. Furthermore, decreasing fractions of spiral and ring galaxies are observed toward the centers of the galaxy clusters. The obtained morphology catalog is publicly available on the GALAXY CRUISE website.

Shimakawa, Rhythm (ORCID:0000000344422750)↗
DOE OSTI2020

Modeling Nondestructive Defect Detection in Additively Manufactured Metallic Structures for Nuclear Applications

The future of quickly, economically produced metallic nuclear reactor parts with minimal supply-chain dependence lies in Laser Powder Bed Fusion (LPBF) Additive Manufacturing (AM): a 3D printing method involving laser melting and net shaping stainless steel and Inconel metallic powder into a solid structure. However, intrinsic features in LPBF frequently leads to the formation of materials defects, such as pores, within 3D printed structures. As safe long-term use in energy applications requires knowledge of all relevant defects before deployment in a reactor, we must develop methods for nondestructive detection of these defects. We are investigating Pulsed Thermal Tomography (PTT), which is a non-contact nondestructive imaging method scalable to arbitrary structure size. Thermal tomography (TT) is a computational method for 3D spatial reconstruction of material thermal effusivity from flash or pulsed thermography temperature data cube. Thermography data cube consists of 2D surface temperature measurements at different times. The objective of the present work is to investigate limits on defect detection in AM metallic structures with PTT. To this effect, we modeled PTT with COMSOL heat transfer computer simulations. We developed a layered media COMSOL simulation consisting of a Stainless Steel 316 (SS316) plate with an internal layer of un-sintered SS316 powder. Thermophysical properties of the powder layer were modeled with equivalent volume mixing model. To account for partial sintering at the boundary of the defect, the transition between solid and powder layers was modeled as a Gaussian. Using data from COMSOL simulations, we reconstructed depth-dependent thermal effusivity, which allowed defect visibility estimation. A series of parametric studies determined that at 1mm depth, 50µm is the smallest detectable defect. In addition, classification of the defects which can lead to early fatigue of the metallic structure in a reactor is briefly discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Results for the Fourth Quarter Calendar Year 2020 Tank 50 Salt Solution Sample

In this Technical Report, the chemical and radionuclide contaminant results from the Fourth Quarter Calendar Year 2020 (CY20) sample of Tank 50 salt solution are presented in tabulated form. The information from this characterization will be used by Savannah River Remediation (SRR) for the transfer of aqueous waste from Tank 50 to the Saltstone Production Facility (SPF), where the waste will be treated and disposed in the Saltstone Disposal Facility. This Technical Report compares results, where applicable, to SPF Waste Acceptance Criteria (WAC) Limits and Targets. The chemical and radionuclide contaminant results from the characterization of the Fourth Quarter CY20 sampling of Tank 50 were requested by SRR personnel via a Task Technical Request (TTR) and details of the testing are presented in the Savannah River National Laboratory (SRNL) Task Technical and Quality Assurance Plan (TTQAP). This Technical Report is part of Deliverable 2 relating to Task 1 from the SRR request. Data pertaining to the regulatory limits for Resource Conservation and Recovery Act (RCRA) metals per Task 2 from the SRR request, will be obtained semi-annually for the 1QCY21 and 3QCY21 Tank 50 samples. However, data pertaining to the regulatory limits for Resource Conservation and Recovery Act (RCRA) metals for this current 4QCY20 Tank 50 sample will be obtained and documented per the special analysis associated with the vault classification sample as described in the associated TTQAP.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Modularization of EDGE Workflows Using Nextflow: Improving the Efficiency and Maintainability of Bioinformatics Software

EDGE is a bioinformatics platform developed in 2016 by researchers at Los Alamos National Laboratory (LANL) to facilitate the analysis of next-generation sequencing data by researchers with varying levels of experience in bioinformatics (Li et al., 2017). Users with single-end, paired-end or long-read sequencing data can provide their reads as input to EDGE and select the combination of workflows to run that are most useful for their research (e.g., quality control of reads, genome assembly, or the taxonomic classification of input reads). Table 1 summarizes the modules available in EDGE. EDGE is available as a web platform at https://edgebioinformatics.org, as installable source code maintained on GitHub under a GPLv3 license, and as a publicly hosted Docker image.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Performance of the Quasar Spectral Templates for the Dark Energy Spectroscopic Instrument

Abstract Millions of quasar spectra will be collected by the Dark Energy Spectroscopic Instrument (DESI), leading to a fourfold increase in the number of known quasars. High-accuracy quasar classification is essential to tighten constraints on cosmological parameters measured at the highest redshifts DESI observes ( z > 2.0). We present spectral templates for identification and redshift estimation of quasars in the DESI Year 1 data release. The quasar templates are comprised of two quasar eigenspectra sets, trained on spectra from the Sloan Digital Sky Survey. The sets are specialized to reconstruct quasar spectral variation observed over separate yet overlapping redshift ranges and, together, are capable of identifying DESI quasars from 0.05 < z < 7.0. The new quasar templates show significant improvement over the previous DESI quasar templates regarding catastrophic failure rates, redshift precision and accuracy, quasar completeness, and the contamination fraction in the final quasar sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The fall, recovery, classification, and initial characterization of the Hamburg, Michigan H4 chondrite

Abstract The Hamburg meteorite fell on January 16, 2018, near Hamburg, Michigan, after a fireball event widely observed in the U.S. Midwest and in Ontario, Canada. Several fragments fell onto frozen surfaces of lakes and, thanks to weather radar data, were recovered days after the fall. The studied rock fragments show no or little signs of terrestrial weathering. Here, we present the initial results from an international consortium study to describe the fall, characterize the meteorite, and probe the collision history of Hamburg. About 1 kg of recovered meteorites was initially reported. Petrology, mineral chemistry, trace element and organic chemistry, and O and Cr isotopic compositions are characteristic of H4 chondrites. Cosmic ray exposure ages based on cosmogenic 3 He, 21 Ne, and 38 Ar are ~12 Ma, and roughly agree with each other. Noble gas data as well as the cosmogenic 10 Be concentration point to a small 40–60 cm diameter meteoroid. An 40 Ar‐ 39 Ar age of 4532 ± 24 Ma indicates no major impact event occurring later in its evolutionary history, consistent with data of other H4 chondrites. Microanalyses of phosphates with LA‐ICPMS give an average Pb‐Pb age of 4549 ± 36 Ma. This is in good agreement with the average SIMS Pb‐Pb phosphate age of 4535.3 ± 9.5 Ma and U‐Pb Concordia age of 4535 ± 10 Ma. The weighted average age of 4541.6 ± 9.5 Ma reflects the metamorphic phosphate crystallization age after parent body formation in the early solar system.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The Value of Information From Horizontal Distributed Acoustic Sensing Compared to Multicomponent Geophones Via Machine Learning

Abstract Faults play an important role in recharging many geothermal reservoirs, and seismic information can image the locations of these faults. The value of information (VOI) metric is used to objectively quantify and compare the value of two types of seismic receiver data via a machine learning approach. The demonstrated VOI methodology is novel by including spatial models from seismic data and obtaining the information statistics from machine learning. Our two-dimensional numerical experiments compare images created from sparsely spaced (80 m), two-component geophone sampling to high spatial resolution (1 m), single-component DAS. We used a three-fold cross validation of a U-Net convolutional neural networks to achieve average classification statistics. The results suggest that when horizontal sources are utilized, geophones and DAS identify reflectors and non-reflectors at roughly the same rate. The average F1 score for horizontal DAS is 0.939 and 0.931 for geophones. For images created from a vertical source, DAS performed marginally better (F1 = 0.919) than geophones (F1 = 0.877). Our transferrable methodology can provide guidance on which acquisition scenarios can improve images of important structures in the subsurface and present an efficient method for obtaining reliability statistics from high-dimensional, spatial data.

Energy & Fuels↗
DOE OSTI2023

Analysis of an optical imaging system prototype for autonomously monitoring zooplankton in an aquaculture facility

Traditional approaches to biomonitoring in aquatic systems, such as sample collection, sorting, and identification, require significant time and effort, thereby limiting the spatiotemporal resolution of sample collection. Additionally, collection and preservation of samples for subsequent taxonomic identification and enumeration leads to mortality of organisms. Recent advances in technologies that utilize optical imaging and machine learning have provided new opportunities to expedite biomonitoring and lead to significant cost savings. These technologies can be advantageous to scientists or managers that conduct routine biomonitoring to inform operations, as in the case of aquaculture facilities. The Small Aquatic Organism optical imaging system (SAO) is a high-throughput optical imaging and classification prototype system that relies on computer vision and machine learning (Support Vector Machines, or SVMs) to autonomously identify and enumerate aquatic organisms. The SAO provides a more sustainable method of collecting large volumes of data and has the benefit of being used in situ. In this study, we tested the performance of the SAO in providing comparable results to manual zooplankton community monitoring in ten ponds at an aquaculture facility. We performed a side-by-side study comparing the sampling methods of plankton tow nets, where major zooplankton taxonomic classes were manually identified and enumerated, to sampling with the SAO. Vouchered samples were used to develop a training library for the SAO, where classes consisted of water boatman and zooplankton groups: cladocerans, copepod adults, copepod nauplii, and rotifers. SAO imagery was manually classified and compared with predicted results for validation. Accuracy for the SVM classifier of the SAO was 37.4 %. Convolutional Neural Networks (CNN) and Random Forest classifiers were also applied to SAO imagery and image features for comparison. The best CNN model and our Random Forest model had accuracies of 80.4 % and 46.6 % respectively. Challenges faced included the small size of copepod nauplii and rotifers and the limited resolution of the imaging camera, although there are tradeoffs between imaging resolution and the sample processing rate. Furthermore, our comparison shows that advancement in both optical imaging and ML are needed in order for the SAO prototype to yield comparable results to manual community monitoring in an aquaculture facility.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Predicting the synthesizability of crystalline inorganic materials from the data of known material compositions

Abstract Reliably identifying synthesizable inorganic crystalline materials is an unsolved challenge required for realizing autonomous materials discovery. In this work, we develop a deep learning synthesizability model ( SynthNN ) that leverages the entire space of synthesized inorganic chemical compositions. By reformulating material discovery as a synthesizability classification task, SynthNN identifies synthesizable materials with 7× higher precision than with DFT-calculated formation energies. In a head-to-head material discovery comparison against 20 expert material scientists, SynthNN outperforms all experts, achieves 1.5× higher precision and completes the task five orders of magnitude faster than the best human expert. Remarkably, without any prior chemical knowledge, our experiments indicate that SynthNN learns the chemical principles of charge-balancing, chemical family relationships and ionicity, and utilizes these principles to generate synthesizability predictions. The development of SynthNN will allow for synthesizability constraints to be seamlessly integrated into computational material screening workflows to increase their reliability for identifying synthetically accessible materials.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Reliable photometric membership (RPM) of galaxies in clusters – I. A machine learning method and its performance in the local universe

ABSTRACT We introduce a new method to determine galaxy cluster membership based solely on photometric properties. We adopt a machine learning approach to recover a cluster membership probability from galaxy photometric parameters and finally derive a membership classification. After testing several machine learning techniques (such as stochastic gradient boosting, model averaged neural network and k-nearest neighbours), we found the support vector machine algorithm to perform better when applied to our data. Our training and validation data are from the Sloan Digital Sky Survey main sample. Hence, to be complete to $M_r^* + 3$, we limit our work to 30 clusters with $z$phot-cl ≤ 0.045. Masses (M200) are larger than $\sim 0.6\times 10^{14} \, \mathrm{M}_{\odot }$ (most above $3\times 10^{14} \, \mathrm{M}_{\odot }$). Our results are derived taking in account all galaxies in the line of sight of each cluster, with no photometric redshift cuts or background corrections. Our method is non-parametric, making no assumptions on the number density or luminosity profiles of galaxies in clusters. Our approach delivers extremely accurate results (completeness, C $\sim 92{\rm{ per\ cent}}$ and purity, P $\sim 87{\rm{ per\ cent}}$) within R200, so that we named our code reliable photometric membership. We discuss possible dependencies on magnitude, colour, and cluster mass. Finally, we present some applications of our method, stressing its impact to galaxy evolution and cosmological studies based on future large-scale surveys, such as eROSITA, EUCLID, and LSST.

Lopes, Paulo A. A.↗
DOE OSTI2023

TopFusion: Using Topological Feature Space for Fusion and Imputation in Multi-Modal Data

We present a novel multi-modal data fusion technique using topological features. The method, TopFusion, leverages the flexibility of topological data analysis tools (namely persistent homology and persistence images) to map multi-modal datasets into a common feature space by forming a new multi-channel persistence image. Each channel in the image is representative of a view of the data from a modality-dependent filtration. We demonstrate that the topological perspective we take allows for more effective data reconstruction, i.e. imputation. In particular, by performing imputation in topological feature space we are able to outperform the same imputation techniques applied to raw data or alternatively derived features. We show that TopFusion representations can be used as input to downstream deep learning-based computer vision models and doing so achieves comparable performance to other fusion methods for classification on two multi-modal datasets.

Myers, Audun D.↗
DOE OSTI2023

Intra-hour Solar Irradiance Forecast in Multiple Locations using Deep Transfer Learning

In recent years, solar power system installation imposes several challenges on the operations of local and regional power grids due to the inherent variability of ground-level solar irradiance. This work proposes a novel real-time solar forecast methodology for intra-hour solar irradiance based on deep transfer learning from ground-based sky imager for time horizons ranging from 5-15 min. There are three unique aspects of the proposed methodology: (1) a Deep Learning based algorithm development which is modeled as a classification approach rather than a traditional regression approach; (2) the use of the Transfer Learning technique to show generalization capability, robustness, and portability of baseline model in the newly deployed location where availability of enough data for training is typically scarce, and (3) redefinition of point-based irradiation forecast error estimation technique with a window-based one that is more intuitive and user-friendly. The system is developed using multiple years of irradiance and sky image recording in New Jersey and one-year data from Colorado, USA. The method is validated against ground telemetry from these two locations of diverse geographic and climatic conditions. Results show that the forecasting method proposed in this work is robust and highly accurate (8% MAPE error) for multiple locations deployment.

Deep Learning, Convolution Neural Networks, transf↗
DOE OSTI2022

Learning Latent Interactions for Event Identification via Graph Neural Networks and PMU Data

Phasor measurement units (PMUs) are being widely installed on power systems, providing a unique opportunity to enhance wide-area situational awareness. One essential application is the use of PMU data for real-time event identification. However, how to take full advantage of all PMU data in event identification is still an open problem. Thus, we propose a novel method that performs event identification by mining interaction graphs among different PMUs. The proposed interaction graph inference method follows an entirely data-driven manner without knowing the physical topology. Moreover, unlike previous works that treat interactive learning and event identification as two different stages, our method learns interactions jointly with the identification task, thereby improving the accuracy of graph learning and ensuring seamless integration between the two stages. Moreover, to capture multi-scale event patterns, a dilated inception-based method is investigated to perform feature extraction of PMU data. To test the proposed data-driven approach, a large real-world dataset from tens of PMU sources and the corresponding event logs have been utilized in this work. We report numerical results validate that our method has higher classification accuracy compared to previous methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗