Results for “Self Organizing Map” — Page 4

DOE OSTI2026

Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) (Final Technical Report)

The Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) project advances resilience science and engineering by addressing challenges in rural Kansas communities where aging infrastructure, extreme weather, and socioeconomic disparities heighten vulnerability to energy disruptions. Traditional approaches often focus on technical performance while overlooking community concerns and priorities. SAFER responds by integrating community perspectives with advanced analytical frameworks to create a holistic model for measuring and improving resilience. Project objectives included developing novel resilience metrics, advancing modeling frameworks that capture interdependencies across infrastructures, and embedding community-centric indicators directly into planning processes for distributed energy resources. The key technical innovations included the creation of self-organizing map (SOM)-based indices for objective resilience quantification, hetero-functional graph theory (HFGT) models linking power, water, transportation, and community assets, and graph neural network (GNN) tools for identifying critical nodes in complex systems. Community-centric energy planning was demonstrated through optimal siting and sizing of (photovoltaic) PV and battery storage, ensuring resilience enhancements also addressed energy burden and energy insecurity. SAFER engaged community partners in Dodge City and Ford County through surveys, focus groups, and workshops, generating more than 600 responses that established baseline measures of energy burden, financial insecurity, and willingness-to-pay to avoid outages. This data, organized in terms of a community capitals framework, informed the development of weighted reliability indices that better reflect community costs than traditional utility metrics. SAFER’s GNN-based critical node identification framework identified expert-labelled critical nodes with over 99% accuracy, while also uncovering additional functionalities essential for proactive resilience planning. The project’s models demonstrated that optimal PV and storage deployment could improve resilience indices by over 11 percent, with dispatch strategies further enhancing outcomes, confirming both the technical effectiveness and economic feasibility of these approaches. Through its combined emphasis on rigorous modeling, community-focused planning, and community engagement, SAFER advances the state of resilience research while delivering direct benefits to rural communities. The project provides tools, guidelines, and resilience heatmaps that help utilities, local governments, and residents better anticipate disruptions, prioritize investments, and strengthen the capacity to withstand and recover from energy-related hazards. Furthermore, the developed HFG and GNN frameworks are designed for transferability, allowing them to be adapted for resilience planning in other communities with minimal retraining. This inductive learning capability provides a scalable pathway to extend the SAFER project’s impact. Thus, creating a foundation for a nationally applicable model of infrastructure resilience. Additionally, the HFG can also be extended to include other FEMA community lifelines.

14 SOLAR ENERGY↗

DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Cold-front (D01)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗

DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Cold-front (D02)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗

DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Sea-breeze (D01)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗

DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Sea-breeze (D02)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗

DOE OSTI2023

Data and code repository for "How do the weather regimes drive wind speed and power production at the sub-seasonal to seasonal timescales over the CONUS?"

There has been an increasing need for forecasting power generation at the sub-seasonal to seasonal (S2S) timescales to support the operation, management, and planning of the wind-energy system. At the S2S timescales, atmospheric variability is largely related to recurrent and persistent weather patterns, referred to as weather regimes (WRs). In the study "How do the weather regimes drive wind speed and power production at the sub-seasonal to seasonal timescales over the CONUS?", we identify four WRs that influence wind resources over North America using a self-organizing map (SOM) algorithm. These WRs are responsible for large-scale wind and power production anomalies over the CONUS at the S2S timescales. The WR-based reconstruction explains up to 50% of the monthly variance of power production over the western United States, and the explanatory power generally increases with the increase of timescales. The identified relationship between WRs and power production reveals the potential and limitations of the regional WR-based wind resource assessment over different regions of the CONUS across multiple timescales. This repository includes all the data and codes we use for analyses in this study. Users may use them to reproduce the results of this study on their end.

17 WIND ENERGY↗

DOE OSTI2025

The DECADE cosmic shear project II: photometric redshift calibration of the source galaxy sample

We present the photometric redshift characterization and calibration for the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The redshifts are estimated from a combination of wide-field photometry, deep-field photometry with associated redshift estimates, and a transfer function between the wide field and deep field that is estimated using a source injection catalog. We construct four tomographic bins for the galaxy catalog, and estimate the redshift distribution, $n(z)$, within each one using the Self-organizing Map Photo-Z (SOMPZ) methodology. Our estimates include the contributions from sample variance, zeropoint calibration uncertainties, and redshift biases, as quantified for the deep-field dataset. The total uncertainties on the mean redshifts are $σ_{\langle}$$_z$$_{\rangle} ≈ 0.01$. The SOMPZ estimates are then compared to those from the clustering redshift method, obtained by cross-correlating our source galaxies with galaxies in spectroscopic surveys, and are shown to be consistent with each other.

Anbajagane, D. [Univ. of Chicago, IL (United State↗

DOE OSTI2026

From microbial diversity to functional potential using dimensionality reduction

The high dimensionality of microbial diversity data from ‘omics observations can be reduced using Machine Learning, with many recent studies showcasing ML utility for exploratory ecological feature finding and process prediction. Here, we compare the Self Organizing Map (SOM) dimensionality reduction method to the well-documented sample-based Principal Coordinate Analysis (PCoA) and taxa-based Weighted Gene Correlation Network Analysis (WGCNA) using near daily 16S rRNA gene amplicon sequencing data from the 2019 to 2020 MOSAiC International Arctic Drift Expedition. We then map k-means clustering outputs from each method to available metagenomes, extracting functionally distinct seasonal microbial ecotypes in the surface Arctic Ocean. Our results indicate the SOM method better represented expected seasonal transitions and identified a greater number of metabolically distinct functional groups than the more traditional PCoA ordination. Ultimately, we identified four community ecotypes with distinct taxonomic and functional cut-offs driven by seasonality, water mass, and substrate turnover, highlighting the importance of succession in functional diversity for the central Arctic Ocean. These results reinforce ML dimensionality reduction as a meaningful translator in the mining of historical amplicon datasets to address modern mechanistic questions and potentially provide ’omics informed ecotype diversity to leverage in mechanistic biogeochemical models.

Arctic Ocean↗

DOE OSTI2021

Displacement Analysis of Geothermal Field Based on PSInSAR And SOM Clustering Algorithms A Case Study of Brady Field, Nevada—USA

The availability of free and high temporal resolution satellite data and advanced SAR techniques allows us to analyze ground displacement cost-effectively. Our aim was to properly define subsidence and uplift areas to delineate a geothermal field and perform time-series analysis to identify temporal trends. A Persistent Scatterer Interferometry (PSI) algorithm was used to estimate vertical displacement in the Brady geothermal field located in Nevada by analyzing 70 Sentinel-1A Synthetic-Aperture Radar (SAR) images, between January 2017 and December 2019. To classify zones affected by displacement, an unsupervised Self-Organizing Map (SOM) algorithm was applied to classify points based on their behavior in time, and those clusters were used to determine subsidence, uplift, and stable regions automatically. Finally, time-series analysis was applied to the clustered data to understand the inflection dates. The maximum subsidence is –19 mm/yr with an average value of –6 mm/yr within the geothermal field. The maximum uplift is 14 mm/yr with an average value of 4 mm/yr within the geothermal field. The uplift occurred on the NE of the field, where the injection wells are located. On the other hand, subsidence is concentrated on the SW of the field where the production wells are located. The coupling of the PSInSAR and the SOM algorithms was shown to be effective in analyzing the direction and pattern of the displacements observed in the field.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Where does the dust deposited over the Sierra Nevada snow come from?

Abstract. Mineral dust contributes up to one-half of surface aerosol loading in spring over the southwestern United States, posing an environmental challenge that threatens human health and the ecosystem. Using self-organizing map (SOM) analysis with dust deposition and flux data from WRF-Chem and Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), we identify four typical dust transport patterns across the Sierra Nevada, associated with the mesoscale winds, Sierra barrier jet (SBJ), North Pacific High (NPH), and long-range cross-Pacific westerlies, respectively. We find that dust emitted from the Central Valley is persistently transported eastward, while dust from the Mojave Desert and Great Basin influences the Sierra Nevada during mesoscale transport occurring mostly in winter and early spring. Asian dust reaching the mountain range comes either from the west through straight isobars (cross-Pacific transport) or from the north in the presence of the NPH. Extensive dust depositions are found on the west slope of the mountain, contributed by Central Valley emissions and cross-Pacific remote transport. In particular, the SBJ-related transport produces deposition through landfalling atmospheric rivers, whose frequency might increase in a warming climate.

Huang, Huilin (ORCID:0000000273286738)↗

DOE OSTI2024

Tracking precipitation features and associated large-scale environments over southeastern Texas

Abstract. Deep convection initiated under different large-scale environmental conditions exhibits different precipitation features and interacts with local meteorology and surface properties in distinct ways. Here, we analyze the characteristics and spatiotemporal patterns of different types of convective systems over southeastern Texas using 13 years of high-resolution observations and reanalysis data. We find that mesoscale convective systems (MCSs) contribute significantly to both mean and extreme precipitation in all seasons, while isolated deep convection (IDC) plays a role in intense precipitation during summer and fall. Using self-organizing maps (SOMs), we found that convection can occur under unfavorable conditions without large-scale lifting or moisture convergence. In spring, fall, and winter, front-related large-scale meteorological patterns (LSMPs) characterized by low-level moisture convergence act as primary triggers for convection, while the remaining storms are associated with an anticyclonic pattern and orographic lifting. In summer, IDC events are mainly associated with front-related and anticyclonic LSMPs, while MCSs occur more in front-related LSMPs. We further tracked the life cycle of MCS and IDC events using the Flexible Object Tracker algorithm over southeastern Texas. MCSs frequently initiate west of Houston, traveling eastward for around 8 h to southeastern Texas, while IDC events initiate locally. The average duration of MCSs in southeastern Texas is 6.1 h, approximately 4.1 times the duration of IDC events. Diurnally, the initiation of convection associated with favorable LSMPs peaks at 11:00 UTC, 3 h earlier than that associated with anticyclones.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Variations in boundary layer stability across Antarctica: a comparison between coastal and interior sites

The range of boundary layer stability profiles, from the surface to 500 m a.g.l. (above ground level), present in radiosonde observations from two continental-interior (South Pole Station and Dome Concordia Station) and three coastal (McMurdo Station, Georg von Neumayer Station III, and Syowa Station) Antarctic sites, is examined using the self-organizing maps (SOMs) neural network algorithm. A wide range of potential temperature profiles is revealed, from shallow boundary layers with strong near-surface stability to deeper boundary layers with weaker or near-neutral stability, as well as profiles with weaker near-surface stability and enhanced stability aloft, above the boundary layer. Boundary layer regimes were defined based on the range of profiles revealed by the SOM analysis; 20 boundary layer regimes were identified to account for differences in stability near the surface as well as above the boundary layer. Strong, very strong, or extremely strong stability, with vertical potential temperature gradients of 5 to in excess of 30 K per 100 m, occurred more than 80 % of the time at South Pole and Dome Concordia in the winter. Weaker stability was found in the winter at the coastal sites, with moderate and strong stability (vertical potential temperature gradients of 1.75 to 15 K per 100 m) occurring 70 % to 85 % of the time. Even in the summer, moderate and strong stability is found across all five sites, either immediately near the surface or aloft, just above the boundary layer. While the mean boundary layer height at the continental-interior sites was found to be approximately 50 m, the mean boundary layer height at the coastal sites was deeper, around 110 m. Further, a commonly described two-stability-regime system in the Arctic associated with clear or cloudy conditions was applied to the 20 boundary layer regimes identified in this study to understand if the two-regime behavior is also observed in the Antarctic. It was found that moderate and strong stability occur more often with clear- than cloudy-sky conditions, but weaker stability regimes occur almost equally for clear and cloudy conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July, August, and September, 2022

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A). This dataset includes the data in June, July, August, and September; the last year of the data is 2022.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Synoptic Weather Regime Classifications for the whole year, from 2014 to 2015

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July, August, from 2000 to 2024

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for March, April and May, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July and August, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for December, January and February, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

{node_som_ml,synop_wea_reg}↗