Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Self Organizing Map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Local-thermal-gradient and large-scale-circulation impacts on turbine-height wind speed forecasting over the Columbia River Basin

Abstract. We investigate the sensitivity of turbine-height wind speed forecast to initial condition (IC) uncertainties over the Columbia River Gorge (CRG) and Columbia River Basin (CRB) for two typical weather phenomena, i.e., local-thermal-gradient-induced marine air intrusion and a cold frontal passage. Four types of turbine-height wind forecast anomalies and their associated IC uncertainties related to local thermal gradients and large-scale circulations are identified using the self-organizing map (SOM) technique. The four SOM types are categorized into two patterns, each accounting for half of the ensemble members. The first pattern corresponds to IC uncertainties that alter the wind forecast through a modulating weather system, which produces the strongest wind anomalies in the CRG and CRB. In the second pattern, the moderate uncertainties in local thermal gradient and large-scale circulation jointly contribute to wind forecast anomaly. We analyze the cross section of wind and temperature anomalies through the gorge to explore the evolution of vertical features of each SOM type. The turbine-height wind anomalies induced by large-scale IC uncertainties are more concentrated near the front. In contrast, turbine-height wind anomalies induced by the local IC thermal uncertainties are found above the surface thermal anomalies. Moreover, the wind forecast accuracy in the CRG and CRB is limited by IC uncertainties in a few specific regions, e.g., the 2 m temperature within the basin and large-scale circulation over the northeast Pacific around 140∘ W.

17 WIND ENERGY↗

Predictive links between microbial communities and biological oxygen utilization in the Arctic Ocean

Microbial metabolism influences rates of net community production (NCP), exerting a direct biological control on marine oxygen and carbon fluxes. In the Arctic, it is increasingly important to understand and quantify this process, as ecological and oceanographic conditions shift due to changing climate. Here, we describe potential ecological links between pelagic microbial diversity and an NCP precursor, biological oxygen utilization, using machine learning and paired observations of community structure and metabolic activity from a seasonally and spatially variable transect of the Arctic Ocean (2019–2020 MOSAiC Expedition). Community structure was determined using 16S (prokaryotic) and 18S (eukaryotic) rRNA gene amplicon sequencing, and metabolic activity was derived from ΔO 2 /Ar. Using self-organizing maps, we identified clear successional patterns in observed microbial community structure that were seasonally driven in the upper ocean and vertically stratified with depth. Metabolic activity was also stratified, with a primarily net heterotrophic water column (median −1.5% biological oxygen saturation), excepting periodic oxygen supersaturation (maximum: 13.6%) within the mixed layer. Using DNA sequences as predictor variables, we then constructed a random forest regression model that reliably reconstructed biological oxygen concentrations (root mean squared error = 4.14 μmol kg −1 ). Top predictors from this model were from heterotrophic (bacteria) or potentially mixotrophic (dinoflagellate) taxa. These analyses highlight biologically driven diagnostic tools that can be used to expand biogeochemical datasets and improve the microbial perspectives and metabolisms represented in ecological models of net productivity and carbon flux in a changing Arctic Ocean.

Chamberlain, Emelia J. [Univ. of San Diego, San Di↗

Uncertain role of clouds in shaping summertime atmosphere-sea ice connections in reanalyses and CMIP6 models

Downwelling longwave radiation (DLR) driven by the atmospheric and cloud conditions in the troposphere is suggested to be a dominant factor to determine the summertime net surface energy budget over the Arctic Ocean and thus plays a key role to shape the September sea ice. We use reanalyses and the self-organizing map (SOM) method to distinguish CMIP6 model performance in replicating the observed strong atmosphere-DLR connection. We find all models can reasonably simulate the linkage between key atmosphere variables and the clear sky DLR but behave differently in replicating the atmosphere-DLR connection due to cloud forcing. In ERA5 and strongly coupled models, tropospheric high pressure is associated with decreased clouds in the mid- and high-levels and increased clouds near the surface. This out-of-phase structure indicates that DLR cloud forcing is nearly neutral, making the clear sky DLR more important to bridge JJA circulation to late-summer sea ice. In MERRA-2 and weakly coupled models, tropospheric clouds display a vertically homogeneous reduction; the cloud DLR is thus strongly reduced due to the cooling effect, which partially cancels out the clear sky DLR and makes the total DLR less efficient to translate circulation forcing to sea ice. The differences of cloud vertical distribution in CMIP6 appear to be differentiated by circulation related relative humidity. Therefore, a better understanding of the discrepancy of different reanalyses and remote sensing products is critical to comprehensively evaluate simulated interactions among circulation, clouds, sea ice and energy budget at the surface in summer.

54 ENVIRONMENTAL SCIENCES↗

Projections of winter polynyas and their biophysical impacts in the Ross Sea Antarctica

Abstract This study investigates winter polynyas in the southern Ross Sea, Antarctica where several polynyas are known to form. Coastal polynyas are areas of lower sea ice concentration and/or thickness along the coast that are otherwise surrounded by more extensive, thicker sea ice pack. Polynyas are also locations where organisms can exploit both the ice substrate and pelagic resources. Using a self organizing map algorithm, we identify polynya events in the Community Earth System Model Version 2 Large Ensemble (CESM2-LE). The neural network algorithm is able to identify polynya events without imposing an ice concentration or thickness threshold, as is often done when identifying polynyas. The CESM2-LE produces a wintertime polynya feature comparable in size and location to the Ross Sea polynya, and during polynya events there are large turbulent heat fluxes and export of sea ice from the Ross Sea. In the CESM2-LE polynya event frequency is projected to decrease sharply in the later twentyfirst century, leading to increasing sea ice concentrations and thicknesses in the region. The drivers of the polynya frequency decline are likely both large scale circulation changes and local atmosphere and ocean feedbacks. If declines in wintertime polynya frequency over the twentyfirst century do occur they may impact Antarctic Bottom Water formation and local net primary productivity. Thus, better understanding potential local and unexpected sea ice changes in the Ross Sea is important for both assessing climate system impacts and ecological impacts on the Ross Sea ecosystem, which is currently protected by an internationally recognized marine protected area.

Meteorology & Atmospheric Sciences↗

Corrosion of rebar in concrete. Part III: Artificial Neural Network analysis of chloride threshold data

Active corrosion of carbon steel in reinforced concrete occurs when the chloride ion concentration exceeds the chloride threshold (CT). CT is affected by many physical and chemical parameters including primary variables (pH, corrosion potential, breakdown potential, and temperature) and secondary variables (cemenet composition, concreete porosity, and water/cement ratio). A Kohonen-self organized map (KSOM) and regression artificial neural network (ANN) coupled methodology was developed to find the missing values of independent variables in the sparse database and for quantitatively evaluating the effects of these variables on CT values that are expressed in %TotalCl/cem (or %FreeCl/cem), and [Cl - ]/[OH - ].

36 MATERIALS SCIENCE↗

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗

Discovery of peculiar radio morphologies with ASKAP using unsupervised machine learning

Abstract We present a set of peculiar radio sources detected using an unsupervised machine learning method. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope to train a self-organizing map (SOM). The radio maps from three ASKAP surveys, Evolutionary Map of Universe pilot survey (EMU-PS), Deep Investigation of Neutral Gas Origins pilot survey (DINGO), and Survey With ASKAP of GAMA-09 + X-ray (SWAG-X), are used to search for the rarest or unknown radio morphologies. We use an extension of the SOM algorithm that implements rotation and flipping invariance on astronomical sources. The SOM is trained using the images of all ‘complex’ radio sources in the EMU-PS which we define as all sources catalogued as ‘multi-component’. The trained SOM is then used to estimate a similarity score for complex sources in all surveys. We select 0.5% of the sources that are most complex according to the similarity metric and visually examine them to find the rarest radio morphologies. Among these, we find two new odd radio circle (ORC) candidates and five other peculiar morphologies. We discuss multiwavelength properties and the optical/infrared counterparts of selected peculiar sources. In addition, we present examples of conventional radio morphologies including: diffuse emission from galaxy clusters, and resolved, bent-tailed, and FR-I and FR-II type radio galaxies. We discuss the overdense environment that may be the reason behind the circular shape of ORC candidates.

Astronomy & Astrophysics↗

Meteorological environments associated with California wildfires and their potential roles in wildfire changes during 1984-2017

California has been seeing more wildfires in recent years, resulting in huge economic losses and threatening human health. Clarifying the meteorological environments of wildfires is foundational to improving the understanding and prediction of wildfires and their impacts. Here, 1535 California wildfires during 1984-2017 are systematically investigated. Based on two key meteorological factors - temperature and moisture anomalies - all wildfires are classified into four groups: hot-dry, hot-wet, cold-dry, cold-wet. Most (~60%) wildfires occurred on hot-dry days. Compositing the large-scale environments of the four groups shows that persistent high pressure and strong northeasterly wind descending from inland favor hot-dry conditions for wildfires. This analysis also reveals an important role of anomalies in southerly onshore flow that supports stronger convection, accompanied by more lightning flashes that provide a triggering mechanism for wildfires under hot-wet conditions. Self-organizing map analysis lends confidence in the large-scale meteorological pattern for dominating hot-dry wildfires in California. Besides wildfire occurrence, wildfire size is also influenced by meteorological anomalies through their magnitudes. Among them, moisture anomaly explains the largest fraction (~69%) of variability in wildfire sizes. Large-scale meteorological anomalies are found to play an important role in the devastating 2018 wildfire season in California. During 1984-2017, wildfire burned area has significantly increased by ~3.6% per year, indicating a doubling of burned area in 2017 relative to 1984, with the trend dominated by hot-dry wildfires in summer. Drying and warming in conjunction with strengthening of the high pressure in summer support more frequent and larger wildfires in California.

58 GEOSCIENCES↗

Attention Network Forecasts Time-to-Failure in Laboratory Shear Experiments

Rocks under stress deform by creep mechanisms that include formation and slip on small-scale internal cracks. Intragranular cracks and slip along grain contacts release energy as elastic waves termed acoustic emissions (AE). AEs are thought to contain predictive information that can be used for fault failure forecasting. Here, we present a method using unsupervised classification and an attention network to forecast labquakes using AE waveform features. Our data were generated in a laboratory setting using a biaxial shearing device with granular fault gouge intended to mimic the conditions of tectonic faults. Here, we analyzed the temporal evolution of AEs generated throughout several hundred laboratory earthquake cycles. We used a Conscience Self-Organizing Map (CSOM) to perform topologically ordered vector quantization based on waveform properties. The resulting map was used to interactively cluster AEs. We examined the clusters over time to identify those with predictive ability. Finally, we used a variety of LSTM and attention-based networks to test the predictive power of the AE clusters. By tracking cumulative waveform features over the seismic cycle, the network is able to forecast the time-to-failure (TTF) of lab earthquakes. Our results show that analyzing the data to isolate predictive signals and using a more sophisticated network architecture are key to robustly forecasting labquakes. In the future, this method could be applied on tectonic faults to monitor earthquakes and augment early warning systems.

58 GEOSCIENCES↗

Crucial roles of eastward propagating environments in the summer MCS initiation over the U.S. Great Plains

Mesoscale convective systems (MCSs) frequently occur over the U.S. Great Plains during summer. An analysis using self-organizing map is conducted to identify four types of summer MCS initiation environments during 2004-2017. The first two types feature favorable large-scale environments at both upper and low levels, while Type-3 has favorable lower-level and surface conditions but unfavorable upper-level circulation, and Type-4 features the most unfavorable large-scale environments for MCS initiation. Despite the unfavorable large-scale environment, the convection-centered environments in Type-4 are favorable for MCS initiation and similar to the first two types, suggesting a role of sub-synoptic disturbances as an MCS precursor. All four types of the MCS initiation delineate a clear eastward propagating feature in many fields, such as upper-level potential vorticity/geopotential height, surface pressure and surface equivalent potential temperature, upstream up to 25°-longitude west of and ~36 hours before the MCS initiation. The propagating environments and local, non-propagating low-level moisture are found to be important in MCS initiation at the foothill of the Rocky Mountains, but over the central Great Plains, it is the coupling of dynamical and moisture anomalies associated with propagating waves that results in the MCS initiation. By tracking MCSs and mid-tropospheric perturbations (MPs), a type of sub-synoptic disturbances with Rocky Mountains origin, ~30% of MPs is associated with MCS initiation, mostly in Type-4. Although MPs are related to a small fraction of MCS initiation, MCSs that are associated with MPs tend to produce more rainfall in a larger area with a stronger convective intensity, suggesting MPs to be a source of intense MCSs in summer.

Song, Fengfei↗

Assessing Physical Relationships Between Atmospheric State, Fluxes, and Boundary Layer Stability at McMurdo Station, Antarctica

Observations at McMurdo Station, Antarctica from 24 November 2015 through 3 January 2017 were used to characterize the physical relationships between boundary layer stability and atmospheric state and fluxes. The basis of this analysis was self-organizing maps (SOMs), a neural network algorithm, used to identify the range of potential temperature profiles present in the twice-daily radiosonde data during the ARM (Atmospheric Radiation Measurement) West Antarctic Radiation Experiment (AWARE) campaign. The SOM identified profiles ranging from strongly stable to weakly stable regimes over the lowest 500 m of the atmosphere. It was found that in the winter (MJJA), moderate and strongly stable regimes occur most frequently (61%), while weakly stable regimes dominate in the summer (DJ, 83.4%). The mechanisms responsible for the dominance of different stability regimes in each season were analyzed to determine why these regimes occur with varying frequency throughout the year. This analysis found that wind speed variations and radiative cooling are responsible for the stability observed in the winter, radiative warming, as well as weaker wind speeds, are responsible for summer weak stability, and stability variations in the transition seasons (FMA, SON) are characterized by a change in sign of net radiation with increasing stability, as wind speed changes little across stability regimes. Low-level jets were observed to occur about 50% of the time below areas of enhanced stability aloft and were observed most frequently in the transition seasons. The boundary layer depth, as determined by the Bulk Richardson number, was found to decrease with increasing stability.

54 ENVIRONMENTAL SCIENCES↗

Wintertime synoptic patterns of midlatitude boundary layer clouds over the western North Atlantic: Climatology and insights from in-situ ACTIVATE observations

The winter synoptic evolution of the western North Atlantic and its influence on the atmospheric boundary layer is described by means of a regime classification based on Self Organizing Maps applied to 12 year of data (2009-2020). The regimes are classified into categories according to daily 600-hPa geopotential height: dominant ridge, trough to ridge eastward transition (trough-ridge), dominant trough, and ridge to trough eastward transition (ridge-trough). A fifth synoptic regime resembles the winter climatological mean. Coherent changes in sea-level pressure and large-scale winds are in concert with the synoptic regimes: 1) the ridge regime is associated with a well-developed anticyclone; 2) the trough-ridge gives rise to a low pressure center over the ocean, ascents, and northerly winds over the coastal zone; 3) trough is associated with the eastward displacement of a cyclone, coastal subsidence, and northerly winds, all representative characteristics of cold-air outbreaks; 4) the ridge-trough regime features the development of an anticyclone and weak coastal winds. Low clouds are characteristic of the trough regime, with both trough and trough-ridge featuring synoptic maxima in cloud droplet number concentration (N d ). The N d increase is primarily observed near the coast, concomitant with strong surface heat fluxes exceeding by more than 400 W m -2 compared to fluxes further east. Five consecutive days of aircraft observations collected during the ACTIVATE campaign corroborates the climatological characterization, confirming the occurrence of high N d for days identified as trough. This study emphasizes the role of boundary-layer dynamics and aerosol activation and their roles in modulating cloud microphysics.

54 ENVIRONMENTAL SCIENCES↗

Synoptic Drivers of Atmospheric River Induced Precipitation Near Dronning Maud Land, Antarctica

Atmospheric rivers (ARs) that reach the Antarctic Ice Sheet (AIS) transport anomalous moisture from lower latitudes and can impact the AIS via extreme precipitation and increased downward longwave radiation. ARs contribute significantly to the interannual variability of precipitation over the AIS and thus are likely to play a key role in understanding future changes in the surface mass balance of the AIS. Dronning Maud Land (DML) is one of four maxima in AR frequency over coastal East Antarctica, with AR precipitation explaining 77% of the interannual variability in precipitation for this region. We employ a 16-node self-organizing map (SOM) trained with MERRA-2 sea-level pressure anomalies to identify synoptic-scale environments associated with landfalling ARs in and around DML. Node composites of atmospheric variables reveal common drivers of precipitation associated with ARs reaching DML including anomalous high-low surface pressure couplets, anomalously high integrated water vapor, and coastal barrier jets. Using a quasi-geostrophic framework, we find that upward vertical motion associated with the occlusion process of attendant cyclones dominates atmospheric lift in AR environments. We further identify mechanisms that explain the variability in AR precipitation intensity across nodes, such as the lift associated with the occlusion process of attendant cyclones and the spatial coincidence of ascent induced by the occlusion process and frontogenesis. Here, the latter suggests that ARs making landfall during the mature phase of cyclogenesis result in higher precipitation intensity compared to landfalling ARs that occur during the occluded phase.

54 ENVIRONMENTAL SCIENCES↗

Meteorological Drivers of North American Monsoon Extreme Precipitation Events

Abstract In this paper the meteorological drivers of North American Monsoon (NAM) extreme precipitation events (EPEs) are identified and analyzed. First, the NAM area and its subregions are distinguished using self‐organizing maps applied to the Climate Prediction Center global precipitation data set. This reveals distinct subregions, shaped by the inhomogeneous geographic features of the NAM area, with distinct extreme precipitation character and drivers. Next, defining EPEs as days when subregion‐mean precipitation exceeds the 95th percentile of rainy days, five synoptic features and one mesoscale feature are investigated as potential drivers of EPEs. Essentially all EPEs can be associated with at least one selected driver, with only one event remaining unclassified. This analysis shows the dominant role of Gulf of California moisture surges, mesoscale convective systems and frontal systems in generating NAM extreme precipitation. Finally, a frequency and probability analysis is conducted to contrast precipitation distributions conditioned on the associated meteorological drivers. The findings demonstrate that the co‐occurrence of multiple features does not necessarily enhance the EPE probability.

Meteorology & Atmospheric Sciences↗

Spring Dust in Colorado Plateau: Transport Pathways and Interannual Variability Derived From Two Decades of MERRA‐2 Reanalysis

Spring dust storms in the U.S. Southwest significantly impact environmental and human systems, yet their climatological patterns and driving mechanisms remain poorly understood. Using two decades of MERRA-2 reanalysis data and self-organizing map clustering, we identified four distinct dust transport pathways from surrounding and remote deserts for the top 10% of spring dust events impacting the Colorado Plateau: (a) intense southwesterly near-surface transport where eastward upward transport is blocked by topography, (b) substantial remote transport plus weaker surface emissions, (c) moderate southwesterly transport with stronger upper-level transport, and (d) rare northwesterly pattern linked to the Great Basin sources, which accounts for 38%, 14%, 37%, and 11% of total events, respectively. The frequency and intensity of these events strongly correlate with large-scale climate variability, with increased dust events during La Niña. Our results provide a robust framework for improving seasonal dust forecasts and understanding future dust dynamics under climate change.

aerosol transport↗

Using active learning to improve quasar identification for the DESI spectra processing pipeline

The Dark Energy Spectroscopic Instrument (DESI) survey uses an automatic spectral classification pipeline to classify spectra. QuasarNET is a convolutional neural network used as part of this pipeline originally trained using data from the Baryon Oscillation Spectroscopic Survey (BOSS). In this paper we implement an active learning algorithm to optimally select spectra to use for training a new version of the QuasarNET weights file using only DESI data, with the goal of improving classification accuracy. This active learning algorithm includes a novel outlier rejection step using a Self-Organizing Map to ensure we label spectra representative of the larger quasar sample observed in DESI. We perform two iterations of the active learning pipeline, assembling a final dataset of 5600 labeled spectra, a small subset of the approximately 1.3 million quasar targets in DESI's Data Release 1. When splitting the spectra into training and validation subsets we achieve similar performance to the previously trained weights file in completeness and purity calculated on the validation dataset but do so with less than one tenth of the amount of training data. The new weights also more consistently classify objects in the same way when used on unlabeled data compared to the old weights file. In the process of improving QuasarNET's classification accuracy we discovered a systemic error in QuasarNET's redshift estimation and used our findings to improve our understanding of QuasarNET's redshifts.

Machine learning↗

Examining future changes in coastal low-level jet properties offshore California through dynamical downscaling

The coastal low-level jet, or coastal low-level jet (CLLJ), is a synoptically-forced meteorological feature frequently present offshore the western United States (U.S.). Characterized by a wind speed maximum that resides at the top of the marine boundary layer, the CLLJ is largely controlled by the location and strength of the North Pacific High (NPH) as well as the coastal geometry. Considering the rich wind resource available in this offshore region, the Bureau of Ocean Energy Management identified wind energy lease areas offshore California and supported the deployment of two U.S. Department of Energy wind lidar buoys near Morro Bay and Humboldt. Despite our relatively good understanding of the fundamental mechanisms responsible for large-scale CLLJ properties offshore the western U.S., future changes in CLLJ characteristics are less clear. To address this research challenge, and ultimately to better inform future wind turbine deployments, we use simulations driven by three global climate models (GCMs). We apply self-organizing maps to the model outputs for a historical and two future climate periods to show the range of NPH regimes that support CLLJ conditions during the warm seasons, as well as the subtle contribution from land-falling cyclones approaching the mainland during the cold seasons. Compared to the historical period, the three GCM-driven simulations agree that CLLJ conditions will become more (less) prevalent from central California northward (southward). They agree less with respect to future changes in maximum CLLJ wind speeds and CLLJ heights. However, after considering model biases present during the historical period, wind speeds between the models are actually more similar during the 2070–2095 period than during the historical period. The potential combination of more frequent CLLJ conditions characterized by relatively consistent wind speeds occurring at lower heights across northern California suggests that the Humboldt lease area may be ideal for a long-term wind turbine deployment.

54 ENVIRONMENTAL SCIENCES↗

Optimizing the shape of photometric redshift distributions with clustering cross-correlations

We present an optimization method for the assignment of photometric galaxies to a chosen set of redshift bins. This is achieved by combining simulated annealing, an optimization algorithm inspired by solid-state physics, with an unsupervised machine learning method, a self-organizing map (SOM) of the observed colours of galaxies. Starting with a sample of galaxies that is divided into redshift bins based on a photometric redshift point estimate, the simulated annealing algorithm repeatedly reassigns SOM-selected subsamples of galaxies, which are close in colour, to alternative redshift bins. We optimize the clustering cross-correlation signal between photometric galaxies and a reference sample of galaxies with well-calibrated redshifts. Depending on the effect on the clustering signal, the reassignment is either accepted or rejected. By dynamically increasing the resolution of the SOM, the algorithm eventually converges to a solution that minimizes the number of mismatched galaxies in each tomographic redshift bin and thus improves the compactness of their corresponding redshift distribution. This method is demonstrated on the synthetic Legacy Survey of Space and Time cosmoDC2 catalogue. We find a significant decrease in the fraction of catastrophic outliers in the redshift distribution in all tomographic bins, most notably in the highest redshift bin with a decrease in the outlier fraction from 57 percent to 16 percent.

79 ASTRONOMY AND ASTROPHYSICS↗