SEARCH · Engineering Papers

Results for “Self Organizing Map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Programs and Code for Geothermal Exploration Artificial Intelligence

The scripts below are used to run the Geothermal Exploration Artificial Intelligence developed within the "Detection of Potential Geothermal Exploration Sites from Hyperspectral Images via Deep Learning" project. It includes all scripts for pre-processing and processing, including: - Land Surface Temperature K-Means classifier - Labeling AI using Self Organizing Maps (SOM) - Post-processing for Permanent Scatterer InSAR (PSInSAR) analysis with SOM - Mineral marker summarizing - Artificial Intelligence (AI) Data splitting: creates data set from a single raster file - Artificial Intelligence Model: creates AI from a single data set, after splitting in Train, Validation and Test subsets - AI Mapper: creates a classification map based on a raster file

15 GEOTHERMAL ENERGY↗

NASA NTRS2022

Summer Greenland Blocking Diversity and Its Impact on the Surface Mass Balance of the Greenland Ice Sheet

The increase in Greenland Ice Sheet (GrIS) surface runoff since the turn of the century has been linked to a rise in Greenland blocking frequency. However, a range of synoptic patterns can be considered blocked flow and efforts that summarize all blocking types indiscriminately likely fail to capture consequential differences in GrIS response. To account for these differences, we employ ERA5 reanalysis to identify summer blocking using two independent blocking metrics: the Greenland Blocking Index (GBI) and the blocking index of Pelly and Hoskins (2003, https://doi.org/10.1175/1520-0469(2003)060<0743:ANPOB>2.0.CO;2). We then conduct a self-organizing map analysis to objectively classify synoptic conditions during Greenland blocking episodes and identify three primary blocking types: (a) a high-amplitude Omega block, (b) a lower-amplitude, stationary summer ridge, and (c) a cyclonic wave breaking pattern. Using Modèle Atmosphérique Régional output, we document the spatiotemporal progression of the surface energy and mass balance for each blocking type. Relative to all blocking episodes, summer ridge patterns produce more melt over the southern ice sheet, Omega blocks produce more melt across the northern ice sheet, and cyclonic wave breaking patterns produce more melt in northeast Greenland. Our results indicate that the recent trend in summer Greenland blocking was largely driven by an increase in Omega patterns and suggest that Omega blocks have played a central role in the recent acceleration of GrIS mass loss. Furthermore, the GBI exhibited a relative bias toward Omega patterns, which may help explain why it has measured stronger trends in summer Greenland blocking than other blocking metrics.

atmospheric blocking↗

NASA NTRS2017

Tropospheric Ozonesonde Profiles at Long-Term U.S. Monitoring Sites: 2. Links Between Trinidad Head, CA, Profile Clusters and Inland Surface Ozone Measurements

Much attention has been focused on the transport of ozone (O3) to the western U.S., particularly given the latest revision of the National Ambient Air Quality Standard to 70 parts per billion by volume (ppbv) of O3. This makes quantifying the contributions of stratosphere-to-troposphere exchange, local pollution, and pollution transport to this region essential. To evaluate free-tropospheric and surface O3 in the western U.S., we use self-organizing maps to cluster 18 years of ozonesonde profiles from Trinidad Head, CA. Three of nine O3 mixing ratio profile clusters exhibit thin laminae of high O3 above Trinidad Head. The high O3 layers are located between 1 and 6 km above mean sea level and reside above an inversion associated with a northern location of the Pacific subtropical high. Ancillary data (reanalyses, trajectories, and remotely sensed carbon monoxide) help identify the high O3 sources in one cluster, but distinguishing mixed influences on the elevated O3 in other clusters is difficult. Correlations between the elevated tropospheric O3 and surface O3 at high-altitude monitors at Lassen Volcanic and Yosemite National Parks, and Truckee, CA, are marked and long lasting. The temporal correlations likely result from a combination of transport of baseline O3 and covarying meteorological parameters. Days corresponding to the high O3 clusters exhibit hourly surface O3 anomalies of +5-10 ppbv compared to a climatology; the positive anomalies can last up to 3 days after the ozonesonde profile. The profile and surface O3 links demonstrate the importance of regular ozonesonde profiling at Trinidad Head.

STE↗

DOE OSTI2025

Predicting Cislunar Orbit Lifetimes from Initial Orbital Elements

The volume of space between Earth’s geosynchronous orbit out to the Moon’s sphere of influence, including the lunar Lagrange points, is crucial for the successful planning and execution of space missions, but not fully understood dynamically. This region is a part of cislunar space. Trajectories through cislunar space are influenced by the gravitational forces of the Sun, Earth, Moon, and other Solar System planets leading to typically unpredictable and chaotic trajectory behavior. It is therefore difficult to predict the stability of an trajectory through cislunar space from a set of initial conditions or orbital elements. We simulate one million cislunar orbits to train a self-organizing map (SOM) to cluster the trajectories and orbits into families based on how long they remain stable within the cislunar space. Using the trained SOM, we are able to predict the stable lifetime of a trajectory through cislunar space from a set of initial orbital elements to within an accuracy of 10% for 8% of simulated trajectories and within 50% for 43% of the simulated trajectories. Clustering in the SOM suggests that a variety of trajectory morphologies have similar lifetimes. Once trained, the SOM can predict the stable lifetime of a given cislunar trajectory within milliseconds. The methods developed in this work enable the rapid identification of stable cislunar orbits and trajectories that could be used for future space exploration. Moreover, the developed SOM method can generate orbital and trajectory lifetime estimates from minimal observational data, such as a single two line element, making it useful for early warning systems and large-scale sensor network operations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Linking Synoptic Patterns to Cloud Properties and Local Circulations Over Southeastern Texas

This report classifies meteorological regimes in the southeastern Texas region to identify environmental conditions that favor sea-breeze induced convection. The classification is accomplished using a Self-Organizing Map (SOM) approach. We applied SOM to 10 years of 700-hPa geopotential height anomalies during the summer months from reanalysis data to distinguish three dominant synoptic regimes, with a continuum of transitional states between those. The primary regimes include: (a) a pre-trough regime associated with a synoptic trough, (b) a post-trough regime with upper-level northerly flow, and (c) an anticyclonic regime within the westward extent of the Bermuda High. We project the data from the Geostationary Operational Environmental Satellite and the Next Generation Weather Radar system onto each SOM node to investigate the characteristics of cloud and precipitation properties in different regimes. When southeastern Texas is positioned to the southwest quadrant of a maritime high pressure system, an increased cloud frequency is observed over the region during the afternoon hours due to significant moisture advection. A confluence of synoptic southerly flow and sea-breeze circulation commonly occurs in this regime. When a high pressure system is over southeastern Texas, the area is dominated by large-scale subsidence with weak pressure gradients and moderate precipitable water vapor. This weak synoptic forcing is favorable for the formation of a sea-breeze circulation. This is confirmed by an enhanced onshore flow and a decreased temperature at the surface in the early afternoon, as well as a sharp increase in radar echo top height.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1990

Distributed memory approaches for robotic neural controllers

The suitability is explored of two varieties of distributed memory neutral networks as trainable controllers for a simulated robotics task. The task requires that two cameras observe an arbitrary target point in space. Coordinates of the target on the camera image planes are passed to a neural controller which must learn to solve the inverse kinematics of a manipulator with one revolute and two prismatic joints. Two new network designs are evaluated. The first, radial basis sparse distributed memory (RBSDM), approximates functional mappings as sums of multivariate gaussians centered around previously learned patterns. The second network types involved variations of Adaptive Vector Quantizers or Self Organizing Maps. In these networks, random N dimensional points are given local connectivities. They are then exposed to training patterns and readjust their locations based on a nearest neighbor rule. Both approaches are tested based on their ability to interpolate manipulator joint coordinates for simulated arm movement while simultaneously performing stereo fusion of the camera data. Comparisons are made with classical k-nearest neighbor pattern recognition techniques.

Jorgensen, Charles C.↗

NASA NTRS2012

Can Selforganizing Maps Accurately Predict Photometric Redshifts?

We present an unsupervised machine-learning approach that can be employed for estimating photometric redshifts. The proposed method is based on a vector quantization called the self-organizing-map (SOM) approach. A variety of photometrically derived input values were utilized from the Sloan Digital Sky Survey's main galaxy sample, luminous red galaxy, and quasar samples, along with the PHAT0 data set from the Photo-z Accuracy Testing project. Regression results obtained with this new approach were evaluated in terms of root-mean-square error (RMSE) to estimate the accuracy of the photometric redshift estimates. The results demonstrate competitive RMSE and outlier percentages when compared with several other popular approaches, such as artificial neural networks and Gaussian process regression. SOM RMSE results (using delta(z) = z(sub phot) - z(sub spec)) are 0.023 for the main galaxy sample, 0.027 for the luminous red galaxy sample, 0.418 for quasars, and 0.022 for PHAT0 synthetic data. The results demonstrate that there are nonunique solutions for estimating SOM RMSEs. Further research is needed in order to find more robust estimation techniques using SOMs, but the results herein are a positive indication of their capabilities when compared with other well-known methods

Way, Michael J.↗

NASA NTRS2004

Comparing morphologies of drainage basins on Mars and Earth using integral-geometry and neural maps

We compare morphologies of drainage basins on Mars and Earth in order to confine the formation process of Martian valley networks. Basins on both planets are computationally extracted from digital topography. Integral-geometry methods are used to represent each basin by a circularity function that encapsulates its internal structure. The shape of such a function is an indicator of the style of fluvial erosion. We use the self-organizing map technique to construct a similarity graph for all basins. The graph reveals systematic differences between morphologies of basins on the two planets. This dichotomy indicates that terrestrial and Martian surfaces were eroded differently. We argue that morphologies of Martian basins are incompatible with runoff from sustained, homogeneous rainfall. Fluvial environments compatible with observed morphologies are discussed. We also construct a similarity graph based on the comparison of basins hypsometric curves to demonstrate that hypsometry is incapable of discriminating between terrestrial and Martian basins. INDEX TERMS: 1824 Hydrology: Geomorphology (1625); 1886 Hydrology: Weathering (1625); 5415 Planetology: Solid Surface Planets: Erosion and weathering; 6225 Planetology: Solar System Objects Mars. Citation: Stepinski, T. F., and S. Coradetti (2004), Comparing morphologies of drainage basins on Mars and Earth using integral-ge

Stepinski, T. F.↗

DOE OSTI2021

Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies

ABSTRACT Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey (DES) is an essential component to mapping the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the DES Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: self-organizing map p(z) (sompz), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SRs), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of σ〈z〉 ∼ 0.01 on the mean redshift in each tomographic bin.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Local-thermal-gradient and large-scale-circulation impacts on turbine-height wind speed forecasting over the Columbia River Basin

Abstract. We investigate the sensitivity of turbine-height wind speed forecast to initial condition (IC) uncertainties over the Columbia River Gorge (CRG) and Columbia River Basin (CRB) for two typical weather phenomena, i.e., local-thermal-gradient-induced marine air intrusion and a cold frontal passage. Four types of turbine-height wind forecast anomalies and their associated IC uncertainties related to local thermal gradients and large-scale circulations are identified using the self-organizing map (SOM) technique. The four SOM types are categorized into two patterns, each accounting for half of the ensemble members. The first pattern corresponds to IC uncertainties that alter the wind forecast through a modulating weather system, which produces the strongest wind anomalies in the CRG and CRB. In the second pattern, the moderate uncertainties in local thermal gradient and large-scale circulation jointly contribute to wind forecast anomaly. We analyze the cross section of wind and temperature anomalies through the gorge to explore the evolution of vertical features of each SOM type. The turbine-height wind anomalies induced by large-scale IC uncertainties are more concentrated near the front. In contrast, turbine-height wind anomalies induced by the local IC thermal uncertainties are found above the surface thermal anomalies. Moreover, the wind forecast accuracy in the CRG and CRB is limited by IC uncertainties in a few specific regions, e.g., the 2 m temperature within the basin and large-scale circulation over the northeast Pacific around 140∘ W.

17 WIND ENERGY↗

DOE OSTI2025

Predictive links between microbial communities and biological oxygen utilization in the Arctic Ocean

Microbial metabolism influences rates of net community production (NCP), exerting a direct biological control on marine oxygen and carbon fluxes. In the Arctic, it is increasingly important to understand and quantify this process, as ecological and oceanographic conditions shift due to changing climate. Here, we describe potential ecological links between pelagic microbial diversity and an NCP precursor, biological oxygen utilization, using machine learning and paired observations of community structure and metabolic activity from a seasonally and spatially variable transect of the Arctic Ocean (2019–2020 MOSAiC Expedition). Community structure was determined using 16S (prokaryotic) and 18S (eukaryotic) rRNA gene amplicon sequencing, and metabolic activity was derived from ΔO 2 /Ar. Using self-organizing maps, we identified clear successional patterns in observed microbial community structure that were seasonally driven in the upper ocean and vertically stratified with depth. Metabolic activity was also stratified, with a primarily net heterotrophic water column (median −1.5% biological oxygen saturation), excepting periodic oxygen supersaturation (maximum: 13.6%) within the mixed layer. Using DNA sequences as predictor variables, we then constructed a random forest regression model that reliably reconstructed biological oxygen concentrations (root mean squared error = 4.14 μmol kg −1 ). Top predictors from this model were from heterotrophic (bacteria) or potentially mixotrophic (dinoflagellate) taxa. These analyses highlight biologically driven diagnostic tools that can be used to expand biogeochemical datasets and improve the microbial perspectives and metabolisms represented in ecological models of net productivity and carbon flux in a changing Arctic Ocean.

Chamberlain, Emelia J. [Univ. of San Diego, San Di↗

DOE OSTI2023

Uncertain role of clouds in shaping summertime atmosphere-sea ice connections in reanalyses and CMIP6 models

Downwelling longwave radiation (DLR) driven by the atmospheric and cloud conditions in the troposphere is suggested to be a dominant factor to determine the summertime net surface energy budget over the Arctic Ocean and thus plays a key role to shape the September sea ice. We use reanalyses and the self-organizing map (SOM) method to distinguish CMIP6 model performance in replicating the observed strong atmosphere-DLR connection. We find all models can reasonably simulate the linkage between key atmosphere variables and the clear sky DLR but behave differently in replicating the atmosphere-DLR connection due to cloud forcing. In ERA5 and strongly coupled models, tropospheric high pressure is associated with decreased clouds in the mid- and high-levels and increased clouds near the surface. This out-of-phase structure indicates that DLR cloud forcing is nearly neutral, making the clear sky DLR more important to bridge JJA circulation to late-summer sea ice. In MERRA-2 and weakly coupled models, tropospheric clouds display a vertically homogeneous reduction; the cloud DLR is thus strongly reduced due to the cooling effect, which partially cancels out the clear sky DLR and makes the total DLR less efficient to translate circulation forcing to sea ice. The differences of cloud vertical distribution in CMIP6 appear to be differentiated by circulation related relative humidity. Therefore, a better understanding of the discrepancy of different reanalyses and remote sensing products is critical to comprehensively evaluate simulated interactions among circulation, clouds, sea ice and energy budget at the surface in summer.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Projections of winter polynyas and their biophysical impacts in the Ross Sea Antarctica

Abstract This study investigates winter polynyas in the southern Ross Sea, Antarctica where several polynyas are known to form. Coastal polynyas are areas of lower sea ice concentration and/or thickness along the coast that are otherwise surrounded by more extensive, thicker sea ice pack. Polynyas are also locations where organisms can exploit both the ice substrate and pelagic resources. Using a self organizing map algorithm, we identify polynya events in the Community Earth System Model Version 2 Large Ensemble (CESM2-LE). The neural network algorithm is able to identify polynya events without imposing an ice concentration or thickness threshold, as is often done when identifying polynyas. The CESM2-LE produces a wintertime polynya feature comparable in size and location to the Ross Sea polynya, and during polynya events there are large turbulent heat fluxes and export of sea ice from the Ross Sea. In the CESM2-LE polynya event frequency is projected to decrease sharply in the later twentyfirst century, leading to increasing sea ice concentrations and thicknesses in the region. The drivers of the polynya frequency decline are likely both large scale circulation changes and local atmosphere and ocean feedbacks. If declines in wintertime polynya frequency over the twentyfirst century do occur they may impact Antarctic Bottom Water formation and local net primary productivity. Thus, better understanding potential local and unexpected sea ice changes in the Ross Sea is important for both assessing climate system impacts and ecological impacts on the Ross Sea ecosystem, which is currently protected by an internationally recognized marine protected area.

Meteorology & Atmospheric Sciences↗

DOE OSTI2021

Corrosion of rebar in concrete. Part III: Artificial Neural Network analysis of chloride threshold data

Active corrosion of carbon steel in reinforced concrete occurs when the chloride ion concentration exceeds the chloride threshold (CT). CT is affected by many physical and chemical parameters including primary variables (pH, corrosion potential, breakdown potential, and temperature) and secondary variables (cemenet composition, concreete porosity, and water/cement ratio). A Kohonen-self organized map (KSOM) and regression artificial neural network (ANN) coupled methodology was developed to find the missing values of independent variables in the sparse database and for quantitatively evaluating the effects of these variables on CT values that are expressed in %TotalCl/cem (or %FreeCl/cem), and [Cl - ]/[OH - ].

36 MATERIALS SCIENCE↗

DOE OSTI2024

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗

DOE OSTI2022

Discovery of peculiar radio morphologies with ASKAP using unsupervised machine learning

Abstract We present a set of peculiar radio sources detected using an unsupervised machine learning method. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope to train a self-organizing map (SOM). The radio maps from three ASKAP surveys, Evolutionary Map of Universe pilot survey (EMU-PS), Deep Investigation of Neutral Gas Origins pilot survey (DINGO), and Survey With ASKAP of GAMA-09 + X-ray (SWAG-X), are used to search for the rarest or unknown radio morphologies. We use an extension of the SOM algorithm that implements rotation and flipping invariance on astronomical sources. The SOM is trained using the images of all ‘complex’ radio sources in the EMU-PS which we define as all sources catalogued as ‘multi-component’. The trained SOM is then used to estimate a similarity score for complex sources in all surveys. We select 0.5% of the sources that are most complex according to the similarity metric and visually examine them to find the rarest radio morphologies. Among these, we find two new odd radio circle (ORC) candidates and five other peculiar morphologies. We discuss multiwavelength properties and the optical/infrared counterparts of selected peculiar sources. In addition, we present examples of conventional radio morphologies including: diffuse emission from galaxy clusters, and resolved, bent-tailed, and FR-I and FR-II type radio galaxies. We discuss the overdense environment that may be the reason behind the circular shape of ORC candidates.

Astronomy & Astrophysics↗

DOE OSTI2021

Meteorological environments associated with California wildfires and their potential roles in wildfire changes during 1984-2017

California has been seeing more wildfires in recent years, resulting in huge economic losses and threatening human health. Clarifying the meteorological environments of wildfires is foundational to improving the understanding and prediction of wildfires and their impacts. Here, 1535 California wildfires during 1984-2017 are systematically investigated. Based on two key meteorological factors - temperature and moisture anomalies - all wildfires are classified into four groups: hot-dry, hot-wet, cold-dry, cold-wet. Most (~60%) wildfires occurred on hot-dry days. Compositing the large-scale environments of the four groups shows that persistent high pressure and strong northeasterly wind descending from inland favor hot-dry conditions for wildfires. This analysis also reveals an important role of anomalies in southerly onshore flow that supports stronger convection, accompanied by more lightning flashes that provide a triggering mechanism for wildfires under hot-wet conditions. Self-organizing map analysis lends confidence in the large-scale meteorological pattern for dominating hot-dry wildfires in California. Besides wildfire occurrence, wildfire size is also influenced by meteorological anomalies through their magnitudes. Among them, moisture anomaly explains the largest fraction (~69%) of variability in wildfire sizes. Large-scale meteorological anomalies are found to play an important role in the devastating 2018 wildfire season in California. During 1984-2017, wildfire burned area has significantly increased by ~3.6% per year, indicating a doubling of burned area in 2017 relative to 1984, with the trend dominated by hot-dry wildfires in summer. Drying and warming in conjunction with strengthening of the high pressure in summer support more frequent and larger wildfires in California.

58 GEOSCIENCES↗

DOE OSTI2021

Attention Network Forecasts Time-to-Failure in Laboratory Shear Experiments

Rocks under stress deform by creep mechanisms that include formation and slip on small-scale internal cracks. Intragranular cracks and slip along grain contacts release energy as elastic waves termed acoustic emissions (AE). AEs are thought to contain predictive information that can be used for fault failure forecasting. Here, we present a method using unsupervised classification and an attention network to forecast labquakes using AE waveform features. Our data were generated in a laboratory setting using a biaxial shearing device with granular fault gouge intended to mimic the conditions of tectonic faults. Here, we analyzed the temporal evolution of AEs generated throughout several hundred laboratory earthquake cycles. We used a Conscience Self-Organizing Map (CSOM) to perform topologically ordered vector quantization based on waveform properties. The resulting map was used to interactively cluster AEs. We examined the clusters over time to identify those with predictive ability. Finally, we used a variety of LSTM and attention-based networks to test the predictive power of the AE clusters. By tracking cumulative waveform features over the seismic cycle, the network is able to forecast the time-to-failure (TTF) of lab earthquakes. Our results show that analyzing the data to isolate predictive signals and using a more sophisticated network architecture are key to robustly forecasting labquakes. In the future, this method could be applied on tectonic faults to monitor earthquakes and augment early warning systems.

58 GEOSCIENCES↗