SEARCH · Engineering Papers

Results for “Self Organizing Map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Synoptic Weather Regime Classifications for December, January and February, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

{node_som_ml,synop_wea_reg}↗

DOE OSTI2025

Synoptic Weather Regime Classifications for September, October and November, from 2000 to 2025

node_som_ml↗

DOE OSTI2021

Visual HPC Workflows for the Analysis of System Dynamics Models

Visual analytics supported by high performance computing (HPC) accelerates and enhances the discovery, exploration, and analysis of causal patterns in complex system dynamics (SD) models. We present a suite of visualization-assisted ensemble-based techniques for hypothesis generation and testing, and for sensitivity analysis. By employing HPC to provide parallel, on-demand simulation of SD models, one can “steer” an ensemble of simulated scenarios in real time as one first formulates and then informally tests those hypotheses: this provides rapid feedback for analysts to refine their understanding of the causal relationships emergent from a model. Such understandings can be followed and augmented by rigorous application of statistical methods, namely global variance-based sensitivity analysis, Monte-Carlo filtering, adaptive regional sensitivity analysis, and self-organized maps: here timely computation relies on HPC, while effective presentation emphasizes high-dimensional multivariate data visualization. Immersive visualization in virtual 3D environments provides an excellent adjunct to the traditional 2D graphics typically used for SD models, as it generates an embodied understanding of model behavior and facilitates an active, collaborative critique of model structure and output. Finally, we summarize prospects for HPC-enabled visual analytics applied to SD modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Dark Energy Survey Year 6 Results: Redshift Calibration of the MagLim++ Lens Sample

In this work, we derive and calibrate the redshift distribution of the MagLim++ lens galaxy sample used in the Dark Energy Survey Year 6 (DES Y6) 3x2pt cosmology analysis. The 3x2pt analysis combines galaxy clustering from the lens galaxy sample and weak gravitational lensing. The redshift distributions are inferred using the SOMPZ method - a Self-Organizing Map framework that combines deep-field multi-band photometry, wide-field data, and a synthetic source injection (Balrog) catalog. Key improvements over the DES Year 3 (Y3) calibration include a noise-weighted SOM metric, an expanded Balrog catalogue, and an improved scheme for propagating systematic uncertainties, which allows us to generate O($10^8$) redshift realizations that collectively span the dominant sources of uncertainty. These realizations are then combined with independent clustering-redshift measurements via importance sampling. The resulting calibration achieves typical uncertainties on the mean redshift of 1-2%, corresponding to a 20-30% average reduction relative to DES Y3. We compress the $n(z)$ uncertainties into a small number of orthogonal modes for use in cosmological inference. Marginalizing over these modes leads to only a minor degradation in cosmological constraints. This analysis establishes the MagLim++ sample as a robust lens sample for precision cosmology with DES Y6 and provides a scalable framework for future surveys.

Giannini, G. [Chicago U., Astron. Astrophys. Ctr.;↗

DOE OSTI2025

Dark Energy Survey Year 6 Results: Redshift Calibration of the Weak Lensing Source Galaxies

Determining the distribution of redshifts for galaxies in wide-field photometric surveys is essential for robust cosmological studies of weak gravitational lensing. We present the methodology, calibrated redshift distributions, and uncertainties of the final Dark Energy Survey Year 6 (Y6) weak lensing galaxy data, divided into four redshift bins centered at $\langle z \rangle = [0.414, 0.538, 0.846, 1.157]$. We combine independent information from two methods on the full shape of redshift distributions: optical and near-infrared photometry within an improved Self-Organizing Map $p(z)$ (SOMPZ) framework, and cross-correlations with spectroscopic galaxy clustering measurements (WZ), which we demonstrate to be consistent both in terms of the redshift calibration itself and in terms of resulting cosmological constraints within 0.1$σ$. We describe the process used to produce an ensemble of redshift distributions that account for several known sources of uncertainty. Among these, imperfection in the calibration sample due to the lack of faint, representative spectra is the dominant factor. The final uncertainty on mean redshift in each bin is $σ_{\langle z\rangle} = [0.012, 0.008,0.009, 0.024]$. We ensure the robustness of the redshift distributions by leveraging new image simulations and a cross-check with galaxy shape information via the shear ratio (SR) method.

Yin, B. [Duke U.] (ORCID:0009000656049980)↗

DOE OSTI2025

The Power of DESI for Photometric Redshift Calibration: A Case Study with KiDS-1000

Accurate redshift estimates are a critical requirement for weak lensing surveys and one of the main uncertainties in constraints on dark energy and large-scale cosmic structure. In this paper, we study the potential to calibrate photometric redshift (photo-z) distributions for gravitational lensing using the Dark Energy Spectroscopic Instrument (DESI). Since beginning its science operations in 2021, DESI has collected more than 50 million redshifts, adding about one million monthly. In addition to its large-scale structure samples, DESI has also acquired over 256k high-quality spectroscopic redshifts (spec-zs) in the COSMOS and XMM and VVDS fields. This is already a factor of 3 larger than previous spec-z calibration compilations in these two regions. Here, we explore calibrating photo-zs for the subset of KiDS-1000 galaxies that fall into joint self-organizing map (SOM) cells overlapping the DESI COSMOS footprint using the DESI COSMOS observations. Estimating the redshift distribution in KiDS-1000 with the new DESI data, we find broad consistency with previously published results while also detecting differences in the mean redshift in some tomographic bins with an average shifts of Delta Mean(z) = -0.028 in the mean and Delta Median(z) = +0.011 in the median across tomographic bins. However, we also find that incompleteness per SOM cell, i.e., groups of galaxies with similar colors and magnitudes, can modify n(z) distributions. Finally, we comment on the fact that larger photometric catalogs, aligned with the DESI COSMOS and DESI XMM and VVDS footprints, would be needed to fully exploit the DESI dataset and would extend the coverage to nearly eight times the area of existing 9-band photometry.

Blanco, Diana [UC, Santa Cruz; UC, Santa Cruz, Ins↗

DOE OSTI2023

A Novel Resilience-Oriented Cellular Grid Formation Approach for Distribution Systems with Behind-the-Meter Distributed Energy Resources

This paper presents a resilience-oriented cellular grid formation approach to achieve scalable and reconfigurable community microgrid operations for distribution systems with behind-the-meter distributed energy resources. A set of interconnected solar photovoltaics, energy storage systems, and load is termed as a cell, implying a subset of the grid that can operate independently using its own resources. Cells are identified such that each cell inherently has sufficient energy resources to black start and can provide a certain level of backup power for its load under the loss of utility power supply. The proposed cell formation approach builds on a unique self-organizing map-based method (SomRes) to quantify a system's resilience. Using SomRes and a non-dominated sorting-based genetic algorithm (NSGA-II), a fast and efficient cell formation algorithm is developed to identify cells in a distribution system that are resilient against extreme events. The efficacy of the proposed approach is demonstrated on a numerical model of a real distribution feeder in Colorado, United States.

distributed energy resource↗

DOE OSTI2023

Land surface dynamics and meteorological forcings modulate land surface temperature characteristics

This study examines the effect of land cover, vegetation health, climatic forcings, elevation heat loads, and terrain characteristics (LVCET) on land surface temperature (LST) distribution over West Africa (WA). We employ fourteen machine-learning models, which preserve nonlinear relationships, to downscale LST and other predictands while preserving the geographical variability of WA. Our results showed that the random forest model performs best in downscaling predictands. This is important for the sub-region since it has limited access to mainframes to power multiplex machine-learning algorithms. In contrast to the northern regions, the southern regions consistently exhibit healthy vegetation. Also, areas with unhealthy vegetation coincide with hot LST clusters. The positive Normalized Difference Vegetation Index (NDVI) trends in the Sahel underscore rainfall recovery and subsequent Sahelian greening. The southwesterly winds cause the upwelling of cold waters, lowering LST in southern WA and highlighting the cooling influence of water bodies on LST. Identifying regions with elevated LST is paramount for prioritizing greening initiatives, and our study underscores the importance of considering LVCET factors in urban planning. Topographic slope-facing angles, heat loads, and diurnal anisotropic heat all contribute to variations in LST, emphasizing the need for a holistic approach when designing resilient and sustainable landscapes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

A Unified Photometric Redshift Calibration for Weak Lensing Surveys Using the Dark Energy Spectroscopic Instrument

The effective redshift distribution n(z) of galaxies is a critical component in the study of weak gravitational lensing. Here, we introduce a new method for determining n(z) for weak lensing surveys based on high-quality redshifts and neural-network-based importance weights. Additionally, we present the first unified photometric redshift calibration of the three leading stage-III weak lensing surveys, the Dark Energy Survey (DES), the Hyper Suprime-Cam (HSC) survey, and the Kilo-Degree Survey (KiDS), with state-of-the-art spectroscopic data from the Dark Energy Spectroscopic Instrument (DESI). We verify our method using a new, data-driven approach and obtain n(z) constraints with statistical uncertainties of the order of $σ_z$ ~ 0.01 and smaller. Our analysis is largely independent of previous photometric redshift calibrations and, thus, provides an important cross-check in light of recent cosmological tensions. Overall, we find excellent agreement with previously published results on the DES Y3 and HSC Y1 data sets, while there are some differences on the mean redshift with respect to the previously published KiDS-1000 results. We attribute the latter to mismatches in photometric noise properties in the COSMOS field compared to the wider KiDS self-organizing map-gold catalog. At the same time, the new n(z) estimates for KiDS do not significantly change estimates of cosmic structure growth from cosmic shear. Finally, we discuss how our method can be applied to future weak lensing calibrations with DESI data.

Lange, J. U. [American Univ., Washington, DC (Unit↗

DOE OSTI2024

Critical Minerals and Materials Matchmaker-CM3

This is the Critical Minerals and Materials Matchmaker (CM3) survey form. CM3 is an online information resource created to help connect users across the critical minerals and materials supply chain. The survey is designed to allow organizations to self-identify their critical minerals and materials-aligned activities and interests, and an interactive map that displays those on-going activities in a dynamic way. To include your critical minerals management activity or activities in CM3, please open and fill out the Critical Minerals and Materials Survey. If your organization has many ongoing or planned activities that would be onerous to enter in the form, or if your activities are difficult to geolocate (such as a transport network), please email the team at edxspatial@netl.doe.gov. This initiative is aligned with the approach of DOE’s H2 Matchmaker and Carbon Matchmaker. Read more information on H2 Matchmaker and Carbon Matchmaker. Below are some questions to help understand if you should fill out the CM3 survey: Does your company work with elements such as lithium, cobalt, copper, graphite, nickel, rare earth minerals, or platinum group metals? Does your organization have research and development activities related to critical materials or their supply chains? Does your company currently work in the critical minerals or materials supply chain? Do you have prospective work in critical minerals or materials in the next 5 years? Does your company mine, process, refine or distribute critical minerals or materials? Do you want to network with other facilities or organizations working in the same areas? Are you curious about the critical mineral and material activity in your surrounding area? Are you interested in aligning your potential needs across the supply chain to different geographic areas within the U.S? For more information, please see the CM3 website (https://www.energy.gov/fecm/articles/critical-minerals-materials-matchmaker-cm3) or email our team at edxspatial@netl.doe.gov.

CM3↗

DOE OSTI2023

Extensive 3D mapping of dislocation structures in bulk aluminum

Abstract Thermomechanical processing such as annealing is one of the main methods to tailor the mechanical properties of materials, however, much is unknown about the reorganization of dislocation structures deep inside macroscopic crystals that give rise to those changes. Here, we demonstrate the self-organization of dislocation structures upon high-temperature annealing in a mm-sized single crystal of aluminum. We map a large embedded 3D volume ( $$100\times 300\times 300$$ 100 × 300 × 300 $$\upmu$$ μ m $$^3$$ 3 ) of dislocation structures using dark field X-ray microscopy (DFXM), a diffraction-based imaging technique. Over the wide field of view, DFXM’s high angular resolution allows us to identify subgrains, separated by dislocation boundaries, which we identify and characterize down to the single-dislocation level using computer-vision methods. We demonstrate how even after long annealing times at high temperatures, the remaining low density of dislocations still pack into well-defined, straight dislocation boundaries (DBs) that lie on specific crystallographic planes. In contrast to conventional grain growth models, our results show that the dihedral angles at the triple junctions are not the predicted 120 $$^{\circ }$$ ∘ , suggesting additional complexities in the boundary stabilization mechanisms. Mapping the local misorientation and lattice strain around these boundaries shows that the observed strain is shear, imparting an average misorientation around the DB of $$\approx$$ ≈ 0.003 to 0.006 $$^{\circ }$$ ∘ .

36 MATERIALS SCIENCE↗

DOE OSTI2020

Tailorable Micelle Morphology in Self-Assembling Block Copolymer Gels for Templating Nanoporous Ceramics

The self-assembly of block copolymers offers opportunities for the facile organization and templating of inorganic nanomaterials. Here, we describe a morphology map for a poly(methyl methacrylate)-b-poly(n-butyl acrylate)-b-poly(methyl methacrylate) (PMMA-b-PnBA-b-PMMA) block copolymer/polycarbosilane system that allows for tunable control over nanoscale micelle geometry via manipulation of the preceramic polymer content. We produced gels with spherical, wormlike, and bicontinuous morphologies, which were processed to create silicon carbide-based ceramic structures with tunable nanoscale porosities. The role of the constituent polymers in influencing the structure and rheology of this system is discussed. The PMMA-b-PnBA-b-PMMA block copolymer/preceramic polymer system offers a number of advantages including: (i) commercial availability, (ii) rapid self-assembly kinetics, and (iii) successful conversion of the self-assembled nanostructure to ceramic via pyrolysis. Finally, this system may be useful for catalytic, structural, or thermal applications in both industrial and academic settings because of its ease of use and relatively inexpensive reagents.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Emergent topological polarization textures in relaxor ferroelectrics

Relaxor ferroelectrics underpin high-performance actuators and sensors, yet the nature of polar heterogeneities driving their broadband dielectric response remains debated. Using a unified, multimodal structural refinement framework— simultaneously fitting complementary X-ray and neutron total scattering, X-ray absorption spectra, and diffuse scattering—we reconstruct 3D mesoscale polarization maps in the classic relaxor system PbMg 1/3 Nb 2/3 O 3 –PbTiO 3 . We uncover self-organized swirling polarization textures with half-skyrmion (meron) vortices, challenging models of independent polar nanoregions. These textures, characterized by smooth changes in the polarization direction, originate from overlapping volumes in which the projections of locally correlated polarization vectors onto each volume’s long axis share the same sign. Vortex cores correlate strongly with local charge and strain gradients imposed by compositional heterogeneities. In this work, our results suggest that chemical disorder, acting via depolarizing and strain fields, stabilizes topological vortex textures of the polarization field, offering a route for engineering new dielectric and ferroelectric functionalities.

Eremenko, Maksim [National Institute of Standards ↗

DOE OSTI2026

Dense autoencoders, clustering techniques, and semi-supervised learning for HPGe $γ$-spectra

Classifying high-resolution gamma spectra by their isotopic content is an essential task in nuclear forensics and other applications. Traditional analysis methods are often time-intensive, but machine learning (ML) may help analysts quickly process many spectra. Such methods tend to rely on abundant, well-labeled data for training. Historical gamma data exists in various fields but is not uniformly useful for supervised ML due to inconsistent labeling. Here, to address some of these challenges, we present a method to classify and organize unlabeled data from high-purity germanium detectors using an autoencoding neural network (autoencoder). We trained dense autoencoders to compress gamma data into latent representations that enable efficient data characterization. By clustering the encoded spectra or lower-dimensional mappings of them, we identified and removed portions of over-abundant data categories, resulting in a more balanced dataset and improved autoencoder performance. This encoding and clustering pipeline also enabled the organization of spectra into self-consistent categories. Finally, we found that encoded representations showed potential as inputs for semi-supervised learning of nuclide identification (NID) labels, achieving an average F1 score of 0.85 ± 0.03 when mapping encodings to a set of 65 isotope labels.

Autoencoders↗

DOE OSTI2022

Software Architecture and Hardware Organization in Mu2e Solenoid Field Mapping System

Herein, the Mu2e field mapping system is designed to produce high accuracy field maps of the detector solenoid used in the experiment. The data acquisition system is mobile and uses a self-propelled mapper with rotating arms equipped with 3D Hall probes. The measurements require not only accurate magnetic field readouts, but also accurate locations of all Hall probes while measuring data. The latter is accomplished by using the laser tracker to measure positions of several retroreflectors on the field mapper during data acquisition. The measurement process requires scanning the whole space inside the large solenoid and takes many hours to complete, which necessitates its full automation. The automation software includes control of the mapper, readout of Hall and NMR probes and control of a laser tracker, including prediction of retroreflector positions and execution of quality control checks. The software architecture and data acquisition hardware of the field mapping system are described, with special attention given to control of the laser tracker and its integration with the rest of the system.

3d hall probes↗

DOE OSTI2021

Charge order textures induced by non-linear couplings in a half-doped manganite

Abstract The self-organization of strongly interacting electrons into superlattice structures underlies the properties of many quantum materials. How these electrons arrange within the superlattice dictates what symmetries are broken and what ground states are stabilized. Here we show that cryogenic scanning transmission electron microscopy (cryo-STEM) enables direct mapping of local symmetries and order at the intra-unit-cell level in the model charge-ordered system Nd 1/2 Sr 1/2 MnO 3 . In addition to imaging the prototypical site-centered charge order, we discover the nanoscale coexistence of an exotic intermediate state which mixes site and bond order and breaks inversion symmetry. We further show that nonlinear coupling of distinct lattice modes controls the selection between competing ground states. The results demonstrate the importance of lattice coupling for understanding and manipulating the character of electronic self-organization and that cryo-STEM can reveal local order in strongly correlated systems at the atomic scale.

42 ENGINEERING↗

DOE OSTI2023

Self-organization of photoionized plasmas via kinetic instabilities

Abstract Self-organization in an unmagnetized collisionless plasma (in this paper) refers to formation of transient coherent structures such as collective oscillations (electrostatic waves) or magnetic fields resulting from so-called kinetic effects in the plasma. This topical review provides a comprehensive analysis of the self-organization of strong-field photoionized, non-equilibrium plasmas through kinetic instabilities. The authors propose and demonstrate a novel experimental platform that enables the formation of dense plasmas with known highly anisotropic and non-thermal electron velocity distribution functions on a timescale on the order of an inverse electron plasma frequency. We then show that such plasmas are highly susceptible to a hierarchy of kinetic instabilities, including two-stream, current filamentation and Weibel, that convert a fraction of the electron kinetic energy into electric and/or magnetic energy stored in self-organized structures. The electrostatic waves so produced are measured using a collective light (Thomson) scattering technique with femtosecond resolution as the kinetic instabilities aided by collisions eventually thermalize the plasma electrons. In addition, we describe a novel experimental technique that has made it possible to map the temporal evolution of the wavenumber spectrum of the thermal Weibel instability with picosecond resolution, which leads to the formation of quasi-static coherent magnetic fields with different topologies in photoionized plasmas. Finally, the paper summarizes the important results and discusses future directions on this topic.

Zhang, Chaojie (ORCID:0000000180353014)↗

DOE OSTI2024

Self-Organized Stress Distributions in Polycrystalline Materials [Dissertation]

Understanding stress distributions in solid materials is complicated by the fact that most materials are polycrystalline in nature, with each crystal having an elastically anisotropic reaction to force. This study is to gain a better understanding on how external forces placed on a polycrystal are related to internal reactions within and between the grains. The hypothesis is that the stress distribution in porous to fully dense materials are self-organized based on strong contacts between and within the individual grains created by force chains. Force chains, commonly known in loaded granular materials, and could be the phenomenon that connect micro to macro deformation. Scale bridging measurements conducted through Raman spectroscopy, Atomic Force Microscopy, and Digital Image Correlation will be used to create stress maps, modulus maps, and elastic strain maps across a variety of geological and pharmaceutical polycrystals. When possible, the resulting maps will be compared to current homogenization schemes and a full field models. Finite element modeling will be used to assess whether the patterning seen in the experimental map is a reasonable approximation based on the orientation data of the samples used. A minimum of three publications is projected to be accomplished focusing each on a different method to experimentally test and analyze stress distributions.

36 MATERIALS SCIENCE↗