Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Statistical relationships across epigenomes using large-scale hierarchical clustering

Recent advances in genomics and sequencing platforms have revolutionized our ability to create immense data sets, particularly for studying epigenetic regulation of gene expression. However, the avalanche of epigenomic data is difficult to parse for biological interpretation given nonlinear complex patterns and relationships. This attractive challenge in epigenomic data lends itself to machine learning for discerning infectivity and susceptibility. In this study, we explore over 3000 epigenomes of uninfected individuals and provide a framework to characterize the relationships among epigenetic modifiers, their modifiers, genetic loci, and specific immune cell types across all chromosomes using hierarchical clustering. Hierarchical clustering of epigenomic data revealed consistent epigenetic patterns across chromosomes, demonstrating that variation due to epigenetic modifiers is greater than variation between cell types. Gene Ontology and KEGG pathway analyses indicated significant enrichment of genes involved in chromatin remodeling, mRNA splicing, immune responses, and the regulation of microRNAs and snoRNAs. Epigenetic modifiers frequently formed biologically relevant clusters, including the cohesin complex, RNA Polymerase II transcription factors, and PRC2 complex members. These clustering behaviors remained consistent across all chromosomes, supported by entropy analysis and high Adjusted Rand Index scores, indicating robust cross-chromosomal similarity. Co-occurrence analysis further revealed specific sets of modifiers that consistently appeared together within clusters, reflecting shared biological functions and interactions. Validation using another dataset confirmed the reproducibility of these clustering patterns and modifier co-occurrence relationships, underscoring the reliability and generalizability of the methodology.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Stochastic economic dispatch of wind power under uncertainty using clustering-based extreme scenarios

Operation of power systems with high penetrations of renewable energy sources requires tools for robust decision making under uncertainty. Stochastic economic dispatch and stochastic unit commitment are effective techniques for planning and operation under uncertainty, whose effectiveness depends on the cardinality and quality of the scenario set. Here, this article proposes a machine learning method using -means clustering for capturing relevant physical information from a large population of analog scenarios. Extreme scenario samples drawn from the clusters are used in a two-stage stochastic economic dispatch computation. The effectiveness of the proposed approach is assessed on a synthetic 200-bus system with a geographic footprint over Illinois, USA for four months from each season of WIND Toolkit data. The combination of -means clustering with importance sampling is shown to reduce the total operational cost by over 43% compared to sampling from populations based on heuristic clustering-based methods. Additionally, the variability in the mean cost is about 56% lower than the variability using Monte Carlo sampling. Moreover, the operational cost with the presented approach is shown to be close to the cost calculated based on a hindsight exact wind profile, signifying a highly accurate quantification of wind uncertainty by the presented -means clustering based sampling method.

17 WIND ENERGY↗
DOE OSTI2025

RANGE: A robust adaptive nature-inspired global explorer of potential energy surfaces

With the growing demand for realistic representations of chemical structures and the advent of exascale computing, the intelligent sampling of potential energy surfaces and efficient identification of global minima have become more essential but also more feasible. Building on prior studies demonstrating the efficiency of the Artificial Bee Colony (ABC) swarm intelligence algorithm, we report a hybrid metaheuristic framework that integrates the adaptive exploration capabilities of ABC coupled with the exploitation strengths of genetic algorithms (GA) in a scalable, Python-based implementation. The resulting tool, RANGE (Robust Adaptive Nature-inspired Global Explorer), provides seamless interfaces to multiple potential energy evaluators, either directly or via widely used Python libraries, and is designed for high-performance computing environments. We describe the implementation details of RANGE and evaluate its performance, relative to ABC- or GA-alone based algorithms, on a variety of chemical systems, including molecular clusters and heterogeneous surfaces. In conclusion, our results demonstrate RANGE’s efficiency, robustness, and broad applicability in addressing challenging global optimization problems in computational chemistry and materials science.

Algorithms and data structure↗
DOE OSTI2022

Stringent σ8 constraints from small-scale galaxy clustering using a hybrid MCMC + emulator framework

ABSTRACT We present a novel simulation-based hybrid emulator approach that maximally derives cosmological and Halo Occupation Distribution (HOD) information from non-linear galaxy clustering, with sufficient precision for DESI Year 1 (Y1) analysis. Our hybrid approach first samples the HOD space on a fixed cosmological simulation grid to constrain the high-likelihood region of cosmology + HOD parameter space, and then constructs the emulator within this constrained region. This approach significantly reduces the parameter volume emulated over, thus achieving much smaller emulator errors with fixed number of training points. We demonstrate that this combined with state-of-the-art simulations result in tight emulator errors comparable to expected DESI Y1 LRG sample variance. We leverage the new abacussummit simulations and apply our hybrid approach to CMASS non-linear galaxy clustering data. We infer constraints on σ8 = 0.762 ± 0.024 and fσ8(zeff = 0.52) = 0.444 ± 0.016, the tightest among contemporary galaxy clustering studies. We also demonstrate that our fσ8 constraint is robust against secondary biases and other HOD model choices, a critical first step towards showcasing the robust cosmology information accessible in non-linear scales. We speculate that the additional statistical power of DESI Y1 should tighten the growth rate constraints by at least another 50–60 ${{\ \rm per\ cent}}$, significantly elucidating any potential tension with Planck. We also address the ‘lensing is low’ tension, which we find to be in the same direction as a potential tension in fσ8. We show that the combined effect of a lower fσ8 and environment-based bias accounts for approximately $50{{\ \rm per\ cent}}$ of the discrepancy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Efficient Source of Shaped Single Photons Based on an Integrated Diamond Nanophotonic System

An efficient, scalable source of shaped single photons that can be directly integrated with optical fiber networks and quantum memories is at the heart of many protocols in quantum information science. We demonstrate a deterministic source of arbitrarily temporally shaped single-photon pulses with high efficiency [detection efficiency = 14.9 %] and purity [g (2) (0) = 0.0168] and streams of up to 11 consecutively detected single photons using a silicon-vacancy center in a highly directional fiber-integrated diamond nanophotonic cavity. Finally, combined with previously demonstrated spin-photon entangling gates, this system enables on-demand generation of streams of correlated photons such as cluster states and could be used as a resource for robust transmission and processing of quantum information.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

XRISM Reveals Low Nonthermal Pressure in the Core of the Hot, Relaxed Galaxy Cluster A2029

We present XRISM Resolve observations of the core of the hot, relaxed galaxy cluster Abell 2029 (A2029). We find that the line-of-sight bulk velocity of the intracluster medium (ICM) within the central 180 kpc is at rest with respect to the brightest cluster galaxy, with a 3σ upper limit of ∣vbulk∣ < 100 km s−1. We robustly measure the field-integrated ICM velocity dispersion to be σv = 169 ± 10 km s−1, obtaining similar results for both single-temperature and two-temperature plasma models to account for the cluster cool core. This result, if ascribed to isotropic turbulence, implies a subsonic ICM with Mach number M 3D ≈ 0.22 and a nonthermal pressure fraction of 2.6 ± 0.3%. The turbulent velocity is similar to what was measured in the core of the Perseus cluster by Hitomi, but here in a more massive cluster with an ICM temperature of 7 keV, the limit on the nonthermal pressure fraction is even more stringent. Our result is consistent with expectations from simulations of relaxed clusters, but it is on the low end of the predicted distribution, indicating that A2029 is an exceptionally relaxed cluster with no significant impacts from either a recent minor merger or active galactic nucleus activity.

Audard, Marc (ORCID:000000034721034X)↗
DOE OSTI2022

On the physical size of the Milky Way globular cluster NGC 7089 (M2)

ABSTRACT We study the outer regions of the Milky Way globular cluster NGC 7089 based on new Dark Energy Camera observations. The resulting background-cleaned stellar density profile reveals the existence of an extended envelope. We confirm previous results that cluster stars are found out up to ∼1° from the cluster’s centre, which is nearly three times the value of the most robust tidal radii estimations. We also used results from direct N-body simulations in order to compare with the observations. We found a fairly good agreement between the observed and numerically generated stellar density profiles. Because of the existence of gaps and substructures along globular cluster tidal tails, we closely examined the structure of the outer cluster region beyond the Jacobi radius. We extended the analysis to a sample of 35 globular clusters, 20 of them with observed tidal tails. We found that if the stellar density profile follows a power law ∝ r−α, the α slope correlates with the globular cluster present mass, in the sense that, the more massive the globular cluster, the smaller the α value. This trend is not found in globular clusters without observed tidal tails. The origin of such a phenomenon could be related, among other reasons, to the proposed so-called potential escapers or to the formation of globular clusters within dark matter minihaloes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The Dark Energy Survey Year 3 high-redshift sample: selection, characterization, and analysis of galaxy clustering

ABSTRACT The fiducial cosmological analyses of imaging surveys like DES typically probe the Universe at redshifts z < 1. We present the selection and characterization of high-redshift galaxy samples using DES Year 3 data, and the analysis of their galaxy clustering measurements. In particular, we use galaxies that are fainter than those used in the previous DES Year 3 analyses and a Bayesian redshift scheme to define three tomographic bins with mean redshifts around z ∼ 0.9, 1.2, and 1.5, which extend the redshift coverage of the fiducial DES Year 3 analysis. These samples contain a total of about 9 million galaxies, and their galaxy density is more than 2 times higher than those in the DES Year 3 fiducial case. We characterize the redshift uncertainties of the samples, including the usage of various spectroscopic and high-quality redshift samples, and we develop a machine-learning method to correct for correlations between galaxy density and survey observing conditions. The analysis of galaxy clustering measurements, with a total signal to noise S/N ∼ 70 after scale cuts, yields robust cosmological constraints on a combination of the fraction of matter in the Universe Ωm and the Hubble parameter h, $\Omega _m h = 0.195^{+0.023}_{-0.018}$, and 2–3 per cent measurements of the amplitude of the galaxy clustering signals, probing galaxy bias and the amplitude of matter fluctuations, bσ8. A companion paper (in preparation) will present the cross-correlations of these high-z samples with cosmic microwave background lensing from Planck and South Pole Telescope, and the cosmological analysis of those measurements in combination with the galaxy clustering presented in this work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Dark energy survey year 3 results: cosmology from galaxy clustering and galaxy–galaxy lensing in harmonic space

We present the joint tomographic analysis of galaxy-galaxy lensing and galaxy clustering in harmonic space (HS), using galaxy catalogues from the first three years of observations by the Dark Energy Survey (DES Y3). We utilize the redMaGiC and MagLim catalogues as lens galaxies and the metacalibration catalogue as source galaxies. The measurements of angular power spectra are performed using the pseudo-$C_\ell$ method, and our theoretical modelling follows the fiducial analyses performed by DES Y3 in configuration space, accounting for galaxy bias, intrinsic alignments, magnification bias, shear magnification bias and photometric redshift uncertainties. We explore different approaches for scale cuts based on non-linear galaxy bias and baryonic effects contamination. Our fiducial covariance matrix is computed analytically, accounting for mask geometry in the Gaussian term, and including non-Gaussian contributions and super-sample covariance terms. To validate our HS pipelines and covariance matrix, we used a suite of 1800 log-normal simulations. We also perform a series of stress tests to gauge the robustness of our HS analysis. In the $\Lambda$CDM model, the clustering amplitude $S_8 =\sigma _8(\Omega _m/0.3)^{0.5}$ is constrained to $S_8 = 0.704\pm 0.029$ and $S_8 = 0.753\pm 0.024$ (68 per cent C.L.) for the redMaGiC and MagLim catalogues, respectively. For the wCDM, the dark energy equation of state is constrained to $w = -1.28 \pm 0.29$ and $w = -1.26^{+0.34}_{-0.27}$, for redMaGiC and MagLim catalogues, respectively. These results are compatible with the corresponding DES Y3 results in configuration space and pave the way for HS analyses using the DES Y6 data.

(cosmology:) cosmological parameters↗
DOE OSTI2026

Weak-lensing Detection of Intercluster Filaments in Three Nearby Cluster Systems

Abstract Direct detection of intercluster filaments is challenging due to their low surface density, resulting in a weak deflection field. We present weak-lensing detections of intercluster filaments using wide-field Dark Energy Camera observations from the Local Volume Complete Cluster Survey. A matched-filter method was applied to identify filamentary structures in three nearby ( z < 0.1) systems centered on A401, A2029, and A3558. We discover two filaments (>3 σ ) in each system, with the strongest detections (5.2 σ –5.8 σ ) around A401 and A2029. In particular, we report the first robust weak-lensing detections (≳5 σ ) of the intercluster bridges connecting the cluster pairs A401/399, A2029/2033, A2029/SIG, and A3558/3556. Adopting a filament convergence model motivated by numerical simulations, we infer the maximum convergence ( κ 0 ) and characteristic width ( h c ) for all six filaments, yielding κ 0 ∼ 0.016–0.040 and h c ∼ 0.23–0.43 Mpc. The performance of the matched-filter technique is validated using mock shear catalogs and further tested on a null field around A2351. We explore the potential of using the B-mode lensing signal of filaments to suppress cluster-induced shear contamination. We also quantify the biasing effect of closely separated terminal clusters to the filament signal. These results demonstrate the feasibility of directly mapping dark matter filaments with current and future wide-field weak-lensing datasets.

Shinde, Rahul [Brown University] (ORCID:0000000273↗
DOE OSTI2024

Condition-Based Maintenance of a Circulating Water System of a Canadian Nuclear Power Plant using Machine Learning and Statistical Tools

Canada Deuterium Uranium pressurized-heavy-water reactors (PHWR) are a type of nuclear power plant that generate clean and reliable energy. The scope of this work is to automate data analysis methodologies to inform a condition-based maintenance strategy of a circulating water system (CWS) of a PHWR. The multiunit CWS provides a continuous supply of water to cool steam condensers, even during transient scenarios, thereby improving the thermal efficiency. This work aims to develop a machine learning (ML) based approach to detect anomalies in heterogeneous data of a CWS in a PHWR to help inform a predictive maintenance strategy. The heterogeneous data include textual and numeric time series data for a PHWR. Natural-language-processing (NLP)-based models are used to analyze textual data contained in work orders and operator logs and an event-timeseries correlation detection method is applied to assist anomalies diagnoses for CWS. An ML model Robust Linear Model (RLM) is also used to remove the seasonal variations in the system variable distributions based on distributions of environmental variables. A machine learning model, Density-Based Spatial Clustering of Applications with Noise (DBSCAN), trained on both original data and data without any seasonal variations will then be used to detect if an anomaly exists. Thus, by moving to an automated methodology to detect, classify, and forecast anomalies, the maintenance strategy would be based on component condition instead of a time-based schedule.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2021

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗
DOE OSTI2025

Constructing Water‐Stable Porous Organic Salts via Suppressed Proton Integration Using Fluorinated Tetrazole Tectons

Porous organic salts (POSs) are an emerging class of materials with ordered ionic architectures, offering excellent proton transfer and water uptake properties. However, conventional POS synthesis via strong acid–base neutralization (e.g., ─SO₃H and ─NH₂) leads to extensive hydrogen bonding with water, compromising stability in aqueous and water-lean environments. Here, we address this challenge by designing POSs with hydrophobic porous channels and minimal hydrogen bonding formation. Our key innovation is the use of fluorinated tetrazole as a weak acid tecton and a tetra-substituted imidazole precursor devoid of active protons as the base. Single-crystal analysis and computational modeling reveal that the structural integrity of the synthesized POSs arises primarily from cation–anion interactions, with water confined as clusters in the pores, independent of hydrogen bonding with the scaffold. Robustness of the POS structure under aqueous and water-lean conditions is confirmed by X-ray and neutron scattering, as well as computational modeling, confirming preserved packing and crystal structures. The stability of POS is further demonstrated in aqueous iodine capture, with imidazolium cations and C–F functionalizations serving as strong adsorption sites. As a result, the approach developed herein further pushes the boundary of POS materials to withstand both aqueous and water-lean conditions.

Fluorinated tecton↗
DOE OSTI2024

Cluster expansion by transfer learning for phase stability predictions

Recent progress towards universal machine-learned interatomic potentials holds considerable promise for materials discovery. Yet the accuracy of these potentials for predicting phase stability may still be limited. In contrast, cluster expansions provide accurate phase stability predictions but are computationally demanding to parameterize from first principles, especially for structures of low dimension or with a large number of components, such as interfaces or multimetal catalysts. We overcome this trade-off via transfer learning. Using Bayesian inference, we incorporate prior statistical knowledge from machine-learned and physics-based potentials, enabling us to sample the most informative configurations and to efficiently fit first-principles cluster expansions. Furthermore, this algorithm is tested on Pt:Ni, showing robust convergence of the mixing energies as a function of sample size with reduced statistical fluctuations.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Detection of multi-reference character imbalances enables a transfer learning approach for virtual high throughput screening with coupled cluster accuracy at DFT cost

Appropriately identifying and treating molecules and materials with significant multi-reference (MR) character is crucial for achieving high data fidelity in virtual high-throughput screening (VHTS). Despite development of numerous MR diagnostics, the extent to which a single value of such a diagnostic indicates the MR effect on a chemical property prediction is not well established. We evaluate MR diagnostics for over 10 000 transition-metal complexes (TMCs) and compare to those for organic molecules. We observe that only some MR diagnostics are transferable from one chemical space to another. By studying the influence of MR character on chemical properties (i.e., MR effect) that involve multiple potential energy surfaces (i.e., adiabatic spin splitting, ΔE H–L , and ionization potential, IP), we show that differences in MR character are more important than the cumulative degree of MR character in predicting the magnitude of an MR effect. Motivated by this observation, we build transfer learning models to predict CCSD(T)-level adiabatic ΔE H–L and IP from lower levels of theory. By combining these models with uncertainty quantification and multi-level modeling, we introduce a multi-pronged strategy that accelerates data acquisition by at least a factor of three while achieving coupled cluster accuracy (i.e., to within 1 kcal mol –1 MAE) for robust VHTS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Enabling accurate chemical modeling of shocked energetic materials using a machine learning interatomic potential

Understanding the complex chemistry of organic materials under dynamic compression is important for many applications, but it is challenging due to the large number of reactions occurring at various time scales. Here, in this study, we develop a machine learning potential based on Chebyshev polynomials to study the insensitive energetic material 1,3,5-triamino-2,4,6-trinitrobenzene (TATB) under detonation. We discuss a strategy for constructing diverse training data needed to capture the complex chemistry of TATB. Our potential demonstrates strong transferability across a wide range of thermodynamic conditions and other explosives, enabling accurate and reliable chemical modeling of organic materials under extreme conditions. The efficiency of our approach allows for simulations over several nanoseconds and for large system sizes, providing detailed insights into the chemistry of shocked TATB. The model accurately reproduces experimental Hugoniot equation of state data, and our simulations reveal the rapid formation of nitrogen-rich carbon clusters following shock. The methods and datasets developed here offer a robust framework for accurate chemical modeling of other shocked organic energetic materials.

Chemistry↗
DOE OSTI2026

An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy

We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.

Artificial neural networks↗
DOE OSTI2025

Engineered Methylobacterium extorquens grows well on methoxylated aromatics due to its formaldehyde metabolism and stress response

ABSTRACT Lignin is a vast yet underutilized source of renewable energy. The microbial valorization of lignin is challenging due to the toxicity of its degradation intermediates, particularly formaldehyde. In this study, we engineeredMethylobacterium extorquensPA1 to metabolize lignin-derived methoxylated aromatics, vanillate (VA) and protocatechuate (PCA), by introducing thevanandpcagene clusters. Compared toPseudomonas putida,M. extorquensPA1 exhibited better formaldehyde detoxification, enabling robust growth on VA without accumulation of formaldehyde. Genetic analyses confirmed that formaldehyde oxidation and stress response systems, rather than C 1 assimilation, were important for VA metabolism. Additionally, VA and PCA were found to disrupt membrane potential, contributing to their inherent toxicity. Our findings establishM. extorquensPA1 as a promising chassis for lignin valorization and provide a framework for engineering formaldehyde-resistant microbial platforms. IMPORTANCE In developing biotechnological solutions for a circular economy, it is critical to valorize all parts of renewable resources, such as lignocellulose from vegetative components of agricultural crops and from bioenergy feedstocks. After chemical breakdown, the aromatics arising from lignin present significant challenges for use due to their toxicity. Here, we address one component of this challenge—the methoxy groups that get released as formaldehyde—and show that existing biotechnological platform organisms with strong formaldehyde metabolism, such asMethylobacterium extorquens, can be transformed into highly capable utilizers of methoxylated aromatics.

Microbiology↗