Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Peculiar velocity estimation from kinetic SZ effect using deep neural networks

ABSTRACT The Sunyaev–Zel’dolvich (SZ) effect is expected to be instrumental in measuring velocities of distant clusters in near future telescope surveys. We simplify the calculation of peculiar velocities of galaxy clusters using deep learning frameworks trained on numerical simulations to avoid the independent estimation of the optical depth. Images of distorted photon backgrounds are generated for idealized observations using one of the largest cosmological hydrodynamical simulations, the Magneticum simulations. The model is tested to determine its ability of estimating peculiar velocities from future kinetic SZ observations under different noise conditions. The deep learning algorithm displays robustness in estimating peculiar velocities from kinetic SZ effect by an improvement in accuracy of about 17 per cent compared to the analytical approach.

Wang, Yuyu (ORCID:0000000202458547)↗
DOE OSTI2020

Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Robust Subspace Recovery (RoSuRe) algorithm was recently introduced as a principled and numerically efficient algorithm that unfolds underlying Unions of Subspaces (UoS) structure, present in the data. The union of Subspaces (UoS) is capable of identifying more complex trends in data sets than simple linear models. In this work, we build on and extend RoSuRe to prospect the structure of different data modalities individually. We propose a novel multi-modal data fusion approach based on group sparsity which we refer to as Robust Group Subspace Recovery (RoGSuRe). Relying on a bi-sparsity pursuit paradigm and non-smooth optimization techniques, the introduced framework learns a new joint representation of the time series from different data modalities, respecting an underlying UoS model. We subsequently integrate the obtained structures to form a unified subspace structure. The proposed approach exploits the structural dependencies between the different modalities data to cluster the associated target objects. The resulting fusion of the unlabeled sensors’ data from experiments on audio and magnetic data has shown that our method is competitive with other state of the art subspace clustering methods. The resulting UoS structure is employed to classify newly observed data points, highlighting the abstraction capacity of the proposed method.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Profiles of upcoming HPC Applications and their Impact on Reservation Strategies

With the expected convergence between HPC, BigData and AI, new applications with different profiles are coming to HPC infrastructures. Here, we aim at better understanding the features and needs of these applications in order to be able to run them efficiently on HPC platforms. The approach followed is bottom-up: we study thoroughly an emerging application from the neuroscience community (SLANT) to understand its behavior. Based on these observations, we derive a generic, yet simple, application model (namely, a linear sequence of stochastic jobs). We expect this model to be representative for a large set of upcoming applications that require the computational power of HPC clusters without fitting the typical behavior of large-scale traditional applications. In a second step, we show how one can manipulate this generic model in a scheduling framework. Specifically we consider the problem of making reservations (both time and memory) for an execution on an HPC platform. We derive solutions using the model of the first step of this work. We experimentally show the robustness of the model, even with very few data or with another application, to generate the model, and provide performance gains with regards to standard and more recent approaches used in the neuroscience community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Unleashed from constrained optimization: quantum computing for quantum chemistry employing generator coordinate inspired method

Hybrid quantum-classical approaches offer potential solutions to quantum chemistry problems, yet they often manifest as constrained optimization problems. Here, we explore the interconnection between constrained optimization and generalized eigenvalue problems through the Unitary Coupled Cluster (UCC) excitation generators. Inspired by the generator coordinate method, we employ these UCC excitation generators to construct non-orthogonal, overcomplete many-body bases, projecting the system Hamiltonian into an effective Hamiltonian, which bypasses issues such as barren plateaus that heuristic numerical minimizers often encountered in standard variational quantum eigensolver (VQE). Diverging from conventional quantum subspace expansion methods, we introduce an adaptive scheme that robustly constructs the many-body basis sets from a pool of the UCC excitation generators. This scheme supports the development of a hierarchical ADAPT quantum-classical strategy, enabling a balanced interplay between subspace expansion and ansatz optimization to address complex, strongly correlated quantum chemical systems cost-effectively, setting the stage for more advanced quantum simulations in chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Evaluation of a pair-based, joint-likelihood association approach for regional infrasound event identification

SUMMARY A Bayesian framework for the association of infrasonic detections is presented and evaluated for analysis at regional propagation scales. A pair-based, joint-likelihood association approach is developed that identifies events by computing the probability that individual detection pairs are attributable to a hypothetical common source and applying hierarchical clustering to identify events from the pair-based analysis. The framework is based on a Bayesian formulation introduced for infrasonic source localization and utilizes the propagation models developed for that application with modifications to improve the numerical efficiency of the analysis. Clustering analysis is completed using hierarchical analysis via weighted linkage for a non-Euclidean distance matrix defined by the negative log-joint-likelihood values. The method is evaluated using regional synthetic data with propagation distances of hundreds of kilometres in order to study the sensitivity of the method to uncertainties and errors in backazimuth and time of arrival. The method is found to be robust and stable for typical uncertainties, able to effectively distinguish noise detections within the data set from those in events, and can be made numerically efficient due to its ease of parallelization.

58 GEOSCIENCES↗
DOE OSTI2026

Spatially Accelerated Winding Numbers for Curved Geometry

The generalized winding number (GWN) is a scalar field that supports robust containment queries on curved geometry, including non-watertight, overlapping, and nested boundary representations. While queries can be easily parallelized over samples, direct evaluation on parametric curves and surfaces remains costly for large and complex models. Fast, state-of-the-art GWN approaches leverage a spatial index to approximate the GWN, typically coupled with a Taylor expansion which approximates the GWN contribution for far clusters of geometric primitives. However, such methods operate only on discrete inputs such as triangle meshes and point clouds, and would introduce containment errors near boundaries if applied to curved input. We extend support for fast GWN evaluation over arbitrary collections of NURBS curves in 2D and trimmed NURBS patches in 3D via a Bounding Volume Hierarchy that stores efficiently precomputed moment data in the hierarchy nodes. When querying the hierarchy, approximations for far clusters are used alongside direct evaluation for nearby NURBS primitives, achieving sub-linear complexity while preserving the geometric features in the vicinity of the query point. Central to our performance improvements is an adaptive subdivision strategy for NURBS primitives during a preprocessing phase, creating better spatial partitions while retaining the same accuracy for containment decisions as a direct evaluation. We demonstrate the performance and accuracy of our approach across a large collection of 2D and 3D datasets.

Computer science↗
DOE OSTI2020

Decoy selection for protein structure prediction via extreme gradient boosting and ranking

Background: Identifying one or more biologically-active/native decoys from millions of non-native decoys is one of the major challenges in computational structural biology. The extreme lack of balance in positive and negative samples (native and non-native decoys) in a decoy set makes the problem even more complicated. Consensus methods show varied success in handling the challenge of decoy selection despite some issues associated with clustering large decoy sets and decoy sets that do not show much structural similarity. Recent investigations into energy landscape-based decoy selection approaches show promises. However, lack of generalization over varied test cases remains a bottleneck for these methods. Results: We propose a novel decoy selection method, ML-Select, a machine learning framework that exploits the energy landscape associated with the structure space probed through a template-free decoy generation. The proposed method outperforms both clustering and energy ranking-based methods, all the while consistently offering better performance on varied test-cases. Moreover, ML-Select shows promising results even for the decoy sets consisting of mostly low-quality decoys. Conclusions: ML-Select is a useful method for decoy selection. This work suggests further research in finding more effective ways to adopt machine learning frameworks in achieving robust performance for decoy selection in template-free protein structure prediction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Decode the Workload: Training Deep Learning Models for Efficient Compute Cluster Representation

Monitoring the status of a high throughput computing cluster running computationally intensive production jobs is a crucial yet challenging system administration task due to the complexity of such systems. To this end, we train autoencoders using the Linux kernel CPU metrics of the cluster. Additionally, we explore assisting these models with graph neural networks to share information across threads within a compute node. The models are compared in terms of their ability to: 1) Produce a compressed latent representation that captures the salient features of the input, 2) Detect anomalous activity, and 3) Make distinction between different kinds of jobs run at Jefferson Lab. The goal is to have a robust encoder whose compressed embeddings are used for several downstream tasks. We extend this study further by deploying these models in a human-in-the-loop production-based setting for the anomaly detection task and discuss the associated implementation aspects such as continual learning and the criterion to generate alarms. This study represents a first step in the endeavor towards building self-supervised large-scale foundation models for computing centers.

Mohammed, Ahmed↗
DOE OSTI2023

Linker Vacancy Engineering of a Robust ftw–type Zr–MOF for Hexane Isomers Separation

Discrimination of physically similar molecules by porous solids represents an important yet challenging task in industrially relevant chemical separations. Precisely controlled pore dimension and/or tailored pore surface functionality are crucial to achieve high-efficiency separation. Metal-organic frameworks (MOFs) are promising candidates for these challenging separations in light of their structural diversity as well as highly adjustable pore dimension/functionality. We report here a microporous, ftw-type Zr-based MOF structure, HIAM-410 (HIAM=Hoffmann Institute of Advanced Materials), built on hexanuclear Zr 6 cluster and pyrene-1,3,6,8-tetracarboxylate (ptc 4– ). Its crystallographic structure has been determined using continuous rotation electron diffraction (cRED) technique combined with Rietveld refinement against powder X-ray diffraction data, aided by low-dose high-resolution transmission electron microscopy (HRTEM) imaging. The compound features exceptional framework stability that is comparable to the prototype MOF UiO-66. Interestingly, the linker vacancies in the pristine MOF structure could be partially restored by post-synthetic linker insertion. Its separation capability of hexane isomers is enhanced substantially upon the linker vacancy engineering. As a result, the restored structure exhibits efficient splitting of monobranched and dibranched hexane isomers at both room temperature and industrially relevant temperature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Accurate and efficient parameterization of an atomic cluster expansion (ACE) potential for ammonia under extreme conditions

We present a machine learning interatomic potential for ammonia designed to capture its complex multiphase behavior, including both molecular and superionic phases. The potential is based on the atomic cluster expansion (ACE) formulation and has been parameterized to facilitate high-fidelity molecular dynamics simulations of ammonia under extreme conditions, for pressures up to 100 GPa and for temperatures above 500 K and up to 6000 K. A diverse range of configurations was generated through high-quality ab initio molecular dynamics simulations, covering insulating and superionic ice phases, liquid ammonia, molecular nitrogen (N 2 ) and hydrogen (H 2 ), and metastable compounds that form upon dissociation, including $NH^{+}_{4}$, $H^{+}_{3}$, N 2 H 4 , and N 3 H. We demonstrate that the ammonia ACE potential accurately reproduces experimental and density functional theory predicted isotherms and Hugoniots. Crucially, the potential is able to capture the intricate phase behavior of ammonia, including the transition from insulating molecular fluid to the superionic phase. This work provides a robust interatomic potential that can be used for large-scale, accurate simulations of ammonia under extreme thermodynamic conditions, offering a powerful tool for investigating its behavior in various phases and applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Netostat: analyzing dynamic flow patterns in high-speed networks

Understanding flow traffic patterns in networks, such as the Internet or service provider networks, is crucial to improving their design and building them robustly. However, as networks grow and become more complex, it is increasingly cumbersome and challenging to study how the many flow patterns, sizes and the continually changing source-destination pairs in the network evolve with time. Here, we present Netostat, a visualization-based network analysis tool that uses visual representation and a mathematics framework to study and capture flow patterns, using graph theoretical methods such as clustering, similarity and difference measures. Netostat generates an interactive graph of all traffic patterns in the network, to isolate key elements that can provide insights for traffic engineering. We present results for U.S. and European research networks, ESnet and GEANT, demonstrating network state changes, to identify major flow trends, potential points of failure, and bottlenecks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

SUNBIRD : a simulation-based model for full-shape density-split clustering

Combining galaxy clustering information from regions of different environmental densities can help break cosmological parameter degeneracies and access non-Gaussian information from the density field that is not readily captured by the standard two-point correlation function (2PCF) analyses. However, modelling these density-dependent statistics down to the non-linear regime has so far remained challenging. We present a simulation-based model that is able to capture the cosmological dependence of the full shape of the density-split clustering (DSC) statistics down to intra-halo scales. Our models are based on neural-network emulators that are trained on high-fidelity mock galaxy catalogues within an extended-ΛCDM framework, incorporating the effects of redshift-space, Alcock–Paczynski distortions, and models of the halo–galaxy connection. Our models reach sub-percent level accuracy down to $1 \, h^{-1}\text{Mpc}$ and are robust against different choices of galaxy–halo connection modelling. When combined with the galaxy 2PCF, DSC can tighten the constraints on ω cdm , σ 8 , and n s by factors of 2.9, 1.9, and 2.1, respectively, compared to a 2PCF-only analysis. DSC additionally puts strong constraints on environment-based assembly bias parameters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Tunable room-temperature ferromagnetism in Co-doped two-dimensional van der Waals ZnO

The recent discovery of ferromagnetism in two-dimensional van der Waals crystals has provoked a surge of interest in the exploration of fundamental spin interaction in reduced dimensions. However, existing material candidates have several limitations, notably lacking intrinsic room-temperature ferromagnetic order and air stability. Here, motivated by the anomalously high Curie temperature observed in bulk diluted magnetic oxides, we demonstrate room-temperature ferromagnetism in Co-doped graphene-like Zinc Oxide, a chemically stable layered material in air, down to single atom thickness. Through the magneto-optic Kerr effect, superconducting quantum interference device and X-ray magnetic circular dichroism measurements, we observe clear evidences of spontaneous magnetization in such exotic material systems at room temperature and above. Transmission electron microscopy and atomic force microscopy results explicitly exclude the existence of metallic Co or cobalt oxides clusters. X-ray characterizations reveal that the substitutional Co atoms form Co 2+ states in the graphitic lattice of ZnO. By varying the Co doping level, we observe transitions between paramagnetic, ferromagnetic and less ordered phases due to the interplay between impurity-band-exchange and super-exchange interactions. Our discovery opens another path to 2D ferromagnetism at room temperature with the advantage of exceptional tunability and robustness.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Dark Energy Survey Year 6 Results: Redshift Calibration of the MagLim++ Lens Sample

In this work, we derive and calibrate the redshift distribution of the MagLim++ lens galaxy sample used in the Dark Energy Survey Year 6 (DES Y6) 3x2pt cosmology analysis. The 3x2pt analysis combines galaxy clustering from the lens galaxy sample and weak gravitational lensing. The redshift distributions are inferred using the SOMPZ method - a Self-Organizing Map framework that combines deep-field multi-band photometry, wide-field data, and a synthetic source injection (Balrog) catalog. Key improvements over the DES Year 3 (Y3) calibration include a noise-weighted SOM metric, an expanded Balrog catalogue, and an improved scheme for propagating systematic uncertainties, which allows us to generate O($10^8$) redshift realizations that collectively span the dominant sources of uncertainty. These realizations are then combined with independent clustering-redshift measurements via importance sampling. The resulting calibration achieves typical uncertainties on the mean redshift of 1-2%, corresponding to a 20-30% average reduction relative to DES Y3. We compress the $n(z)$ uncertainties into a small number of orthogonal modes for use in cosmological inference. Marginalizing over these modes leads to only a minor degradation in cosmological constraints. This analysis establishes the MagLim++ sample as a robust lens sample for precision cosmology with DES Y6 and provides a scalable framework for future surveys.

Giannini, G. [Chicago U., Astron. Astrophys. Ctr.;↗
DOE OSTI2026

Dark Energy Survey Year 6 results: Redshift calibration of the MagLim++ lens sample

In this work, we derive and calibrate the redshift distribution of the MagLim++ lens galaxy sample used in the Dark Energy Survey Year 6 (DES Y6) 3 x 2pt cosmology analysis. The 3 x 2pt analysis combines galaxy clustering from the lens galaxy sample and weak gravitational lensing. The redshift distributions are inferred using the SOMPZ method - a Self-Organizing Map framework that combines deep-field multi-band photometry, wide-field data, and a synthetic source injection ( B alrog) catalog. Key improvements over the DES Year 3 (Y3) calibration include a noise-weighted SOM metric, an expanded Balrog catalogue, and an improved scheme for propagating systematic uncertainties, which allows us to generate O(10 8 ) redshift realizations that collectively span the dominant sources of uncertainty. These realizations are then combined with independent clustering-redshift measurements via importance sampling. The resulting calibration achieves typical uncertainties on the mean redshift of 1-2%, corresponding to a 20-30% average reduction relative to DES Y3. We compress the n(z) uncertainties into a small number of orthogonal modes for use in cosmological inference. Marginalizing over these modes leads to only a minor degradation in cosmological constraints. Here, this analysis establishes the MagLim++ sample as a robust lens sample for precision cosmology with DES Y6 and provides a scalable framework for future surveys.

dark energy↗
DOE OSTI2023

Robust charge-density-wave correlations in the electron-doped single-band Hubbard model

There is growing evidence that the hole-doped single-band Hubbard and t–J models do not have a superconducting ground state reflective of the high-temperature cuprate superconductors but instead have striped spin- and charge-ordered ground states. Nevertheless, it is proposed that these models may still provide an effective low-energy model for electron-doped materials. Here we study the finite temperature spin and charge correlations in the electron-doped Hubbard model using quantum Monte Carlo dynamical cluster approximation calculations and contrast their behavior with those found on the hole-doped side of the phase diagram. We find evidence for a charge modulation with both checkerboard and unidirectional components decoupled from any spin-density modulations. These correlations are inconsistent with a weak-coupling description based on Fermi surface nesting, and their doping dependence agrees qualitatively with resonant inelastic x-ray scattering measurements. Our results provide evidence that the single-band Hubbard model describes the electron-doped cuprates.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

Aqueous electrolyte solutions with anion-bridged secondary solvation sheaths for highly efficient zinc metal batteries

Aqueous zinc metal batteries are low-cost electrochemical devices suitable for safe grid energy storage. However, water decomposition and Zn dendrite formation detrimentally affect their coulombic efficiency. Conventional aqueous electrolyte solutions, with a concentration around 1 M, are cost-effective and exhibit high bulk ionic conductivity but cannot form a stable solid electrolyte interphase. Water-in-salt and aqueous-organic hybrid electrolyte solutions can form robust solid electrolyte interphases, but they are not kinetically efficient and cost-effective. Here, to circumvent these issues, we design variously concentrated aqueous electrolyte solutions using several salts with different donor numbers to extend anion coordination into the secondary solvation sheath. We show that salt-derived anions with donor number > 18 enter the Zn2+ first solvation sheath, and ensure a strong binding energy between the Zn2+(H2O)5-anion nanometric clusters and water molecules in the secondary solvation sheath. In particular, 2 M aqueous electrolyte solutions containing fluorinated anions exhibit bulk ionic conductivities of 26-35 mS cm−1 at 25 °C and form a ZnF2-rich solid electrolyte interphase. When tested in Zn||NaV3O8·1.5H2O Swagelok cells, the best-performing electrolyte solution enables an average coulombic efficiency of 99.99% for 1,000 cycles at 1.5 mA cm−2, corresponding to an initial specific energy of 130 Wh kg−1 (based on the combined weight of the positive and negative electrodes).

25 ENERGY STORAGE↗
DOE OSTI2022

Understanding Proton Movement in [Fe-Fe] Hydrogenases

Nature uses specialized metalloenzymes to carry out small molecule activation reactions, including CO 2 fixation, O 2 activation, and proton reduction, with unparalleled efficiency, rates, and selectivity. The latter reactions are performed by hydrogenases, protein metallo-complexes that interconverts H 2 to protons and electrons (H 2 oxidation) and the reverse reaction (H 2 production) with incredibly low energy input and amazingly fast kinetics. Reproducing both the activity and efficiency of metalloenzymes in sustainable anthropogenic systems remains one of the “holy grails” of inorganic chemistry. However, identifying the precise molecular components responsible for these desirable properties has been challenging in the natural metalloenzymes, hindering efforts to develop analogous processes in synthetic compounds. Considering the inherent complexity of a metalloenzyme and the many interactions, both strong and weak, that contribute to the function of an enzyme, we have elected to model natural metalloenzymes on a biochemical platform. Towards this end, we have a developed structural, functional, and mechanistic mimic of the [Ni-Fe] hydrogenases within a robust protein scaffold, rubredoxin, to understand the influence of the secondary coordination environment on the metal center. This involved preparing a series of three rubredoxin constructs containing a single point mutation at Val positions and making the NMR chemical shift assignments for the paramagnetic (nickel-substituted) and non-paramagnetic (zinc-substituted) form. These physical studies were complemented with in silico molecular dynamic studies on proteins with [Fe-S] clusters to engineer new proton channels to test in vitro . To assist our search for new natural metalloprotein scaffolds within the vast number of sequenced genomes, we created a neural network-based program to identify proteins with specific metal-binding sites. These computational and physical studies with metalloenzymes provide direct insight into the fundamental chemical principles driving the natural systems and offer design principles for developing catalysts that utilize analogous principles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗