Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cluster computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

The Data Mine model for accessible partnerships in data science

Abstract The Data Mine at Purdue University is a pioneering experiential learning community for undergraduate and graduate students of any background to learn data science. The first data‐intensive experience embedded in a large learning community, The Data Mine had nearly 1300 students in academic year (AY) 2022–2023 and nearly 1700 students for AY 2023–2024. The Data Mine embodies data‐infused education, research, and collaboration. Students learn Python, R, SQL, and shell‐scripting, while working on weekly projects within a high‐performance computing (HPC) cluster. In the Corporate Partners cohort, students work on teams of 5–15 students, led by a paid student team leader. Each cohort follows an Agile approach, working on data‐intensive projects provided by industry partners and mentored by company employees. Students develop professional and data skills throughout the academic year, from August through April. Many students return in subsequent years to the program, increasing their tenure with a Corporate Partner. Student teams are inherently interdisciplinary; students from 133 different majors are involved in the program, ranging from new incoming students through PhD level students. These interdisciplinary teams of students bring new perspectives to challenging problems in which data science is a key part of the solution. The interdisciplinary teams foster an environment of synthesis with ideas and solutions. Students come together with different life experiences, different levels of technical skill, but also varying ways they navigate paths to solutions because of the variety of majors represented, resulting in a more creative and robust solution than a traditional data science program. This article is categorized under: Applications of Computational Statistics > Education in Computational Statistics

Betz, Margaret A.↗
DOE OSTI2025

A bi-level spatiotemporal clustering approach and its application to drought extraction

We present a novel flexible bi-level spatiotemporal clustering algorithm to extract events based on their intensity and spatiotemporal structures. Our algorithm consists of using (i) a novel space-time k-means clustering to obtain spatiotemporally coherent intensity clusters, and (ii) a density-based spatial clustering of applications with noise (DBSCAN) to spatiotemporally section the intensity clusters into individual events. We discuss the development of the algorithm, the selection, tuning and meaning of the parameters within each step, as well as its validation. Finally, we apply the algorithm to a spatiotemporal drought index, standardized vapor pressure deficit drought index (SVDI), over the continental United States (US) from 1980–2021 and show that it captures historical drought events over the continental United States and their spatiotemporal extents.

17 WIND ENERGY↗
DOE OSTI2023

Microstructure modeling of nuclear structural materials: Recent progress and future directions

Modeling and simulation of microstructures are essential to understand the complex responses and behaviors of nuclear materials in extreme environments. The needs to assess the extended life operation as well as the growing interest in accelerating nuclear materials development and qualification have stimulated the use of high-fidelity multiscale models aided by empirical and ab initio data. This paper reviews the role of various models across different length and time scales in investigating irradiation effects on microstructure evolution and degradation, in particular the embrittlement caused by radiation induced or enhanced formation of nanoscale chemical heterogeneities. The strength and limitations of these models, including classical rate theories, cluster dynamics, phase-field methods, and atomistic models informed by ab initio energies, are discussed with seminal examples. Challenges regarding the lack of thermo-kinetic data and theoretical treatments considering chemical complexities and magnetic excitations, as well as the stabilizing effect by excess point defects in nuclear structural materials are presented, along with potential solutions based on ab initio informed surrogate energy models and statistical sampling by Monte Carlo simulations. Further, the review then highlights the opportunities to leverage the advantages of different methods by establishing hybrid models by shared variables or coupled codes and applications. Finally, the review concludes with forward-looking remarks on how the use of physics-based models can aid the improvement of machine-learning models of property degradation and vice versa.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Analysis of spin frustration in an Fe III 7 cluster using a combination of computational, experimental, and magnetostructural correlation methods

The synthesis, structure, and magnetic properties are reported for [Fe 7 O 3 (O 2 C t Bu) 9 (mda) 3 (H 2 O) 3 ] ( 1 ), where mdaH 2 is N -methyldiethanolamine. 1 was prepared from the reaction of [Fe 3 O(O 2 C t Bu) 6 (H 2 O) 3 ](NO 3 ) with mdaH 2 in a 1:~3 ratio in MeCN. The core of 1 consists of a central octahedral Fe III ion held within a non-planar Fe 6 loop by three μ 3 -O 2- and three μ 2 -RO - arms from the three mda 2- chelates. Variable-temperature dc and ac magnetic susceptibility studies revealed dominant antiferromagnetic coupling, leading to a ground state spin of S = 5 / 2 . The ground state was confirmed by a fit of magnetization data collected in the 0.1–7.0 T and 1.8–10.0 K ranges. The four Fe 2 pairwise exchange parameters ( J 1 - J 4 ) were estimated by independent methods: theoretical calculations using either broken symmetry energy differences (-46.3, -16.2, -3.9, and - 28.1 cm -1 , respectively) or Green’s function approximation methods (-41.4, -14.8, -13.2, and - 24.7 cm -1 ), and a magnetostructural correlation (MSC) previously developed for high nuclearity Fe III /O complexes (-39.5, -13.8, -6.7, and - 23.5 cm -1 ). Additionally, the J 1 - J 4 obtained from the MSC and theoretical methods were used with the program PHI to both simulate χ M T vs T as well as to serve as reasonable input values to fit the experimental data (-41.0, -11.4, -5.0, and - 27.3 cm -1 ). Analysis of the J ij led to identification of the spin frustration effects operative and the resultant spin vector alignments at each Fe III ion, thus allowing for the rationalization of the experimental ground state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Scalable, In-situ Data Clustering Data Analysis for Extreme Scale Scientific Computing (Final Report)

The objective of this project is to address challenges in the design and development of scalable in-situ data clustering and analytics algorithms and software. Our goal is to develop parallel software consisting of a set of spatio-temporal data clustering and anomaly detection functions, both of which are very important for large-scale analysis and have wide applicability for in-situ runs as well as post-processing analysis. Our design principles for in-situ analysis consider the following: (1) identify parts of the computation can be done close to the data within the nodes, while it is still in memory; (2) extract analysis components can (and should) be performed in remote staging and analysis nodes; (3) develop error-bound approximation methods for applications tolerable for small errors; (4) identify the type of derived distributions and statistics, for spatio-temporal data, that can be kept locally in order to both accelerate computations and meet energy constraints in subsequent iterations and phases; (5) use a self-describing data format so that data can be consistent and understood among local storage (memory and SSDs) and at staging and analysis nodes, thereby providing portability and flexibility; (6) develop service-oriented functions that can schedule in-situ and post-hoc analysis tasks based on the dynamic requirements of applications. Our development focus is to produce the parallel data analysis software/library that will be scalable, reusable, extensible, and generic for applications in different disciplines. The software will be able to run in-situ with the simulations as well as post-hoc analysis. This approach will satisfy many synergistic requirements for data intensive applications executed on data coming from instruments and experiments. In particular, the proposed multilevel approach is directly applicable to perform design tradeoffs for running part of the algorithms near the instruments and the rest on remote (analysis) systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Immobilization of “Capping Arene” Cobalt(II) Complexes on Ordered Mesoporous Carbon for Electrocatalytic Water Oxidation

We report the synthesis, characterization, and electrocatalytic water oxidation activity of two cobalt complexes, (6-FP)Co(NO 3 ) 2 (1) (6-FP = 8,8'-(1,2-phenylene)diquinoline) and (5-FP)Co(NO 3 ) 2 (2) (5-FP = 1,2-bis(N-7-azaindolyl)benzene), containing "capping arene" bidentate ligands with nitrogen atom donors. The cobalt complexes 1 and 2 were supported on ordered mesoporous carbon (OMC) by π-π stacking, resulting in heterogenized cobalt materials 6-FP-Co-OMC-1 and 5-FP-Co-OMC-2, respectively, and studied for electrocatalytic water oxidation. We find that 6-FP-Co-OMC-1 exhibits an overpotential of 355 mV for a current density of 10 mA cm -2 and a turnover frequency (TOF) of ~0.53 s -1 at an overpotential of 400 mV at pH 14. 6-FP-Co-OMC-1 exhibits activity that is ~1.6 times that of 5-FP-Co-OMC-2, which gives a TOF of 0.32 s -1 at 400 mV overpotential. The structural stability of the single-atom Co site was demonstrated for 6-FP-Co-OMC-1 using X-ray absorption spectroscopy for the molecular complex supported on OMC, but slow degradation in catalyst activity can be attributed to eventual formation of Co oxide clusters. DFT computations of electrocatalytic water oxidation using the molecular complexes as models provide a description of the catalytic mechanism. These studies reveal that the mechanism for O-O bond formation involves an intermediate Co IV oxo complex that undergoes an intramolecular reductive O-O coupling to form a Co II -OOH species. Further, the calculations predict that the molecular 6-FP-Co structure is more active for electrocatalytic water oxidation than 5-FP-Co, which is consistent with experimental studies of 6-FP-Co-OMC-1 and 5-FP-Co-OMC-2, highlighting the possibility that the ligand structure influences the catalytic activity of the supported molecular catalysts.

25 ENERGY STORAGE↗
DOE OSTI2020

Non-dilute helium-related defect interactions in the near-surface region of plasma-exposed tungsten

We report a systematic energetic analysis of helium-related defect interactions that mediate helium (He) segregation on surfaces of plasma-exposed tungsten at different levels of He ion implantation. We focus on high He fluences that increase the He content in the plasma-exposed material well beyond the dilute limit of He concentration and employ atomic configurations generated by large-scale molecular dynamics simulations of He-implanted tungsten. We perform systematic molecular statics computations of cluster– defect interaction energetics in the highly defect-rich near-surface region of plasma-exposed tungsten for small mobile helium clusters as a function of the cluster distance from the surface. In this region, mobile clusters are also subjected to the stress fields generated by defects such as helium bubbles and other clusters, which govern cluster–defect interactions in addition to the cluster–surface interaction. Based on systematic investigation of individual cluster–defect interactions, we develop a mathematical framework to describe the interaction energy landscapes consisting of elastic interaction potential perturbations to finite-width square-well potentials, where the potential well accounts for cluster trapping by the defect at close range and subsequent coalescence and the perturbation potential is parameterized according to elastic inclusion theory. Superposition of all the relevant interaction potentials provides a comprehensive description of the interaction energy landscape that would be experienced by a small mobile cluster along its migration path toward the plasma-exposed surface at high He fluence. Such descriptions are particularly important for developing atomistically-informed, hierarchical multi-scale models of helium cluster dynamics in plasma-facing materials.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Coarse-grain cluster analysis of tensors with application to climate biome identification

A tensor provides a concise way to codify the interdependence of complex data. Treating a tensor as a d-way array, each entry records the interaction between the different indices. Clustering provides a way to parse the complexity of the data into more readily understandable information. Clustering methods are heavily dependent on the algorithm of choice, as well as the chosen hyperparameters of the algorithm. However, their sensitivity to data scales is largely unknown. In this work, we apply the discrete wavelet transform to analyze the effects of coarse-graining on clustering tensor data. We are particularly interested in understanding how scale affects clustering of the Earth's climate system. The discrete wavelet transform allows classification of the Earth's climate across a multitude of spatial-temporal scales. The discrete wavelet transform is used to produce an ensemble of classification estimates, as opposed to a single classification. Each element of the ensemble is a clustering at a different spatial-temporal scale. Information theoretic approaches are used to identify important scale lengths in clustering the L15 Climate Datset. We also discover a sub-collection of the ensemble that spans the majority of the variance observed, allowing for efficient consensus clustering techniques that can be used to identify climate biomes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Microscopic origin of temperature-dependent magnetism in spin-orbit-coupled transition metal compounds

A few 4 d and 5 d transition metal compounds with various electron fillings were recently found to exhibit magnetic susceptibilities χ and magnetic moments that deviate from the well-established Kotani model. This model has been considered for decades to be the canonical expression for descriing the temperature dependence of magnetism in systems with nonnegligible spin-orbit coupling effects. In this paper, we uncover the origin of such discrepancies and determine the applicability and limitations of the Kotani model by calculating the temperature dependence of the magnetic moments of a series of 4 d (Ru-based) and 5 d (W-based) systems at different electron fillings. For this purpose, we perform exact diagonalization of -derived relativistic multiorbital Hubbard models on finite clusters and compute their magnetic susceptibilities. Comparison with experimentally measured magnetic properties indicates that contributions such as a temperature-independent χ 0 background, crystal field effects, Coulomb and Hund's couplings, and intersite interactions—not included in the Kotani model—are especially crucial for correctly describing the temperature dependence of χ and magnetic moments at various electron fillings in these systems. Based on our results, we propose a generalized approach beyond the Kotani model to accurately describe their magnetism. Published by the American Physical Society 2025

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

WfBench: Automated Generation of Scientific Workflow Benchmarks

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the deployment, monitoring, and optimization of workflow executions, many workflow systems have been developed over the past decade. There is a need for workflow benchmarks that can be used to evaluate the performance of workflow systems on current and future software stacks and hardware platforms.We present a generator of realistic workflow benchmark specifications that can be translated into benchmark code to be executed with current workflow systems. Our approach generates workflow tasks with arbitrary performance characteristics (CPU, memory, and I/O usage) and with realistic task dependency structures based on those seen in production workflows. We present experimental results that show that our approach generates benchmarks that are representative of production workflows, and conduct a case study to demonstrate the use and usefulness of our generated benchmarks to evaluate the performance of workflow systems under different configuration scenarios.

Coleman, Taina↗
DOE OSTI2024

A new “gold standard”: Perturbative triples corrections in unitary coupled cluster theory and prospects for quantum computing

A major difficulty in quantum simulation is the adequate treatment of a large collection of entangled particles, synonymous with electron correlation in electronic structure theory, with coupled cluster (CC) theory being the leading framework for dealing with this problem. Augmenting computationally affordable low-rank approximations in CC theory with a perturbative account of higher-rank excitations is a tractable and effective way of accounting for the missing electron correlation in those approximations. This is perhaps best exemplified by the “gold standard” CCSD(T) method, which bolsters the baseline CCSD with the effects of triple excitations using considerations from many-body perturbation theory (MBPT). Despite this established success, such a synergy between MBPT and the unitary analog of CC theory (UCC) has not been explored. In this work, we propose a similar approach wherein converged UCCSD amplitudes are leveraged to evaluate energy corrections associated with triple excitations, leading to the UCCSD[T] method. In terms of quantum computing, this correction represents an entirely classical post-processing step that improves the energy estimate by accounting for triple excitation effects without necessitating new quantum algorithm developments or increasing demand for quantum resources. The rationale behind this choice is shown to be rigorous by studying the properties of finite-order UCC energy functionals, and our efforts do not support the addition of the fifth-order contributions as in the (T) correction. We assess the performance of these approaches on a collection of small molecules and demonstrate the benefits of harnessing the inherent synergy between MBPT and UCC theories.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Density Matrix Quantum Circuit Simulation via the BSP Machine on Modern GPU Clusters

As quantum computers evolve, simulations of quantum programs on classical computers will be essential in validating quantum algorithms, understanding the effect of system noise, and design applications for future quantum computers. In this paper, we propose a novel multi-GPU programming model called MG-BSP that constructs a virtual BSP machine on top of modern multi-GPU platforms, and tweak the programming model to build a multi-GPU density matrix quantum simulator. We propose and evaluated a new formulation minimizing communication and prove that the transformation conserves original semantics when noise is introduced. We build the tool-chain to support quantum assembly open standard, synthesize testing quantum circuit, and enable ultra-deep quantum simulation. We evaluated our design on four state-of-the-art multi-GPU platforms including the latest DGX-1 and DGX-2 systems. We demonstrate simulation of 1 million gates in 94 minutes, far deeper circuits than has been demonstrated in prior work. A roofline-model analysis show that we have reached near-optimal performance under memory bound.

Li, Ang↗
DOE OSTI2022

Spectral function for 4 He using the Chebyshev expansion in coupled-cluster theory

Here, we compute spectral function for 4 He by combining coupled-cluster theory with an expansion of integral transforms into Chebyshev polynomials. Our method allows us to estimate the uncertainty of spectral reconstruction. The properties of the Chebyshev polynomials make the procedure numerically stable and considerably lower in memory usage than the typically employed Lanczos algorithm. We benchmark our predictions with other calculations in the literature and with electron-scattering data in the quasi-elastic peak. The spectral function formalism allows one to extend ab initio lepton-nucleus cross sections into the relativistic regime. This makes it a promising tool for modeling this process at higher-energy transfers. The results we present open the door for studies of heavier nuclei, important for the neutrino oscillation programs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

PANDORA: A Parallel Dendrogram Construction Algorithm for Single Linkage Clustering on GPU

This paper introduces Pandora, a parallel algorithm for computing dendrograms, the hierarchical cluster trees for single linkage clustering (SLC). Current parallel approaches construct dendrograms by partitioning a minimum spanning tree and removing edges. However, they struggle with skewed, hard-to-parallelize real-world dendrograms. Consequently, computing dendrograms is the sequential bottleneck in HDBSCAN*[21], a popular SLC variant. Pandora uses recursive tree contraction to address this limitation. Pandora contracts nodes to construct progressively smaller trees. It computes the smallest contracted dendrogram and expands it by inserting contracted edges. This recursive strategy is highly parallel, skew-independent, work-optimal, and well-suited for GPUs and multicores. We develop a performance portable implementation of Pandora in Kokkos[31] and evaluate its performance on multicore CPUs and multi-vendor GPUs (e.g., Nvidia, AMD) for dendrogram construction in HDBSCAN*. Multithreaded Pandora is 2.2x faster than the current best-multithreaded implementation. Our GPU version achieves 6-20x speedup on AMD GPUs and 10-37x on NVIDIA GPUs over multithreaded Pandora. Pandora removes HDBSCAN*’s sequential bottleneck, greatly boosting efficiency, particularly with GPUs.

Sao, Piyush↗