Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cluster computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Explicitly correlated coupled cluster method for accurate treatment of open-shell molecules with hundreds of atoms

We present a near-linear scaling formulation of the explicitly correlated coupled-cluster singles and doubles with the perturbative triples method [CCSD(T)F12¯] for high-spin states of open-shell species. The approach is based on the conventional open-shell CCSD formalism [M. Saitow et al., J. Chem. Phys. 146, 164105 (2017)] utilizing the domain local pair-natural orbitals (DLPNO) framework. The use of spin-independent set of pair-natural orbitals ensures exact agreement with the closed-shell formalism reported previously, with only marginally impact on the cost (e.g., the open-shell formalism is only 1.5 times slower than the closed-shell counterpart for the C160H322 n-alkane, with the measured size complexity of ≈1.2). Evaluation of coupled-cluster energies near the complete-basis-set (CBS) limit for open-shell systems with more than 550 atoms and 5000 basis functions is feasible on a single multi-core computer in less than 3 days. The aug-cc-pVTZ DLPNO-CCSD(T)F12¯ contribution to the heat of formation for the 50 largest molecules among the 348 core combustion species benchmark set [J. Klippenstein et al., J. Phys. Chem. A 121, 6580–6602 (2017)] had root-mean-square deviation (RMSD) from the extrapolated CBS CCSD(T) reference values of 0.3 kcal/mol. For a more challenging set of 50 reactions involving small closed- and open-shell molecules [G. Knizia et al., J. Chem. Phys. 130, 054104 (2009)], the aug-cc-pVQ(+d)Z DLPNO-CCSD(T)F12¯ yielded a RMSD of ∼0.4 kcal/mol with respect to the CBS CCSD(T) estimate.

Kumar, Ashutosh (ORCID:0000000175896030)↗

Enhancing the accuracy of density functional tight binding models through ChIMES many-body interaction potentials

Semi-empirical quantum models such as Density Functional Tight Binding (DFTB) are attractive methods for obtaining quantum simulation data at longer time and length scales than possible with standard approaches. However, application of these models can require lengthy effort due to the lack of a systematic approach for their development. In this work, we discuss the use of the Chebyshev Interaction Model for Efficient Simulation (ChIMES) to create rapidly parameterized DFTB models, which exhibit strong transferability due to the inclusion of many-body interactions that might otherwise be inaccurate. We apply our modeling approach to silicon polymorphs and review previous work on titanium hydride. We also review the creation of a general purpose DFTB/ChIMES model for organic molecules and compounds that approaches hybrid functional and coupled cluster accuracy with two orders of magnitude fewer parameters than similar neural network approaches. In all cases, DFTB/ChIMES yields similar accuracy to the underlying quantum method with orders of magnitude improvement in computational cost. In conclusion, our developments provide a way to create computationally efficient and highly accurate simulations over varying extreme thermodynamic conditions, where physical and chemical properties can be difficult to interrogate directly, and there is historically a significant reliance on theoretical approaches for interpretation and validation of experimental results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Distributed out-of-memory NMF on CPU/GPU architectures

We propose an efficient distributed out-of-memory implementation of the non-negative matrix factorization (NMF) algorithm for heterogeneous high-performance-computing systems. The proposed implementation is based on prior work on NMFk, which can perform automatic model selection and extract latent variables and patterns from data. In this work, we extend NMFk by adding support for dense and sparse matrix operation on multi-node, multi-GPU systems. The resulting algorithm is optimized for out-of-memory problems where the memory required to factorize a given matrix is greater than the available GPU memory. Memory complexity is reduced by batching/tiling strategies, and sparse and dense matrix operations are significantly accelerated with GPU cores (or tensor cores when available). Input/output latency associated with batch copies between host and device is hidden using CUDA streams to overlap data transfers and compute asynchronously, and latency associated with collective communications (both intra-node and inter-node) is reduced using optimized NVIDIA Collective Communication Library (NCCL) based communicators. Benchmark results show significant improvement, from 32X to 76x speedup, with the new implementation using GPUs over the CPU-based NMFk. Good weak scaling was demonstrated on up to 4096 multi-GPU cluster nodes with approximately 25,000 GPUs when decomposing a dense 340 Terabyte-size matrix and an 11 Exabyte-size sparse matrix of density 10 -6 .

97 MATHEMATICS AND COMPUTING↗

Unconventional Error Cancellation Explains the Success of Hartree–Fock Density Functional Theory for Barrier Heights

Energy barriers, which control the rates of chemical reactions, are seriously underestimated by computationally efficient semilocal approximations for the exchange-correlation energy. The accuracy of a semilocal density functional approximation is strongly boosted for reaction barrier heights by evaluating that approximation non-self-consistently on Hartree–Fock electron densities, which has been known for ~30 years. Here, the conventional explanation is that the Hartree–Fock theory yields the more accurate density. This work presents a benchmark Kohn–Sham inversion of accurate coupled-cluster densities for the reaction H 2 + F → HHF → H + HF and finds a strong, understandable cancellation between positive (excessively overcorrected) density-driven and large negative functional-driven errors (expected from stretched radical bonds in the transition state) within this Hartree–Fock density functional theory. This confirms earlier conclusions (Kaplan, A. D., et al. J. Chem. Theory Comput. 2023, 19, 532–543) based on 76 barrier heights and three less reliable, but less expensive, fully nonlocal density functional proxies for the exact density.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Affinity propagation clustering of full-field, high-spatial-dimensional measurements for robust output-only modal identification: A proof-of-concept study

Determination of the model order is a challenging problem in system identification, especially in output-only or operational modal identification where some modes are weakly excited. While existing methods such as the stabilization diagram method (spectral information) are effective, they do not scale to high-dimensional data, which is usually needed for high-fidelity characterization of structural dynamics and has been made available in the emerging full-field measurement techniques using optical methods such as photogrammetry and laser vibrometers. In this proof-of-concept study we present a new non-parametric, data-driven approach for robust output-only identification of high-spatial-dimensional modal parameters of basic structures by efficiently processing and interactively exploiting the full-field measurement (i.e., very dense spatial measurement points). Specifically, we first over-estimate the system model once, producing a pool of candidate modes associated with their modal frequencies and full-field, high-spatial-dimensional mode shapes. This is accomplished by a data-driven method termed affinity propagation clustering (APC), where the active clusters, which are the active modes in our formulations, emerge from the "message-passing" procedure and does not require a pre-determination of the cluster number (mode or model order). Next, rather than using the spectral information to distinguish the physical and spurious modes in the stabilization diagram method, we exploit and visualize the spatial, full-field mode shape associated with each candidate mode to do so. We conduct extensive experiments on basic structural models with comparisons to a few existing methods. The results indicate that the new method is computationally efficient for identifying high-spatial-dimensional modal parameters, and robust to identify weak modes by exploiting the full-field measurement. We also discuss its applicability and limitations for structures with complex geometry (shapes).

42 ENGINEERING↗

Visualization of hydraulic fracture using physics-informed clustering to process ultrasonic shear waves

Ultrasonic transmission is sensitive to the spatial variation in mechanical properties of materials due to the presence of cracks/fractures. Wave propagation through fractured media introduces changes in the frequency content, travel time and transmission coefficient of the wave. A workflow based on physics-informed unsupervised learning is developed to process the transmitted ultrasonic-shear waveforms to non-invasively visualize the geomechanical alterations due to hydraulic fracturing. Novelty of the work involves the assignment of both statistically consistent and physically consistent clusters to the measurements of shear waveforms acquired across the one axial and two frontal planes. Physically consistent/relevant information is incorporated by considering the travel time of the peak of spectral energy and transmission coefficient of the transmitted waveform. The proposed workflow generates maps of geomechanical alterations across the frontal and axial planes of the sample. The outputs of the workflow are in good agreement with independent techniques viz. acoustic emission and X-ray computed tomography. Finally, the proposed workflow can be adapted for improved fracture characterization in the subsurface when processing sonic-logging, cross-wellbore seismic or surface seismic waveform data.

42 ENGINEERING↗

Cross-kingdom expression of synthetic genetic elements promotes discovery of metabolites in the human microbiome

Small molecules encoded by biosynthetic pathways mediate cross-species interactions and harbor untapped potential, which has provided valuable compounds for medicine and biotechnology. Since studying biosynthetic gene clusters in their native context is often difficult, alternative efforts rely on heterologous expression, which is limited by host-specific metabolic capacity and regulation. Here, in this work, we describe a computational-experimental technology to redesign genes and their regulatory regions with hybrid elements for cross-species expression in Gram-negative and -positive bacteria and eukaryotes, decoupling biosynthetic capacity from host-range constraints to activate silenced pathways. These synthetic genetic elements enabled the discovery of a class of microbiome-derived nucleotide metabolites—tyrocitabines—from Lactobacillus iners. Tyrocitabines feature a remarkable orthoester-phosphate, inhibit translational activity, and invoke unexpected biosynthetic machinery, including a class of “Amadori synthases” and “abortive” tRNA synthetases. Our approach establishes a general strategy for the redesign, expression, mobilization, and characterization of genetic elements in diverse organisms and communities.

59 BASIC BIOLOGICAL SCIENCES↗

Towards complete assignment of the infrared spectrum of the protonated water cluster H + (H 2 O) 21

The spectroscopic features of protonated water species in dilute acid solutions have been long sought after for understanding the microscopic behavior of the proton in water with gas-phase water clusters H + (H 2 O) n extensively studied as bottom-up model systems. We present a new protocol for the calculation of the infrared (IR) spectra of complex systems, which combines the fragment-based Coupled Cluster method and anharmonic vibrational quasi-degenerate perturbation theory, and demonstrate its accuracy towards the complete and accurate assignment of the IR spectrum of the H + (H 2 O) 21 cluster. The site-specific IR spectral signatures reveal two distinct structures for the internal and surface four-coordinated water molecules, which are ice-like and liquid-like, respectively. The effect of inter-molecular interaction between water molecules is addressed, and the vibrational resonance is found between the O-H stretching fundamental and the bending overtone of the nearest neighboring water molecule. The revelation of the spectral signature of the excess proton offers deeper insight into the nature of charge accommodation in the extended hydrogen-bonding network underpinning this aqueous cluster.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

TX$^2$: Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration (Martindale & Stewart, 2021), or TX 2 software package, is a library designed for artificial intelligence researchers to better understand the performance of transformer models (Vaswani et al., 2017) used for sequence classification. The tool is capable of integrating with a trained transformer model and a dataset split into training and testing populations to produce an ipywidget (Project Jupyter Contributors, 2021) dashboard with a number of visualizations to understand model performance with an emphasis on explainability and interpretability. The TX 2 package is primarily intended to integrate into a workflow centered around Jupyter Notebooks (Kluyver et al., 2016), and currently assumes the use of PyTorch (Paszke et al., 2019) and Hugging Face transformers library (Wolf et al., 2020). The dashboard includes visualization and data exploration features to aid researchers, including an interactive UMAP embedding graph (McInnes et al., 2018) to understand classification clusters, a word salience map that can be updated as researchers alter textual entries in near real time, a set of tools to understand word frequency and importance based on the clusters in the UMAP embedding graph, and a set of traditional confusion matrix analysis tools.

97 MATHEMATICS AND COMPUTING↗

Augmented Human Analysis (AHA)

Radio frequency (RF) signal monitoring generally emphasizes intentionally generated signals, such as WiFi, Bluetooth, or cellular transmissions. However, electronic devices also produce unintended radiated emissions (UREs), which could also be useful in RF spectrum analysis. In either case, deriving intelligence from RF signals is typically a human-intensive process requiring significant domain knowledge. In the Augmented Human Analysis (AHA) project, we investigate the utility of dimensionally aligned signal projection (DASP) and machine learning (ML) algorithms for accelerating RF analysis workflows. We find that while DASP algorithms can indeed highlight signal characteristics relevant for classification tasks, the choice of algorithmic hyperparameters greatly affects performance. To address this challenge, we evaluate the quality of DASP outputs using the silhouette score, which measures how well data points cluster; high silhouette scores indicate good clustering, and thus good hyperparameter values. This approach is critical for machine learning pipelines as the DASP parameters cannot be directly optimized during model training. By identifying good DASP parameters, and thus good DASP outputs, as a preprocessing step, we can decrease the amount of effort required for downstream ML model training. We demonstrate our workflow using a dataset of UREs from common household devices, showing that even without the aid of ML, proper selection of DASP parameters enables clustering by device type.

42 ENGINEERING↗

Polynomial Scaling Localized Active Space Unitary Selective Coupled Cluster Singles and Doubles

We present a polynomial-scaling algorithm for the localized active space unitary selective coupled cluster singles and doubles (LAS-USCCSD) method. In this approach, cluster excitations are selected based on a threshold ϵ determined by the absolute gradients of the LAS-UCCSD energy with respect to cluster amplitudes. Using the generalized Wick’s theorem for multireference wave functions, we derive the gradient expression as a polynomial function of one-, two-, and three-body reduced density matrices and 1- and 2-electron integrals, valid for any multireference wave function. The resulting gradient implementation exhibits a memory scaling of 𝒪(N 6 ), with N spin orbitals in the combined active space of all fragments. The variational quantum eigensolver is used to optimize the selected cluster excitations on a quantum simulator. Furthermore, by plotting the energy error, defined as the difference between the LAS-USCCSD and corresponding CASCI energies, against the inverse cluster amplitude selection threshold (ϵ –1 ) for polyene chains containing 2 to 5 π-bond units, we establish a relationship between the energy error and the threshold. To further validate the accuracy of LAS-USCCSD, we computed the cis–trans isomerization energy of stilbene (a 20-qubit system) and the magnetic coupling constant of the tris-hydroxo-bridged chromium dimer [Cr 2 (OH) 3 (NH 3 ) 6 ] 3+ (evaluated as both 12- and 20-qubit systems) using the Qiskit-Qulacs simulator. Assessing such examples is important to determine the practical feasibility of quantum simulations for chemically realistic systems. Toward this goal, with the LAS-USCCSD algorithm we estimated the quantum resources required for simulating an active space of (30e,22o) in [Cr 2 (OH) 3 (NH 3 ) 6 ] 3+ , a size that remains beyond the reach of current quantum simulators for accurate treatment.

Algorithms↗

Regional surrogates for predictive control of digital twins

Digital twins of complex systems must involve a model that is fast, generalizable, and usable for real-time control. For example, high-fidelity nonlinear multiphysics simulations can capture laser-material interactions, but are too slow for optimization or model predictive control (MPC). Reduced-order models, used to accelerate such computation, frequently fail to generalize to unseen inputs or control states. We show theoretically that this failure is intrinsic, i.e., that a learned model is non-unique outside the sampled subspace when its low-rank structure arises from limited excitation and clustered eigenvalues, rather than from a user-imposed truncation alone. Motivated by this result, we propose a control-ready regional surrogate-construction framework for both autonomous and nonautonomous dynamics; it employs Koopman lifting to represent nonlinearities, while preserving spatial locality. We illustrate our approach by constructing a control-ready surrogate for the digital twin of a thermal component of additive-manufacturing process. Our surrogate, localized in space through a von Neumann stencil, is learned from noisy high-fidelity simulations that emulate thermal-camera images collected during the manufacturing. It is linear in thermo-physically augmented states so that MPC reduces to a convex quadratic program. The surrogate requires no online correction, generalizes to unseen scan paths and power profiles of the laser, and is more than three orders of magnitude faster than a finite-difference solver. Furthermore, when the MPC sequence computed on the digital twin is applied to this solver, closed-loop temperature regulation is recovered, showing that the surrogate preserves control-relevant input-output behavior.

Data-driven model↗

A review on recent machine learning applications for imaging mass spectrometry studies

Imaging mass spectrometry (IMS) is a powerful analytical technique widely used in biology, chemistry, and materials science fields that continue to expand. IMS provides a qualitative compositional analysis and spatial mapping with high chemical specificity. The spatial mapping information can be 2D or 3D depending on the analysis technique employed. Due to the combination of complex mass spectra coupled with spatial information, large high-dimensional datasets (hyperspectral) are often produced. Therefore, the use of automated computational methods for an exploratory analysis is highly beneficial. The fast-paced development of artificial intelligence (AI) and machine learning (ML) tools has received significant attention in recent years. These tools, in principle, can enable the unification of data collection and analysis into a single pipeline to make sampling and analysis decisions on the go. There are various ML approaches that have been applied to IMS data over the last decade. Here, in this review, we discuss recent examples of the common unsupervised (principal component analysis, non-negative matrix factorization, k-means clustering, uniform manifold approximation and projection), supervised (random forest, logistic regression, XGboost, support vector machine), and other methods applied to various IMS datasets in the past five years. The information from this review will be useful for specialists from both IMS and ML fields since it summarizes current and representative studies of computational ML-based exploratory methods for IMS.

47 OTHER INSTRUMENTATION↗

The Effective Fragment Molecular Orbital Method: Achieving High Scalability and Accuracy for Large Systems

The effective fragment molecular orbital (EFMO) method has been developed to predict the total energy of a very large molecular system accurately (with respect to the underlying quantum mechanical method) and efficiently by taking advantage of the locality of strong chemical interactions and employing a two-level hierarchical parallelism. The accuracy of the EFMO method is partly attributed to the accurate and robust intermolecular interaction prediction between distant fragments, in particular, the many-body polarization and dispersion effects, which require the generation of static and dynamic polarizability tensors by solving the coupled perturbed Hartree–Fock (CPHF) and time-dependent HF (TDHF) equations, respectively. Solving the CPHF and TDHF equations is the main EFMO computational bottleneck due to the inefficient (serial) and I/O-intensive implementation of the CPHF and TDHF solvers. In this work, the efficiency and scalability of the EFMO method are significantly improved with a new CPU memory-based implementation for solving the CPHF and TDHF equations that are parallelized by either message passing interface (MPI) or hybrid MPI/OpenMP. Here, the accuracy of the EFMO method is demonstrated for both covalently bonded systems and noncovalently bound molecular clusters by systematically examining the effects of basis sets and a key distance-related cutoff parameter, R cut . R cut determines whether a fragment pair (dimer) is treated by the chosen ab initio method or calculated using the effective fragment potential (EFP) method (separated dimers). Decreasing the value of Rcut increases the number of separated (EFP) dimers, thereby decreasing the computational effort. It is demonstrated that excellent accuracy (<1 kcal/mol error per fragment) can be achieved when using a sufficiently large basis set with diffuse functions coupled with a small R cut value. With the new parallel implementation, the total EFMO wall time is substantially reduced, especially with a high number of MPI ranks. Given a sufficient workload, nearly ideal strong scaling is achieved for the CPHF and TDHF parts of the calculation. For the first time, EFMO calculations with the inclusion of long-range polarization and dispersion interactions on a hydrated mesoporous silica nanoparticle with explicit water solvent molecules (more than 15k atoms) are achieved on a massively parallel supercomputer using nearly 1000 physical nodes. In addition, EFMO calculations on the carbinolamine formation step of an amine-catalyzed aldol reaction at the nanoscale with explicit solvent effects are presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Numerical Simulations of Noisy Variational Quantum Eigensolver Ansatz Circuits

This is a case study of the variational quantum eigensolver (VQE) method using numerical simulations to test the influence of noise on the accuracy of the underlying circuit ansatz. We investigate a computational chemistry application of VQE to calculate the electronic ground state and its energy for Sodium Hydride (NaH), a prototypical two-electron problem. Using a one-parameter ansatz derived from unitary coupled cluster (UCC) theory, we simulate the effects of noise on the energy expectation value and variance with respect to the ansatz parameter. These numerical simulations provide insights into the accuracy of the prepared quantum state and the efficiency of the classical optimizer that iteratively refines the ansatz. We conduct a comparative study between analytical results derived for the UCC ansatz in the absence of noise and the noisy numerical simulation results obtained using an isotropic depolarizing noise model for each gate. We also compare the relative increase in noise on logically equivalent UCC ansatz circuits generated by randomized compiling. Notably, we observe that the intrinsic variance in the energy due to the simplicity of the ansatz itself compares with the noise induced by the bare circuit.

Gowrishankar, Meenambika↗

Identifying Genomic Islands with Deep Neural Networks

Background Horizontal gene transfer is the main source of adaptability for bacteria, through which genes are obtained from different sources including bacteria, archaea, viruses, and eukaryotes. This process promotes the rapid spread of genetic information across lineages, typically in the form of clusters of genes referred to as genomic islands (GIs). Different types of GIs exist, and are often classified by the content of their cargo genes or their means of integration and mobility. While various computational methods have been devised to detect different types of GIs, no single method is capable of detecting all types. Results We propose a method, which we call Shutter Island, that uses a deep learning model (Inception V3, widely used in computer vision) to detect genomic islands. The intrinsic value of deep learning methods lies in their ability to generalize. Via a technique called transfer learning, the model is pre-trained on a large generic dataset and then re-trained on images that we generate to represent genomic fragments. We demonstrate that this image-based approach generalizes better than the existing tools. Conclusions We used a deep neural network and an image-based approach to detect the most out of the correct GI predictions made by other tools, in addition to making novel GI predictions. The fact that the deep neural network was re-trained on only a limited number of GI datasets and then successfully generalized indicates that this approach could be applied to other problems in the field where data is still lacking or hard to curate.

Computer Vision↗