Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parallelism”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Utilizing ensemble learning for performance and power modeling and improvement of parallel cancer deep learning CANDLE benchmarks

Abstract Machine learning (ML) continues to grow in importance across nearly all domains in modeling to learn from data. Often a tradeoff exists between a model's ability to minimize bias and variance. In this article, we utilize ensemble learning to combine linear, nonlinear, and tree‐/rule‐based ML methods to cope with the bias‐variance tradeoff and result in more accurate models. We use the datasets collected for two parallel cancer deep learning CANDLE benchmarks, NT3 and P1B2, to build performance and power models based on hardware performance counters using single‐object and multiple‐objects ensemble learning to identify the most important counters for improvement on the Cray XC40 Theta at Argonne National Laboratory. Based on the insights from these models, we improve the performance and energy of P1B2 and NT3 by optimizing the deep learning environments TensorFlow, Keras, Horovod, and Python under the huge page size of 8 MB. Experimental results show that ensemble learning not only produces more accurate models but also provides more robust performance counter ranking. We achieve up to 61.15% performance improvement and up to 62.58% energy saving for P1B2 and up to 55.81% performance improvement and up to 52.60% energy saving for NT3 on up to 24,576 cores.

Wu, Xingfu↗

Parallel domain decomposition method for finite element approximation of 3D steady state non‐Newtonian fluids

Summary We introduce a stabilized finite element method for the 3D non‐Newtonian Navier–Stokes equations and a parallel domain decomposition method for solving the sparse system of nonlinear equations arising from the discretization. Non‐Newtonian flow problems are, generally speaking, more challenging than Newtonian flows because the nonlinearities are not only in the convection term but also in the viscosity term, which depends on the shear rate. Many good iterative methods and preconditioning techniques that work well for the Newtonian flows do not work well for the non‐Newtonian flows. We employ a Galerkin/least squares finite element method, with stabilization parameters adjusted to count the non‐Newtonian effect, to discretize the equations, and the resulting highly nonlinear system of equations is solved by a Newton–Krylov–Schwarz algorithm. In this study, we apply the proposed method to some inelastic power‐law fluid flows through the eccentric annuli with inner cylinder rotation and investigate the robustness of the method with respect to some physical parameters, including the power‐law index and the Reynolds number ratios. We then report the superlinear speedup achieved by the domain decomposition algorithm on a computer with up to 512 processors. Copyright © 2015 John Wiley & Sons, Ltd.

Shiu, Wen‐Shin↗

Strong parallel evidence of selection during switchgrass sward establishment in hybrid and lowland ecotypes

Switchgrass sward establishment results in up to 90% seedling mortality. The degree of selection during sward establishment has not been reported using modern genetic methods. Pooled leaf samples were sequenced from replicated swards of 46 half-sib families from two breeding groups (lowland and hybrid) before and through 3 years of stand establishment. Pooled allele frequencies were then assessed using fixation indices (Fst) and an independent data set was used to predict the polygenic impact of establishment selection on two traits (heading date and winter survivorship). Last, the DNA pools were assigned survival rankings to predict the sward survival genomically estimated breeding values within the training data set. Strong and parallel selection occured in both breeding groups. Five genomic regions exceeded the significant threshold of 99.9% in >10 families, indicating consistent selection across families and breeding groups. Polygenic trait predictions determined that establishment selection was partially associated with winter survivorship but resulted in variable heading date alterations. The genomewide variation is consistent with selection for a small number of related parental lines. This study observed strong selection for a small number of hybrid and coastal ecotype individuals which are promising germplasm sources for improved sward survival. This confirms prior reports of sward selection during grassland establishment and highlights the strength of pooled DNA sequencing for survival traits.

54 ENVIRONMENTAL SCIENCES↗

SIESTA-SIPs: Massively parallel spectrum-slicing eigensolver for an ab initio molecular dynamics package

Integration of Shift-and-Invert Parallel spectral transformation (SIPs) eigensolver (as implemented in the SLEPc library) into an ab initio molecular dynamics package, SIESTA, is described. The effectiveness of the code is demonstrated on applications to polyethylene chains, boron nitride sheets, and bulk water clusters. For problems with the same number of orbitals, the performance of the SLEPc eigensolver depends on the sparsity of the matrices involved, favoring reduced dimensional systems such as polyethylene or boron nitride sheets in comparison to bulk systems like water clusters. For all problems investigated, performance of SIESTA-SIPs exceeds the performance of SIESTA with default solver (ScaLAPACK) at the larger number of cores and the larger number of orbitals. A method that improves the load-balance with each iteration in the self-consistency cycle by exploiting the emerging knowledge of the eigenvalue spectrum is demonstrated

ab initio↗

Valence : A Massively Parallel Implementation of the Variational Subspace Valence Bond Method

This work describes the software package, Valence, for the calculation of molecular energies using the variational subspace valence bond (VSVB) method. VSVB is an ab initio electronic structure method based on nonorthogonal orbitals. Important features of practical value include high parallel scalability, wave functions that can be constructed automatically by combining orbitals from previous calculations, and ground and excited states that can be modeled with a single configuration or determinant. Here, the open-source software package includes tools to generate wave functions, a database of generic orbitals, example input files, and a library build intended for integration with other packages. We also present the interface to an external software package, enabling the computation of optimized molecular geometries and vibrational frequencies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coupled‐cluster singles, doubles and perturbative triples with density fitting approximation for massively parallel heterogeneous platforms

Abstract A high‐performance implementation of the coupled‐cluster singles, doubles, and perturbative triples [CCSD(T)] is developed in the Massively Parallel Quantum Chemistry program. Novel features include: (1) reduced memory requirements via a density‐fitting (DF) CCSD implementation utilizing distributed lazy evaluation for tensors with more than two unoccupied indices and (2) the ability to utilize efficiently many‐core nodes (Intel Xeon Phi) and heterogeneous nodes with multiple NVIDIA GPUs on each node. All data that are greater than quadratic in the system size are distributed among processes. Excellent strong scaling is observed on distributed‐memory computers equipped with conventional CPUs, Intel Xeon Phi processors, and heterogeneous nodes with multiple NVIDIA GPUs Canonical CCSD(T) energies can be evaluated for systems containing 200 electrons and 1000 basis functions in a few days using a small size commodity cluster, with even larger computations possible on leadership‐class computing resources.

Peng, Chong↗

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗

Performance Characterization of De Novo Genome Assembly on Leading Parallel Systems.

De novo genome assembly is one of the most important and challenging computational problems in modern genomics; further, it shares algorithms and communication patterns important to other graph analytic and irregular applications. Unlike simulations, it has no floating point arithmetic and is dominated by small memory transactions within and between computing nodes. In this work, we focus on the highly scalable HipMer assembler and identify the dominant algorithms and communication patterns, also using microbenchmarks to capture the workload. We evaluate HipMer on a variety of platforms from the latest HPC systems to ethernet clusters. HipMer performs well on all single node systems, including the Xeon Phi manycore architecture. Given large enough problems, it also demonstrates excellent scaling across nodes in an HPC system, but requires a high speed network with low overhead and high injection rates. Our results shed light on the architectural features that are most important for achieving good parallel efficiency on this and related problems.

Ellis, Marquita↗

Magnetic resonance cholangiopancreatography using optimized integrated combination with parallel imaging and compressed sensing technique

Purpose: To assess the combined parallel imaging (PI) and optimized integrated compressed sensing technique (prototype Compressed SENSE) for magnetic resonance cholangiopancreatography (MRCP) compared with conventional MRCP. Methods: This prospective study was approved by our Institutional Review Board, and all patients provided written informed consent. A total of 56 consecutive patients (27 men and 29 women; mean age 67.2 years) underwent breath-hold three-dimensional (3D) MRCP with PI alone (BH-MRCP; acquisition time, 23 s), respiratory-triggered 3D MRCP with PI alone (RT-MRCP; 201 s) and respiratory-triggered 3D MRCP with Compressed SENSE (RT-MRCPcs; 45 s). Relative duct-to-periductal contrast ratios (RCs) of the pancreaticobiliary ducts were calculated for quantitative image analyses. Two radiologists graded the visibility of the pancreaticobiliary ducts, pancreatic cystic lesion, motion artifact, and overall image quality using a five-point rating scale for qualitative image analyses. Theses qualitative and quantitative measurements were then compared among the three sequences. Results: RCs of the common bile duct, right hepatic duct (RHD), left hepatic duct (LHD), and main pancreatic duct at the pancreatic head, body, and tail segments, were significantly higher RT-MRCP, followed by RT-MRCPcs and BH-MRCP (P < 0.001). The visibility of the peripheral RHD and LHD was slightly better in RT-MRCP than in RT-MRCPcs and BH-MRCP (P < 0.001). The visibility of other pancreaticobiliary ducts, pancreatic cystic lesion, motion artifact, and overall image quality were almost comparable among three sequences. Conclusion: The acquisition time was markedly reduced in RT-MRCPcs compared with conventional RT-MRCP while there were significant differences in both quantitative and qualitative analyses, the differences were small enough that the reduced acquisition time makes up for it.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Component-based workflows for parallel thermomechanical analysis of arrayed geometries

Component-based simulation workflows can increase the agility of the design process by streamlining adaptation of new simulation methods. Here, we present one such workflow for parallel unstructured mesh-based simulations and demonstrate its usefulness in the thermomechanical analysis of an array of solder joints used in microelectronics fabrication. We automate the simulation process from problem specification to the solution of the underlying PDEs, including problem setup, domain definition, and mesh generation. We establish the utility of the proposed approach by demonstrating that qualitatively different stress concentrations are seen in solder joints near the center of such an array and a solder joint seen at the edge of the same array.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Anticipating gelation and vitrification with medium amplitude parallel superposition (MAPS) rheology and artificial neural networks

Abstract Anticipating qualitative changes in the rheological response of complex fluids (e.g., a gelation or vitrification transition) is an important capability for processing operations that utilize such materials in real-world environments. One class of complex fluids that exhibits distinct rheological states are soft glassy materials such as colloidal gels and clay dispersions, which can be well characterized by the soft glassy rheology (SGR) model. We first solve the model equations for the time-dependent, weakly nonlinear response of the SGR model. With this analytical solution, we show that the weak nonlinearities measured via medium amplitude parallel superposition (MAPS) rheology can be used to anticipate the rheological aging transitions in the linear response of soft glassy materials. This is a rheological version of a technique called structural health monitoring used widely in civil and aerospace engineering. We design and train artificial neural networks (ANNs) that are capable of quickly inferring the parameters of the SGR model from the results of sequential MAPS experiments. The combination of these data-rich experiments and machine learning tools to provide a surrogate for computationally expensive viscoelastic constitutive equations allows for rapid experimental characterization of the rheological state of soft glassy materials. We apply this technique to an aging dispersion of Laponite ® clay particles approaching the gel point and demonstrate that a trained ANN can provide real-time detection of transitions in the nonlinear response well in advance of incipient changes in the linear viscoelastic response of the system.

Lennon, Kyle R. (ORCID:0000000212515461)↗

An asynchronous parallel high-throughput model calibration framework for crystal plasticity finite element constitutive models

Crystal plasticity finite element model (CPFEM) is a powerful numerical simulation in the integrated computational materials engineering toolboxes that relates microstructures to homogenized materials properties and establishes the structure–property linkages in computational materials science. However, to establish the predictive capability, one needs to calibrate the underlying constitutive model, verify the solution and validate the model prediction against experimental data. Bayesian optimization (BO) has stood out as a gradient-free efficient global optimization algorithm that is capable of calibrating constitutive models for CPFEM. Here in this paper, we apply a recently developed asynchronous parallel constrained BO algorithm to calibrate phenomenological constitutive models for stainless steel 304 L, Tantalum, and Cantor high-entropy alloy.

304L stainless steel↗

Modeling the Control Systems of Gas-Turbines to Ensure Their Reliable Parallel Operation in the UPS of Russia

Consideration is given to different approaches to modeling the control systems of gas turbines as a component of CCPP and GTPP to ensure their reliable parallel operation in the UPS of Russia. The disadvantages of the approaches to the modeling of combined-cycle units in studying long-term electromechanical transients accompanied by power imbalance are pointed out. Examples are presented to support the use of more detailed models of gas turbines in electromechanical transient calculations. It is shown that the modern speed control systems of gas turbines in combination with relatively low equivalent inertia have a considerable effect on electromechanical transients, including those caused by disturbances not related to power imbalance.

42 ENGINEERING↗

New gauge fields from extension of space time parallel transport of vector spaces to the underlying number systems.

One way of describing gauge theories in physics is to assign a vector space {bar V}{sub x} to each space time point x. For each x the field {psi} takes values {psi}(x) in {bar V}{sub x}. The freedom to choose a basis in each {bar V}{sub x} introduces gauge group operators and their Lie algebra representations to define parallel transformations between vector spaces. This paper is an exploration of the extension of these ideas to include the underlying scalar complex number fields. Here a Hilbert space, {bar H}{sub x}, as an example of {bar V}{sub x}, and a complex number field, {bar C}{sub x}, are associated with each space time point. The freedom to choose a basis in {bar H}{sub x} is expanded to include the freedom to choose complex number fields. This expansion is based on the discovery that there exist representations of complex (and other) number systems that differ by arbitrary scale factors. Compensating changes must be made in the basic field operations so that the relevant axioms are satisfied. This results in the presence of a new real valued gauge field A(x). Inclusion of A(x) into covariant derivatives in Lagrangians results in the description of A(x) as a gauge boson for which mass is optional. The great accuracy of QED suggests that the coupling constant of A(x) to matter fields is very small compared to the fine structure constant. Other physical properties of A(x) are not known at present.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Large-scale optimization-based non-negative computational framework for diffusion equations: Parallel implementation and performance studies

It is well-known that the standard Galerkin formulation, which is often the formulation of choice under the finite element method for solving self-adjoint diffusion equations, does not meet maximum principles and the non-negative constraint for anisotropic diffusion equations. Recently, optimization-based methodologies that satisfy maximum principles and the non-negative constraint for steady-state and transient diffusion-type equations have been proposed. To date, these methodologies have been tested only on small-scale academic problems. The purpose of this paper is to systematically study the performance of the non-negative methodology in the context of high performance computing (HPC). PETSc and TAO libraries are, respectively, used for the parallel environment and optimization solvers. For large-scale problems, it is important for computational scientists to understand the computational performance of current algorithms available in these scientific libraries. The numerical experiments are conducted on the state-of-the-art HPC systems, and a single-core performance model is used to better characterize the efficiency of the solvers. Furthermore, our studies indicate that the proposed non-negative computational framework for diffusion-type equations exhibits excellent strong scaling for real-world large-scale problems.

97 MATHEMATICS AND COMPUTING↗

Role of Interactions and Correlations on Collective Dynamics of Molecular Motors Along Parallel Filaments

Cytoskeletal motors known as motor proteins are molecules that drive cellular transport along several parallel cytoskeletal filaments and support many biological processes. Experimental evidences suggest that they interact with the nearest molecules of their filament while performing any mechanical work. These interactions modify the microscopic level properties of motor proteins. In this work, a new version of two-channel totally asymmetric simple exclusion process, that incorporates the intra-channel interactions in a thermodynamically consistent way, is proposed. As the existing approaches for multi-channel systems deviate from analyzing the combined effect of inter and intra-channel interactions, a new approach known as modified vertical cluster mean field is developed. The approach along with Monte Carlo simulations successfully encounters some correlations and computes the complex dynamic properties of the system. Role of symmetry of interactions and inter-channel coupling is observed on the phase diagrams, maximal particle current and its corresponding optimal interaction strength. Surprisingly, for all values of coupling rate and most of the interaction splittings, the optimal interaction strength corresponding to maximal current belongs to the case of weak repulsive interactions. Moreover, for weak interaction splittings and with an increase in the coupling rate, the optimal interaction strength tends towards the known experimental results. The effect of coupling as well as interaction energy is also measured for correlations. They are found to be short-range and weaker for repulsive and weak attractive interactions while they are long-range and stronger for large attractions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Two-Dimensional Problem of Thermoelasticity for a Half Space in the Presence of Heat Release in a Ribbon-Shaped Domain Parallel to its Boundary

Using a logarithmic single-layer potential, thermoelastic displacement potential, Airy stress function, and Boussinesq function, we solve two-dimensional problems of stationary heat conduction and thermoelasticity under the conditions of plane deformation of a semiinfinite body in the presence of heat release in a ribbon-shaped domain parallel to its boundary (in this domain, either a temperature or a heat flux is given). The boundary of the body is kept at temperature equal to zero. We study the distribution of stresses in the domain of heat release with given heat sources of constant intensity at constant temperature.

42 ENGINEERING↗

Experimental and numerical analysis of parallel reactant flow and transverse mixing with mineral precipitation in homogeneous and heterogeneous porous media

Formation of mineral precipitates in the mixing interface between two reactant solutions flowing in parallel in porous media is governed by reactant mixing by diffusion and dispersion and is coupled to changes in porosity/permeability due to precipitation. The spatial and temporal distribution of mixing-dependent precipitation of barium sulfate in porous media was investigated with side-by-side injection of barium chloride and sodium sulfate solutions in thin rectangular flow cells packed with quartz sand. The results for homogeneous sand beds were compared to beds with higher or lower permeability inclusions positioned in the path of the mixing zone. In the homogeneous and high permeability inclusion experiments, BaSO 4 precipitate (barite) formed in a narrow deposit along the length and in the center of the solution–solution mixing zone even though dispersion was enhanced within, and downstream of, the high permeability inclusion. In the low permeability inclusion experiment, the deflected BaSO 4 precipitation zone broadened around one side and downstream of the inclusion and was observed to migrate laterally toward the sulfate solution. A continuum-scale fully coupled reactive transport model that simultaneously solves the nonlinear governing equations for fluid flow, transport of reactants and geochemical reactions was used to simulate the experiments and provide insight into mechanisms underlying the experimental observations. Lastly, migration of the precipitation zone in the low permeability inclusion experiment could be explained by the coupling effects among fluid flow, reactant transport and localized mineral precipitation reaction.

54 ENVIRONMENTAL SCIENCES↗