Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Synchronization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Geometric Verification of Dynamic Wave Arc Delivery With the Vero System Using Orthogonal X-ray Fluoroscopic Imaging

Purpose: The purpose of this study was to define an independent verification method based on on-board orthogonal fluoroscopy to determine the geometric accuracy of synchronized gantry–ring (G/R) rotations during dynamic wave arc (DWA) delivery available on the Vero system. Methods and Materials: A verification method for DWA was developed to calculate O-ring-gantry (G/R) positional information from ball-bearing positions retrieved from fluoroscopic images of a cubic phantom acquired during DWA delivery. Different noncoplanar trajectories were generated in order to investigate the influence of path complexity on delivery accuracy. The G/R positions detected from the fluoroscopy images (DetPositions) were benchmarked against the G/R angulations retrieved from the control points (CP) of the DWA RT plan and the DWA log files recorded by the treatment console during DWA delivery (LogActed). The G/R rotational accuracy was quantified as the mean absolute deviation ± standard deviation. The maximum G/R absolute deviation was calculated as the maximum 3-dimensional distance between the CP and the closest DetPositions. Results: In the CP versus DetPositions comparison, an overall mean G/R deviation of 0.13°/0.16° ± 0.16°/0.16° was obtained, with a maximum G/R deviation of 0.6°/0.2°. For the LogActed versus DetPositions evaluation, the overall mean deviation was 0.08°/0.15° ± 0.10°/0.10° with a maximum G/R of 0.3°/0.4°. The largest decoupled deviations registered for gantry and ring were 0.6° and 0.4° respectively. No directional dependence was observed between clockwise and counterclockwise rotations. Doubling the dose resulted in a double number of detected points around each CP, and an angular deviation reduction in all cases. Conclusions: An independent geometric quality assurance approach was developed for DWA delivery verification and was successfully applied on diverse trajectories. Results showed that the Vero system is capable of following complex G/R trajectories with maximum deviations during DWA below 0.6°.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Small Cell Carcinoma of the Urinary Bladder: A Retrospective, Multicenter Rare Cancer Network Study of 107 Patients

Purpose: Small cell carcinomas of the bladder (SCCB) account for fewer than 1% of all urinary bladder tumors. There is no consensus regarding the optimal treatment for SCCB. Methods and Materials: Fifteen academic Rare Cancer Network medical centers contributed SCCB cases. The eligibility criteria were as follows: pure or mixed SCC; local, locoregional, and metastatic stages; and age ≥18 years. The overall survival (OS) and disease-free survival (DFS) were calculated from the date of diagnosis according to the Kaplan-Meier method. The log-rank and Wilcoxon tests were used to analyze survival as functions of clinical and therapeutic factors. Results: The study included 107 patients (mean [±standard deviation, SD] age, 69.6 [±10.6] years; mean follow-up time, 4.4 years) with primary bladder SCC, with 66% of these patients having pure SCC. Seventy-two percent and 12% of the patients presented with T2-4N0M0 and T2-4N1-3M0 stages, respectively, and 16% presented with synchronous metastases. The most frequent curative treatments were radical surgery and chemotherapy, sequential chemotherapy and radiation therapy, and radical surgery alone. The median (interquartile range, IQR) OS and DFS times were 12.9 months (IQR, 7-32 months) and 9 months (IQR, 5-23 months), respectively. The metastatic, T2-4N0M0, and T2-4N1-3M0 groups differed significantly (P=.001) in terms of median OS and DFS. In a multivariate analysis, impaired creatinine clearance (OS and DFS), clinical stage (OS and DFS), a Karnofsky performance status <80 (OS), and pure SCC histology (OS) were independent and significant adverse prognostic factors. In the patients with nonmetastatic disease, the type of treatment (ie radical surgery with or without adjuvant chemotherapy vs conservative treatment) did not significantly influence OS or DFS (P=.7). Conclusions: The prognosis for SCCB remains poor. The finding that radical cystectomy did not influence DFS or OS in the patients with nonmetastatic disease suggests that conservative treatment is appropriate in this situation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

First Experience With Real-Time EPID-Based Delivery Verification During IMRT and VMAT Sessions

Purpose: Gantry-mounted megavoltage electronic portal imaging devices (EPIDs) have become ubiquitous on linear accelerators. WatchDog is a novel application of EPIDs, in which the image frames acquired during treatment are used to monitor treatment delivery in real time. We report on the preliminary use of WatchDog in a prospective study of cancer patients undergoing intensity modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT) and identify the challenges of clinical adoption. Methods and Materials: At the time of submission, 28 cancer patients (head and neck, pelvis, and prostate) undergoing fractionated external beam radiation therapy (24 IMRT, 4 VMAT) had ≥1 treatment fraction verified in real time (131 fractions or 881 fields). EPID images acquired continuously during treatment were synchronized and compared with model-generated transit EPID images within a frame time (∼0.1 s). A χ comparison was performed to cumulative frames to gauge the overall delivery quality, and the resulting pass rates were reported graphically during treatment delivery. Every frame acquired (500-1500 per fraction) was saved for postprocessing and analysis. Results: The system reported the mean ± standard deviation in real time χ 91.1% ± 11.5% (83.6% ± 13.2%) for cumulative frame χ analysis with 4%, 4 mm (3%, 3 mm) criteria, global over the integrated image. Conclusions: A real-time EPID-based radiation delivery verification system for IMRT and VMAT has been demonstrated that aims to prevent major mistreatments in radiation therapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Palliative Short-Course Radiation Therapy in Rectal Cancer: A Phase 2 Study

Purpose: The management of patients with symptomatic rectal cancer not amenable to curative treatment may be challenging. The aim of this phase 2 study was to evaluate the efficacy of short-course radiation therapy in patients with obstructing rectal cancer. Methods and Materials: Patients who were not candidates for surgical resection because of synchronous metastases, age, and/or comorbidities were considered eligible. The sample size was calculated based on the 2-stage design of Simon. Short-course radiation therapy was delivered with an isocentric 4-field box technique (total, 25 Gy; 5 fractions in 5 days). Chemotherapy was suspended during radiation treatment. Clinical outcome measures were symptomatic response rate, toxicity, colostomy-free survival, and overall survival. Results: From October 2003 to November 2012, 18 patients (median age, 77.5 years) were enrolled. The median follow-up was 11.5 months (range, 3-36 months). Four weeks after treatment, a complete response (ie, complete symptom resolution) was observed in 38.9% of patients and a partial response in 50.0% cases, whereas 11.1% had no response. The rates of reduction or resolution of pain and bleeding were 87.5% and 100%, respectively. The 1-, 2-, and 3-year colostomy-free survival rates were 100%, 71.4%, and 47.6%, respectively (median, 30 months). The 1-, 2-, and 3-year cumulative overall survival rates were 85.2%, 53%, and 39.8%, respectively (median, 25 months). No patients stopped treatment because of gastrointestinal or genitourinary toxicities: 38.9% of patients had grade 1 to 2 toxicity, and 16.7% had grade 3 toxicity. Only 1 patient had hematologic grade 2 toxicity, and 2 patients had grade 2 skin toxicity. Conclusions: Short-course radiation therapy may represent a safe and effective alternative treatment option in patients with obstructing rectal cancer not eligible for curative treatment, allowing colostomy to be avoided in a substantial proportion of patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Detection of surface water temperature variations of Mongolian lakes benefiting from the spatially and temporally gap-filled MODIS data

Lakes provide critical water resources for human activities and ecosystems, particularly in the Mongolian Plateau (MP), which is characterized by a dry climate and a harsh environment. As a region that is sensitive to anthropogenic warming, tracking lake surface water temperature (LSWT) changes in Mongolian lakes is crucial for understanding the consequences of a warming climate on lake ecosystems. However, the long-term monitoring of LSWT is restricted by the spatiotemporal gaps in the raw imagery of remote sensing-based land surface temperature (LST), e.g., the commonly used Moderate Resolution Imaging Spectroradiometer (MODIS) LST products. This study applied an improved gap-filling method by utilizing the discrete cosine transform-based penalized least squares (DCT-PLS) strategy in the spatial domain combined with the linear interpolation (LI) algorithm in the temporal domain. The method was applied to fill gaps in the LSWT imagery of 12 representative lakes across MP. The randomly sampled high-quality MODIS LSWT values in the spatial and temporal domains were excavated as false data gaps and considered “virtual true” validation datasets. The spatial validation results showed that the estimated LSWT for all the lake cases were comparable with the “virtual true” LSWT values, with the average values of the coefficient of determination, mean absolute error, mean square error, and root mean square error being 0.98, 0.38 °C, 0.45 °C, and 0.59 °C, respectively. Meanwhile, the error of nighttime LSWT results was relatively lower than that of daytime LSWT. For temporal interpolation validation, the LI algorithm exhibited relatively better performance and could more objectively indicate the variation in LSWT. Benefiting from the spatially and temporally well-constrained data, we analyzed the interannual and intra-annual change characteristics of the LSWTs of the 12 lakes. The long-term variations of annual and seasonal mean LSWTs in the 12 selected lakes exhibited no evident trends in 2000–2020, while presented apparent interannual fluctuations. The slight changes in the average LSWTs of the 12 selected lakes were in excellent synchronization with the surrounding LST derived from the reanalysis datasets, confirming the widely reported phenomenon of “global warming hiatus” that occurred in the early 21st century. This study improves the understanding of the LSWT variations in Mongolian lakes in response to global climate change. It has the potential to provide an effective approach for monitoring LSWT changes in other large-scale studies.

54 ENVIRONMENTAL SCIENCES↗

Achieving ultra-high bearing strength of tungsten nanoribbons in a transforming metal matrix

Nanowires (or nanoribbons) were identified as the most potential structural reinforcements for composites due to their ultrahigh strength, but it is difficult to transcribe their ultrahigh strength into the composite. Here, an in-situ W nanoribbbons-NiTi matrix composite was fabricated by mechanical reduction of a W-NiTi ingot, and the micromechanical deformation behavior was studied by in-situ high energy X-ray diffraction during tensile loading-unloading. It is revealed that the large elastic deformation of the W nanoribbons in a NiTi matrix is dictated by and synchronized with the martensitic transformation of the matrix. The bearing strength of the W nanoribbons, up to 11.6 GPa, was achieved in this composite. A significant load transfer took place from the matrix to the nanoribbons, exhibiting the characters of locality and rapidity. In conclusion, the stress fraction carried by the W nanoribbons with the volume fraction of 3% is up to 45% for the strength of the composite.

36 MATERIALS SCIENCE↗

A WENO-Limited, ADER-DT, Finite-Volume Scheme for Efficient, Robust, and Communication-Avoiding Multi-Dimensional Transport

The novel ADER-DT time discretization is applied to two-dimensional transport in a quadrature-free, WENO- and FCT-limited, Finite-Volume context. Emphasis is placed on (1) the serial and parallel computational properties of ADER-DT and this framework and (2) the flexibility of ADER-DT and this framework in efficiently balancing accuracy with other constraints important to transport applications. This study demonstrates a range of choices for the user when approaching their specific application while maintaining good parallel properties. In this method, genuine multi-dimensionality, single-step and single-stage time stepping, strict positivity, and a flexible range of limiting are all achieved with only one parallel synchronization and data exchange per time step. In terms of parallel data transfers per simulated time interval, this improves upon multi-stage time stepping and post-hoc filtering techniques such as hyperdiffusion. This method is evaluated with standard transport test cases over a range of limiting options to demonstrate quantitatively and qualitatively what a user should expect when employing this method in their application.

Norman, Matthew R↗

Sequential limiting in continuous and discontinuous Galerkin methods for the Euler equations

We present a new predictor-corrector approach to enforcing local maximum principles in piecewise-linear finite element schemes for the compressible Euler equations. The new element-based limiting strategy is suitable for continuous and discontinuous Galerkin methods alike. In contrast to synchronized limiting techniques for systems of conservation laws, we constrain the density, momentum, and total energy in a sequential manner which guarantees positivity preservation for the pressure and internal energy. After the density limiting step, the total energy and momentum gradients are adjusted to incorporate the irreversible effect of density changes. Antidiffusive corrections to bounds-compatible low-order approximations are limited to satisfy inequality constraints for the specific total and kinetic energy. An accuracy-preserving smoothness indicator is introduced to gradually adjust lower bounds for the element-based correction factors. The employed smoothness criterion is based on a Hessian determinant test for the density. Finally, a numerical study is performed for test problems with smooth and discontinuous solutions.

97 MATHEMATICS AND COMPUTING↗

The Elements of Life, Photosynthesis and Genomics

I am a Professor of Biochemistry, Biophysics and Structural Biology and Plant and Microbial Biology at the University of California in Berkeley. I was born and raised in India, emigrated to the United States to attend university, earning a B.S. in Molecular Biology and a Ph.D. in Biochemistry at the University of Wisconsin in Madison. Following post-doctoral studies with Lawrence Bogorad at Harvard University where I became interested in genetic control of trace element quotas, I joined the department of Chemistry and Biochemistry at UCLA. One of the first to appreciate essential trace metals as potential regulators of gene expression, I articulated the details of the nutritional Cu regulon in Chlamydomonas. In parallel, I used genetic approaches to discover the genes governing missing steps in tetrapyrrole metabolism, including the attachment of heme to apocytochromes in the thylakoid lumen and the factors catalyzing the formation of ring V in chlorophyll. After biochemistry and classical genetics, I embraced genomics, taking a leadership role on the Joint Genome Institute’s efforts on the Chlamydomonas genome and more recently, contributing to high quality assemblies of several genomes in the green algal radiation, and large transcriptomic and proteomic datasets — focusing on the diel metabolic cycle in synchronized cultures and acclimation to key environmental and nutritional stressors — that are well-used and appreciated by the community. Finally, a new venture in Berkeley is the promotion of Auxenochlorella protothecoides as the true “green yeast” and as a platform for engineering algae to produce useful bioproducts.

59 BASIC BIOLOGICAL SCIENCES↗

An Isotropic Chemical Shift-Chemical Shift Anisotropic Correlation Experiment Using Discrete Magic Angle Turning

An isotropic-anisotropic shift 2D correlation spectroscopy is introduced that combines the advantages of both magic angle turning (MAT) and magic angle hopping (MAH) technologies. In this new approach, denoted DMAT for "discrete magic angle turning", the sample rotates clockwise followed by an anticlockwise rotation of exactly the same amount with each rotation less or equal than 360 degrees but greater than 240 degrees, with the rotation speed being constant only for times related to the evolution dimension. This back and forth rotation is repeated and synchronized with a special radio frequency (RF) pulse sequence to produce an isotropic-anisotropic shift 2D correlation spectrum. For any spin-interaction of rank-2 such as chemical shift anisotropy, isotropic magnetic susceptibility interaction, and residual homonuclear dipolar interaction in biological fluid samples, the projection along the isotropic dimension is a high resolution spectrum. Since a less than 360 degrees sample rotation is involved, the design potentially allows for in situ control over physical parameters such as pressure, flow conditions, feed compositions, and temperature so that true in-situ NMR investigations can be carried out.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Double echo symmetry-based REDOR and RESPDOR pulse sequences for proton detected measurements of heteronuclear dipolar coupling constants

1 H{X} symmetry-based rotational echo double resonance pulse sequences (S-REDOR) and symmetry-based rotational echo saturation pulse double resonance (S-RESPDOR) solid-state NMR experiments have found widespread application for 1 H detected measurements of difference NMR spectra, dipolar coupling constants, and internuclear distances under conditions of fast magic angle spinning (MAS). In these experiments the supercycled $\text{R4}^2_1 (\text{SR4}^2_1)$ symmetry-based recoupling pulse sequence is typically applied to the 1 H spins to reintroduce heteronuclear dipolar couplings. However, the timing of $\text{SR4}^2_1$ and other symmetry-based pulse sequences must be precisely synchronized with the rotation of the sample, otherwise, the evolution of 1 H CSA and other interactions will not be properly refocused. For this reason, significant distortions are often observed in experimental dipolar dephasing difference curves obtained with S-REDOR or S-RESPDOR pulse sequences. Here we introduce a family of double echo (DE) S-REDOR/S-RESPDOR pulse sequences that function in an analogous manner to the recently introduced $t_1$-noise eliminated (TONE) family of dipolar heteronuclear multiple quantum coherence (D-HMQC) pulse sequences. Through numerical simulations and experiments the DE S-REDOR/S-RESPDOR sequences are shown to provide dephasing difference curves similar to those obtained with S-REDOR/S-RESPDOR. However, the DE sequences are more robust to the deviations of the MAS frequency from the ideal value that occurs during typical solid-state NMR experiments. In this work, the DE sequences are shown to provide more reliable 1 H detected dipolar dephasing difference curves for nuclei such as 15 N (with isotopic labelling), 183 W and 35 Cl. The double echo sequences are therefore recommended to be used in place of conventional S-REDOR/S-RESPDOR sequences for measurement of weak dipolar coupling constants and long-range distances.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Pedestal fueling simulations with a coupled kinetic plasma–kinetic neutral transport code

The simplified neutral transport routine in the guiding center ion–electron-neutral neoclassical PIC code XGC0 has been replaced by one that calls the Monte Carlo neutral transport code DEGAS2. This provides a more realistic treatment of neutral atoms in the tokamak edge plasma and allows detailed atomic physics and plasma–material interaction processes to be incorporated into the simulations. The spatial profile of the neutral particle source used in DEGAS2 is determined from the fluxes of XGC0 ions to the material surfaces, and DEGAS2 is run in a time dependent manner synchronized with XGC0. The kinetic plasma–kinetic neutral transport capability is demonstrated with example pedestal fueling simulations.

Materials Science↗

In-situ determination of strain during transient burst testing and the temperature dependence of Zircaloy-4 claddings

Understanding fuel system behavior during postulated loss-of-coolant accidents is pertinent for continued safe and efficient operation of light water reactors, particularly as higher burnups are being pursued and safety margins re-evaluated. Conventional mechanical models for the incumbent Zr alloys typically rely on the assumption that steady-state creep is the dominant fuel cladding response during transient accident conditions. To investigate this assumption, simulated accident burst testing was performed on Zircaloy-4 claddings with balloon behavior measured in-situ. Here, two distinct loading conditions were utilized during burst testing: (1) constant-gas-inventory where pressure was allowed to increase with temperature and (2) constant pressure. In-situ strains and strain rates were measured via 2-dimensional digital image correlation techniques and synchronized with temperature to determine deformation dependencies. The temperature dependence of strain rate was characterized by a two segment Arrhenius relationship, with a distinct transition between the high and low temperature/strain regimes. The average activation energy of the lower temperature/strain regime was 328 ± 25 kJ/mol, in agreement with the ~320 kJ/mol used for conventional LOCA models. However, the higher temperature/strain segment, which encompassed most of ballooning, showed increased activation energies as well as a dependence on whether the burst region was in view. For tests that burst away from the camera view, the average high temperature/strain segment activation energy was 635 ± 150 kJ/mol. For samples where the rupture opening formed in view, the average activation energy was 1015 ± 179 kJ/mol. This observed shift in temperature dependence indicates a transition in deformation mechanism at the end of life, possibly to time independent failure mechanisms, which has not yet been visualized in the literature for Zr alloys. Parameters at the transition points were analyzed to determine thresholds for this change in behavior, which occurred at an average hoop strain of 6.9 ± 2.1 %.

36 MATERIALS SCIENCE↗

Optimizing the hypre solver for manycore and GPU architectures

The solution of large-scale combustion problems with codes such as Uintah on modern computer architectures requires the use of multithreading and GPUs to achieve performance. Uintah uses a low-Mach number approximation that requires iteratively solving a large system of linear equations. The Hypre iterative solver has solved such systems in a scalable way for Uintah, but the use of OpenMP with Hypre leads to at least slowdown due to OpenMP overheads. The proposed solution uses the MPI Endpoints within Hypre, where each team of threads acts as a different MPI rank. This approach minimizes OpenMP synchronization overhead and performs as fast or (up to 1.44) faster than Hypre's MPI-only version, and allows the rest of Uintah to be optimized using OpenMP. The profiling of the GPU version of Hypre shows the bottleneck to be the launch overhead of thousands of micro-kernels. The GPU performance was improved by fusing these micro-kernels and was further optimized by using Cuda-aware MPI, resulting in an overall speedup of 1.16—1.44 compared to the baseline GPU implementation. The above optimization strategies were published in the International Conference on Computational Science 2020 [1]. This work extends the previously published research by carrying out the second phase of communication-centered optimizations in Hypre to improve its scalability on large-scale supercomputers. Additionally, this includes an efficient non-blocking inter-thread communication scheme, communication-reducing patch assignment, and expression of logical communication parallelism to a new version of the MPICH library that utilizes the underlying network parallelism [2]. The above optimizations avoid communication bottlenecks previously observed during strong scaling and improve performance by up to 2 on 256 nodes of Intel Knight's Landing processor.

97 MATHEMATICS AND COMPUTING↗

Physics-aware adaptive checkpointing with shadow systems for nonlinear PDE simulations

Large-scale simulations of nonlinear partial differential equations (PDEs) that exhibit strongly transient behavior and pattern-forming dynamics produce enormous amounts of data, which, even with modern storage systems, cannot be stored for later curation. Current I/O strategies either write dense time series of snapshots, which is often prohibitive in I/O and storage, or store a few checkpoints that enable restart but incur expensive recomputation cost and provide no control over post-restart error growth, especially when lossy compression is used. Moreover, most, if not all, existing strategies take no account of the actual physical state of the system. Here, we present a simple physics-aware I/O framework in which a low-cost shadow system adaptively triggers lossy checkpoints when the shadow system deviates from the fine-scale simulation. The shadow system can be a coarsened replica of the fine-scale simulation that evolves concurrently. This means that checkpoints are taken based on the physical state of the system: fewer checkpoints are triggered when the system is quiescent while more are taken when the system undergoes a rapid change. This type of behavior is observed in many systems such as Brusselator and FitzHugh–Nagumo. We illustrate that our framework maintains stable restarts, keeps fine-scale restart errors bounded by shadow errors, and reconstructs the time history with significantly lower error and storage than interpolating fixed-interval snapshots, with low-cost shadow replay and modest online synchronization overhead.

Gong, Qian [ORNL] (ORCID:0000000235704142)↗

Efficient Heterogeneous Execution on Large Multicore and Accelerator Platforms: Case Study Using a Block Tridiagonal Solver

The algorithmic and implementation principles are explored in gainfully exploiting GPU accelerators in conjunction with multicore processors on high-end systems with large numbers of compute nodes, and evaluated in an implementation of a scalable block tridiagonal solver. The accelerator of each compute node is exploited in combination with multicore processors of that node in performing block-level linear algebra operations in the overall, distributed solver algorithm. Optimizations incorporated include: (1) an efficient memory mapping and synchronization interface to minimize data movement, (2) multi-process sharing of the accelerator within a node to obtain balanced load with multicore processors, and (3) an automatic memory management system to efficiently utilize accelerator memory when sub-matrices spill over the limits of device memory. Results are reported from our novel implementation that uses MAGMA and CUBLAS accelerator software systems simultaneously with ACML for multithreaded execution on processors. Overall, using 940 nVidia Tesla X2090 accelerators and 15,040 cores, the best heterogeneous execution delivers a 10.9-fold reduction in run time relative to an already efficient parallel multicore-only baseline implementation that is highly optimized with intra-node and inter-node concurrency and computation-communication overlap. Detailed quantitative results are presented to explain all critical runtime components contributing to hybrid performance.

Park, Alfred J↗

Cross-scale efficient tensor contractions for coupled cluster computations through multiple programming model backends

Coupled-cluster methods provide highly accurate models of molecular structure through explicit numerical calculation of tensors representing the correlation between electrons. These calculations are dominated by a sequence of tensor contractions, motivating the development of numerical libraries for such operations. While based on matrix–matrix multiplication, these libraries are specialized to exploit symmetries in the molecular structure and in electronic interactions, and thus reduce the size of the tensor representation and the complexity of contractions. The resulting algorithms are irregular and their parallelization has been previously achieved via the use of dynamic scheduling or specialized data decompositions. We introduce our efforts to extend the Libtensor framework to work in the distributed memory environment in a scalable and energy-efficient manner. We achieve up to 240× speedup compared with the optimized shared memory implementation of Libtensor. We attain scalability to hundreds of thousands of compute cores on three distributed-memory architectures (Cray XC30 and XC40, and IBM Blue Gene/Q), and on a heterogeneous GPU-CPU system (Cray XK7). As the bottlenecks shift from being compute-bound DGEMM's to communication-bound collectives as the size of the molecular system scales, we adopt two radically different parallelization approaches for handling load-imbalance, tasking and bulk synchronous models. Nevertheless, we preserve a unified interface to both programming models to maintain the productivity of computational quantum chemists.

97 MATHEMATICS AND COMPUTING↗