Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework

Most high-end computers adopt hybrid architecture, porting a large-scale scientific code onto accelerators is necessary. The paper presents a generic method for porting large-scale scientific code onto accelerators using compiler directives within a modularized function unit test platform. We have implemented the method and designed a software tool (SPEL) to port the E3SM Land Model (ELM) onto the GPUs in the Summit computer. SPEL automatically generates GPU-ready test modules for all ELM functions, such as CanopyFlux, SoilTemperature, and EcosystemDynamics. SPEL breaks the ELM into a collection of standalone unit test programs for easy code verification and further performance improvement. We further optimize several ELM test modules with advanced techniques, including memory reduction, reconstructed parallel loops, and asynchronous GPU kernel launch. We hope our study will inspire new toolkit developments that expedite large-scale scientific code porting with compiler directives.

Schwartz, Peter↗
DOE OSTI2015

High-accuracy Aspheric X-ray Mirror Metrology Using Software Configurable Optical Test System/deflectometry

The Software Configurable Optical Test System (SCOTS) uses deflectometry to measure surface slopes of general optical shapes without the need for additional null optics. Careful alignment of test geometry and calibration of inherent system error improve the accuracy of SCOTS to a level where it competes with interferometry. We report a SCOTS surface measurement of an off-axis superpolished elliptical x-ray mirror that achieves <1 nm<1 nm root-mean-square accuracy for the surface measurement with low-order term included.

42 ENGINEERING↗
DOE OSTI2014

ARCHER{sub RT} – A GPU-based and photon-electron coupled Monte Carlo dose computing engine for radiation therapy: Software development and application to helical tomotherapy

Purpose: Using the graphical processing units (GPU) hardware technology, an extremely fast Monte Carlo (MC) code ARCHER{sub RT} is developed for radiation dose calculations in radiation therapy. This paper describes the detailed software development and testing for three clinical TomoTherapy® cases: the prostate, lung, and head and neck. Methods: To obtain clinically relevant dose distributions, phase space files (PSFs) created from optimized radiation therapy treatment plan fluence maps were used as the input to ARCHER{sub RT}. Patient-specific phantoms were constructed from patient CT images. Batch simulations were employed to facilitate the time-consuming task of loading large PSFs, and to improve the estimation of statistical uncertainty. Furthermore, two different Woodcock tracking algorithms were implemented and their relative performance was compared. The dose curves of an Elekta accelerator PSF incident on a homogeneous water phantom were benchmarked against DOSXYZnrc. For each of the treatment cases, dose volume histograms and isodose maps were produced from ARCHER{sub RT} and the general-purpose code, GEANT4. The gamma index analysis was performed to evaluate the similarity of voxel doses obtained from these two codes. The hardware accelerators used in this study are one NVIDIA K20 GPU, one NVIDIA K40 GPU, and six NVIDIA M2090 GPUs. In addition, to make a fairer comparison of the CPU and GPU performance, a multithreaded CPU code was developed using OpenMP and tested on an Intel E5-2620 CPU. Results: For the water phantom, the depth dose curve and dose profiles from ARCHER{sub RT} agree well with DOSXYZnrc. For clinical cases, results from ARCHER{sub RT} are compared with those from GEANT4 and good agreement is observed. Gamma index test is performed for voxels whose dose is greater than 10% of maximum dose. For 2%/2mm criteria, the passing rates for the prostate, lung case, and head and neck cases are 99.7%, 98.5%, and 97.2%, respectively. Due to specific architecture of GPU, modified Woodcock tracking algorithm performed inferior to the original one. ARCHER{sub RT} achieves a fast speed for PSF-based dose calculations. With a single M2090 card, the simulations cost about 60, 50, 80 s for three cases, respectively, with the 1% statistical error in the PTV. Using the latest K40 card, the simulations are 1.7–1.8 times faster. More impressively, six M2090 cards could finish the simulations in 8.9–13.4 s. For comparison, the same simulations on Intel E5-2620 (12 hyperthreading) cost about 500–800 s. Conclusions: ARCHER{sub RT} was developed successfully to perform fast and accurate MC dose calculation for radiotherapy using PSFs and patient CT phantoms.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

SU-E-I-02: A Framework to Perform Batch Simulations of Computational Voxel Phantoms to Study Organ Doses in Computed Tomography Using a Commercial Monte Carlo Software Package

Purpose: ImpactMC (CT Imaging, Erlangen, Germany) is a Monte Carlo (MC) software package that offers a GPU enabled, user definable and validated method for 3D dose distribution calculations for radiography and Computed Tomography (CT). ImpactMC, in and of itself, offers limited capabilities to perform batch simulations. The aim of this work was to develop a framework for the batch simulation of absorbed organ dose distributions from CT scans of computational voxel phantoms. Methods: The ICRP 110 adult Reference Male and Reference Female computational voxel phantoms were formatted into compatible input volumes for MC simulations. A Matlab (The MathWorks Inc., Natick, MA) script was written to loop through a user defined set of simulation parameters and 1) generate input files required for the simulation, 2) start the MC simulation, 3) segment the absorbed dose for organs in the simulated dose volume and 4) transfer the organ doses to a database. A demonstration of the framework is made where the glandular breast dose to the adult Reference Female phantom, for a typical Chest CT examination, is investigated. Results: A batch of 48 contiguous simulations was performed with variations in the total collimation and spiral pitch. The demonstration of the framework showed that the glandular dose to the right and left breast will vary depending on the start angle of rotation, total collimation and spiral pitch. Conclusion: The developed framework provides a robust and efficient approach to performing a large number of user defined MC simulations with computational voxel phantoms in CT (minimal user interaction). The resulting organ doses from each simulation can be accessed through a database which greatly increases the ease of analyzing the resulting organ doses. The framework developed in this work provides a valuable resource when investigating different dose optimization strategies in CT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2015

SU-E-T-50: A Multi-Institutional Study of Independent Dose Verification Software Program for Lung SBRT

Purpose: The accuracy of dose distribution depends on treatment planning system especially in heterogeneity-region. The tolerance level (TL) of the secondary check using the independent dose verification may be variable in lung SBRT plans. We conducted a multi-institutional study to evaluate the tolerance level of lung SBRT plans shown in the AAPM TG114. Methods: Five institutes in Japan participated in this study. All of the institutes used a same independent dose verification software program (Simple MU Analysis: SMU, Triangle Product, Ishikawa, JP), which is Clarkson-based and CT images were used to compute radiological path length. Analytical Anisotropic Algorithm (AAA), Pencil Beam Convolution with modified Batho-method (PBC-B) and Adaptive Convolve (AC) were used for lung SBRT planning. A measurement using an ion-chamber was performed in a heterogeneous phantom to compare doses from the three different algorithms and the SMU to the measured dose. In addition to it, a retrospective analysis using clinical lung SBRT plans (547 beams from 77 patients) was conducted to evaluate the confidence limit (CL, Average±2SD) in dose between the three algorithms and the SMU. Results: Compared to the measurement, the AAA showed the larger systematic dose error of 2.9±3.2% than PBC-B and AC. The Clarkson-based SMU showed larger error of 5.8±3.8%. The CLs for clinical plans were 7.7±6.0 % (AAA), 5.3±3.3 % (AC), 5.7±3.4 % (PBC -B), respectively. Conclusion: The TLs from the CLs were evaluated. A Clarkson-based system shows a large systematic variation because of inhomogeneous correction. The AAA showed a significant variation. Thus, we must consider the difference of inhomogeneous correction as well as the dependence of dose calculation engine.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

A quantification of the effectiveness of EPID dosimetry and software-based plan verification systems in detecting incidents in radiotherapy

Purpose: Complex treatments in radiation therapy require robust verification in order to prevent errors that can adversely affect the patient. For this purpose, the authors estimate the effectiveness of detecting errors with a “defense in depth” system composed of electronic portal imaging device (EPID) based dosimetry and a software-based system composed of rules-based and Bayesian network verifications. Methods: The authors analyzed incidents with a high potential severity score, scored as a 3 or 4 on a 4 point scale, recorded in an in-house voluntary incident reporting system, collected from February 2012 to August 2014. The incidents were categorized into different failure modes. The detectability, defined as the number of incidents that are detectable divided total number of incidents, was calculated for each failure mode. Results: In total, 343 incidents were used in this study. Of the incidents 67% were related to photon external beam therapy (EBRT). The majority of the EBRT incidents were related to patient positioning and only a small number of these could be detected by EPID dosimetry when performed prior to treatment (6%). A large fraction could be detected by in vivo dosimetry performed during the first fraction (74%). Rules-based and Bayesian network verifications were found to be complimentary to EPID dosimetry, able to detect errors related to patient prescriptions and documentation, and errors unrelated to photon EBRT. Combining all of the verification steps together, 91% of all EBRT incidents could be detected. Conclusions: This study shows that the defense in depth system is potentially able to detect a large majority of incidents. The most effective EPID-based dosimetry verification is in vivo measurements during the first fraction and is complemented by rules-based and Bayesian network plan checking.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Collision prediction software for radiotherapy treatments

Purpose: This work presents a method of collision predictions for external beam radiotherapy using surface imaging. The present methodology focuses on collision prediction during treatment simulation to evaluate the clearance of a patient’s treatment position and allow for its modification if necessary. Methods: A Kinect camera (Microsoft, Redmond, WA) is used to scan the patient and immobilization devices in the treatment position at the simulator. The surface is reconstructed using the SKANECT software (Occipital, Inc., San Francisco, CA). The treatment isocenter is marked using simulated orthogonal lasers projected on the surface scan. The point cloud of this surface is then shifted to isocenter and converted from Cartesian to cylindrical coordinates. A slab models the treatment couch. A cylinder with a radius equal to the normal distance from isocenter to the collimator plate, and a height defined by the collimator diameter is used to estimate collisions. Points within the cylinder clear through a full gantry rotation with the treatment couch at 0° , while points outside of it collide. The angles of collision are reported. This methodology was experimentally verified using a mannequin positioned in an alpha cradle with both arms up. A planning CT scan of the mannequin was performed, two isocenters were marked in PINNACLE, and this information was exported to AlignRT (VisionRT, London, UK)—a surface imaging system for patient positioning. This was used to ensure accurate positioning of the mannequin in the treatment room, when available. Collision calculations were performed for the two treatment isocenters and the results compared to the collisions detected the room. The accuracy of the Kinect-Skanect surface was evaluated by comparing it to the external surface of the planning CT scan. Results: Experimental verification results showed that the predicted angles of collision matched those recorded in the room within 0.5°, in most cases (largest deviation −1.2°). The accuracy study for the Kinect-Skanect surface showed an average discrepancy between the CT external contour and the surface scan of 2.2 mm. Conclusions: This methodology provides fast and reliable collision predictions using surface imaging. The use of the Kinect-Skanect system allows for a comprehensive modeling of the patient topography including all the relevant anatomy and immobilization devices that may lead to collisions. The use of this tool at the treatment simulation stage may allow therapists to evaluate the clearance of a patient’s treatment position and optimize it before the planning CT scan is performed. This can allow for safer treatments for the patients due to better collision predictions and improved clinical workflow by minimizing replanning and resimulations due to unforeseen clearance issues.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-T-22: Clinical Implications When Using TG-186 (ACE) Heterogeneity Software

Purpose: The purpose of this study is to compare dosimetric calculations using traditional TG-43 formalism and Oncentra Brachy Advanced Collapsed cone Engine (ACE) TG-186 calculation algorithm in clinical setting. Methods: We analyzed dosimetry of four patients treated with accelerated partial breast irradiation using a multi-channel intracavitary device (SAVI). All patients were treated to 34 Gy in 10 fractions using a high-dose-rate (192) Ir source. The plans were designed and treated using the TG-43 model. ACE was used to assess the effect heterogeneity correction on various dosimetric parameters. Mass density was estimated using Hounsfield units. Results: Compared to TG-43 formalism, ACE estimated lower doses to targets and organs at risk. The mean difference was 19.8% (range 15.3–24.1%) for PTV-eval V200, 12.0% (range 9.7–17.7%) for PTV-eval V150, 4.3% (range 3.3–6.5%) for PTV-eval D95, 3.3% (range 1.4–5.4%) for PTV-eval D90, 5.4% (range 2.9–9.9%) for maximum rib dose, and 5.7% (2.4–7.4%) for maximum skin dose. There was no correlation between the magnitude of the difference and the PTV-eval volume, air volume, or tissue-applicator conformance. Conclusion: Based on our preliminary study, the TG-43 algorithm appears to overestimate the dose to targets and organs at risk when compared to the ACE TG-186 software. We hypothesize that air adjacent to the SAVI struts contributes to lack of scatter thereby contributing a significant difference in dose calculation when using ACE. We believe that ACE calculation provides a more realistic isodose distribution than TG-43. We plan to further investigate the impact of heterogeneity correction on brachytherapy planning for a wide variety of clinical scenarios, include skin, cervix/uterus, prostate, and lung.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-T-94: Plan2pdf - a Software Tool for Automatic Plan Report for Philips Pinnacle TPS

Purpose: To implement an automatic electronic PDF plan reporting tool for Philips Pinnacle treatment planning system (TPS) Methods: An electronic treatment plan reporting software is developed by us to enable fully automatic PDF report from Pinnacle TPS to external EMR programs such as MOSAIQ. The tool is named “plan2pdf”. plan2pdf is implemented using Pinnacle scripts, Java and UNIX shell scripts, without any external program needed. plan2pdf supports full auto-mode and manual mode reporting. In full auto-mode, with a single mouse click, plan2pdf will generate a detailed Pinnacle plan report in PDF format, which includes customizable cover page, Pinnacle plan summary, orthogonal views through each plan POI and maximum dose point, DRR for each beam, serial transverse views captured throughout the dose grid at a user specified interval, DVH and scorecard windows. The final PDF report is also automatically bookmarked for each section above for convenient plan review. The final PDF report can either be saved on a user specified folder on Pinnacle, or it can be automatically exported to an EMR import folder via a user configured FTP service. In manual capture mode, plan2pdf allows users to capture any Pinnacle plan by full screen, individual window or rectangular ROI drawn on screen. Furthermore, to avoid possible patients’ plan mix-up during auto-mode reporting, a user conflict check feature is included in plan2pdf: it prompts user to wait if another patient is being exported by plan2pdf by another user. Results: plan2pdf is tested extensively and successfully at our institution consists of 5 centers, 15 dosimetrists and 10 physicists, running Pinnacle version 9.10 on Enterprise servers. Conclusion: plan2pdf provides a highly efficient, user friendly and clinical proven platform for all Philips Pinnacle users, to generate a detailed plan report in PDF format for external EMR systems.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-T-367: Using PRIMO, a PENELOPE-Based Software, to Improve the Small Field Dosimetry of Linear Accelerators

Purpose: To calculate output correction factors for Varian Clinac 2100iX beams for seven small field detectors and use the values to determine the small field output factors for the linacs at Karolinska university hospital. Methods: Phase space files (psf) for square fields between 0.25cm and 10cm were calculated using the PENELOPE-based PRIMO software. The linac MC-model was tuned by comparing PRIMO-estimated and experimentally determined depth doses and lateral dose-profiles for 40cmx40cm fields. The calculated psf were used as radiation sources to calculate the correction factors of IBA and PTW detectors with the code penEasy/PENELOPE. Results: The optimal tuning parameters of the MClinac model in PRIMO were 5.4 MeV incident electron energy and zero energy spread, focal spot size and beam divergence. Correction factors obtained for the liquid ion chamber (PTW-T31018) are within 1% down to 0.5 cm fields. For unshielded diodes (IBA-EFD, IBA-SFD, PTW-T60017 and PTW-T60018) the corrections are up to 2% at intermediate fields (>1cm side), becoming down to −11% for fields smaller than 1cm. The shielded diode (IBA-PFD and PTW-T60016) corrections vary with field size from 0 to −4%. Volume averaging effects are found for most detectors in the presence of 0.25cm fields. Conclusion: Good agreement was found between correction factors based on PRIMO-generated psf and those from other publications. The calculated factors will be implemented in output factor measurements (using several detectors) in the clinic. PRIMO is a userfriendly general code capable of generating small field psf and can be used without having to code own linac geometries. It can therefore be used to improve the clinical dosimetry, especially in the commissioning of linear accelerators. Important dosimetry data, such as dose-profiles and output factors can be determined more accurately for a specific machine, geometry and setup by using PRIMO and having a MC-model of the detector used.

43 PARTICLE ACCELERATORS↗
DOE OSTI2016

SU-F-T-618: Evaluation of a Mono-Isocentric Treatment Planning Software for Stereotactic Radiosurgery of Multiple Brain Metastases

Purpose: To evaluate planning performance of an automated treatment planning software (BrainLAB; Elements) for stereotactic radiosurgery (SRS) of multiple brain metastases. Methods: Brainlab’s Multiple Metastases Elements (MME) uses single isocentric technique to treat up to 10 cranial planning target volumes (PTVs). The planning algorithm of the MME accounts for multiple PTVs overlapping with one another on the beam eyes view (BEV) and automatically selects a subset of all overlapping PTVs on each arc for sparing normal tissues in the brain. The algorithm also optimizes collimator angles, margins between multi-leaf collimators (MLCs) and PTVs, as well as monitor units (MUs) using minimization of conformity index (CI) for all targets. Planning performance was evaluated by comparing the MME-calculated treatment plan parameters with the same parameters calculated with the Volumetric Modulated Arc Therapy (VMAT) optimization on Varian’s Eclipse platform. Results: Figures 1 to 3 compare several treatment plan outcomes calculated between the MME and VMAT for 5 clinical multi-targets SRS patient plans. Prescribed target dose was volume-dependent and defined based on the RTOG recommendation. For a total number of 18 PTV’s, mean values for the CI, PITV, and GI were comparable between the MME and VMAT within one standard deviation (σ). However, MME-calculated MDPD was larger than the same VMAT-calculated parameter. While both techniques delivered similar maximum point doses to the critical cranial structures and total MU’s for the 5 patient plans, the MME required less treatment planning time by an order of magnitude compared to VMAT. Conclusion: The MME and VMAT produce similar plan qualities in terms of MUs, target dose conformation, and OAR dose sparing. While the selective use of PTVs for arc-optimization with the MME reduces significantly the total planning time in comparison to VMAT, the target dose homogeneity was also compromised due to its simplified inverse planning algorithm used.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-G-JeP2-06: Dosimetric and Workflow Evaluation of First Commercial Synthetic CT Software for Clinical Use in Pelvis

Purpose: evaluate a commercial synthetic CT (syn-CT) software for use in prostate radiotherapy Methods: Twenty prostate patients underwent CT and MR simulation scans in treatment position on a 3T Philips scanner. The MR protocol consisted of a T2w turbo spin-echo for soft tissue contrast, a 2D balanced-fast field echo (b-FFE) for fiducial identification, a dual-echo 3D FFE B0 map for distortion analysis and a 3D mDIXON FFE sequence to generate syn-CT. Two echoes are acquired during mDIXON scan, allowing water, fat, and in-phase images to be derived using the frequency shift of the fat and water protons. Tissues were classified as: air, adipose, water, trabecular/spongy bone and compact/cortical bone and assigned specific bulk HU values. Bone structures are segmented based on a pelvis bone atlas. Accuracy of syn-CT for patient treatment planning was analyzed by transferring the original plan and structures from the CT to syn-CT via rigid registration and recalculating dose. In addition, new IMRT plans were generated on the syn-CT using structures contoured on MR and transferred to the syn-CT. Accuracy of fiducial-based localization at the treatment machine performed using syn-CT or DRRs generated from syn-CT was assessed by comparing to orthogonal kV radiographs or CBCT. Results: Dosimetric comparison between CT and syn-CT was within 0.5% for all structures. The de-novo optimized plans generated on the syn-CT met our institutional clinical objectives for target and normal structures. Patient-induced susceptibility distortion based on B0 maps was within 1mm and 0.4 mm in the body and prostate. The rectal and bladder outlines on the syn-CT were deemed sufficient for assessing rectal and bladder filling on the CBCT at the time of treatment. CBCT localization showed a median error of < ±1 mm in LR, AP and SI direction. Conclusion: MRI derived syn-CT can be used clinically in MR-alone planning and treatment process for prostate. Drs. Deasy, Hunt and Tyagi have Master research agreement with Philips healthcare.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-E-209-03: Development of An In-House CT Dose Monitoring and Management System Based On Open-Source Software Resources -- Pearls and Pitfalls

Radiation dose monitoring solutions have opened up new opportunities for medical physicists to be more involved in modern clinical radiology practices. In particular, with the help of comprehensive radiation dose data, data-driven protocol management and informed case follow up are now feasible. Significant challenges remain however and the problems faced by medical physicists are highly heterogeneous. Imaging systems from multiple vendors and a wide range of vintages co-exist in the same department and employ data communication protocols that are not fully standardized or implemented making harmonization complex. Many different solutions for radiation dose monitoring have been implemented by imaging facilities over the past few years. Such systems are based on commercial software, home-grown IT solutions, manual PACS data dumping, etc., and diverse pathways can be used to bring the data to impact clinical practice. The speakers will share their experiences with creating or tailoring radiation dose monitoring/management systems and procedures over the past few years, which vary significantly in design and scope. Topics to cover: (1) fluoroscopic dose monitoring and high radiation event handling from a large academic hospital; (2) dose monitoring and protocol optimization in pediatric radiology; and (3) development of a home-grown IT solution and dose data analysis framework. Learning Objectives: Describe the scope and range of radiation dose monitoring and protocol management in a modern radiology practice Review examples of data available from a variety of systems and how it managed and conveyed. Reflect on the role of the physicist in radiation dose awareness.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

Software for Sparse Tensor Decomposition on Emerging Computing Architectures

In this paper, we develop software for decomposing sparse tensors that is portable to and performant on a variety of multicore, manycore, and GPU computing architectures. The result is a single code whose performance matches optimized architecture-specific implementations. The key to a portable approach is to determine multiple levels of parallelism that can be mapped in different ways to different architectures, and we explain how to do this for the matricized tensor times Khatri--Rao product (MTTKRP), which is the key kernel in canonical polyadic tensor decomposition. Our implementation leverages the Kokkos framework, which enables a single code to achieve high performance across multiple architectures that differ in how they approach fine-grained parallelism. We also introduce a new construct for portable thread-local arrays, which we call compile-time polymorphic arrays. Not only are the specifics of our approaches and implementation interesting for tuning tensor computations, but they also provide a roadmap for developing other portable high-performance codes. As a last step in optimizing performance, we modify the MTTKRP algorithm itself to do a permuted traversal of tensor nonzeros to reduce atomic-write contention. Lastly, we test the performance of our implementation on 16- and 68-core Intel CPUs and the K80 and P100 NVIDIA GPUs, showing that we are competitive with state-of-the-art architecture-specific codes while having the advantage of being able to run on a variety of architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Cross-Cutting Software Solutions in Support of Experimental Analysis Challenges at National Scattering Facilities

Rapid improvements in instrumentation at neutron and light source combined with new capabilities in computing, data analytics, and machine learning offer unprecedented scientific capabilities to address fundamental and applied science questions in a wide area of subjects from quantum materials to biological systems. In order to make these capabilities accessible to the broader scientific community, significant developments are needed related to workflow spanning from experimental control to advanced materials simulations as well as the underpinning scientific software. In this chapter, we explore these needs and recent developments at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory. A central part of the workflow at the SNS is the data reduction framework Mantid which is developed as a partnership between European and US neutron-scattering facilities.

Proffen, Thomas↗
DOE OSTI2015

Static analysis techniques for semiautomatic synthesis of message passing software skeletons

The design of high-performance computing architectures demands performance analysis of large-scale parallel applications to derive various parameters concerning hardware design and software development. The process of performance analysis and benchmarking an application can be done in several ways with varying degrees of fidelity. One of the most cost-effective ways is to do a coarse-grained study of large-scale parallel applications through the use of program skeletons. The concept of a “program skeleton” that we discuss in this article is an abstracted program that is derived from a larger program where source code that is determined to be irrelevant is removed for the purposes of the skeleton. In this work, we develop a semiautomatic approach for extracting program skeletons based on compiler program analysis. Finally, we demonstrate correctness of our skeleton extraction process by comparing details from communication traces, as well as show the performance speedup of using skeletons by running simulations in the SST/macro simulator.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Replicated Computational Results (RCR) Report for “Adaptive Precision Block-Jacobi for High Performance Preconditioning in the Ginkgo Linear Algebra Software”

The article by Flegar et al. titled “Adaptive Precision Block-Jacobi for High Performance Preconditioning in the Ginkgo Linear Algebra Software” presents a novel, practical implementation of an adaptive precision block-Jacobi preconditioner. Performance results using state-of-the-art GPU architectures for the block-Jacobi preconditioner generation and application demonstrate the practical usability of the method, compared to a traditional full-precision block-Jacobi preconditioner. A production-ready implementation is provided in the Ginkgo numerical linear algebra library. In this report, the Ginkgo library is reinstalled and performance results are generated to perform a comparison to the original results when using Ginkgo’s Conjugate Gradient solver with either the full or the adaptive precision block-Jacobi preconditioner for a suite of test problems on an NVIDIA GPU accelerator. After completing this process, the published results are deemed reproducible.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Software-Hardware Co-design of Heterogeneous SmartNIC System for Recommendation Models Inference and Training

Deep Learning Recommendation Models (DLRMs) are critical applications in various domains and have evolved as one of the single largest machine learning applications. Trillions of DLRM parameters exceed the on-chip memory capacity of GPUs. Large-scale multi-node systems are required for distributed DLRM inference and training, which suffer from the all-to-all communication bottleneck, mainly limiting the scalability of ever-growing DLRMs. In recent years, SmartNICs have evolved with coupled computation and communication capabilities providing opportunities for a powerful heterogeneous device in the system. However, there isn't such a distributed system that fully leverages the abundant smartNIC resources that resolve the scalability issue of DLRMs. In this work, we proposed a software-hardware co-design of a heterogeneous smartNIC system that resolves the communication bottleneck of distributed DLRMs, mitigates the memory bandwidth pressure, and improves computation efficiency. We provide a set of smartNIC designs of cache systems (including local cache and remote cache) and smartNIC computation kernels which reduce data movement, relieve memory lookup intensity, and improve the GPU's computation efficiency. In addition, we propose a graph algorithm that improves the data locality of queries within batches which optimizes the overall system performance with higher data reuse. Our evaluation shows that our system achieves 2.1x latency speedup for inference and 1.6x throughput speedup for training.

Guo, Anqi↗