Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Integrating External Resources with a Task-Based Programming Model

Accessing external resources (e.g., loading input data, checkpointing snapshots, and out-of-core processing) can have a significant impact on the performance of supercomputer applications. However, no existing programming systems for high-performance computing directly manage and optimize these external accesses. As a result, users must explicitly manage external accesses alongside their computation at the application level, which can result in both correctness and performance issues. We address this limitation by introducing Iris, a task-based programming model with semantics for external resources. Iris allows applications to describe their access requirements to external resources and the relationship of those accesses to the computation. Iris incorporates external I/O into a deferred execution model, reschedules external I/O to overlap I/O with computation, and reduces external I/O when possible. We evaluate Iris on three microbenchmarks representative of important workloads in HPC and a full combustion simulation, S3D. We demonstrate that the Iris implementation of S3D reduces the external I/O overhead by up to 20×, compared to the Legion and the Fortran implementations.

97 MATHEMATICS AND COMPUTING↗

Sparse Deep Neural Network Inference using different Programming Models

Sparse deep neural networks have gained increasing attention recently in achieving speedups on inference with reduced memory footprints. However, the real-world applications are little shown with specialized optimizations, yet a wide variety of DNN tasks remain dense without exploiting the advantages of sparsity in networks. Recent work presented by MIT/IEEE/Amazon GraphChallenge has demonstrated significant speedups and various techniques. Still, we find that there is limited investigation of the impact of various Python and C\slash C++ based programming models to explore new opportunities in general cases. In this work, we provide performance evaluation through different programming models using CuPy, cuSPARSE, and OpenMP to discuss the advantages and disadvantages of our sparse implementations on single-GPU and multiple GPUs of NVIDIA DGX-A100 40GB/80GB platforms.

machine learning, HPC↗

Investigating Resilience of Loops in HPC Programs: A Semantic Approach with LLMs

Soft errors have become one of the major concerns for the error resilience of the HPC applications as those errors may cause HPC applications to generate serious outcomes such as silent data corruptions (SDCs). Protecting the applications from soft errors is an essential while challenging task. Among different approaches, obtaining a profound understanding of the resilience proneness of an application is very important to devise efficient error detection and recovery strategies. Given the scale of the HPC applications both in the code size and execution time, there are often cases that the error propagation analysis on such applications would produce a massive volume of unstructured data, which requires a significant amount of efforts, to process and to obtain indicating actions towards error protection. In this paper, we present a control-flow based visual analysis framework to help the users conduct error propagation analysis and identify the critical sections of a program that may have a higher likelihood of leading to erroneous outcomes when affected by the control flow related errors. We also design and implement the scalable visualization framework - ResilienceVis that efficiently and effectively visualizes the affected program states under errors and the propagation traces for an application in a user-friendly manner, and eventually, we combine the analysis and visualization to exhibit the error-proneness of the different sections of applications.

Jiang, Hailong↗

Localized Fault Recovery for Nested Fork-Join Programs

Nested fork-join programs scheduled using work stealing can automatically balance load and adapt to changes in the execution environment. In this paper, we design an approach to efficiently recover from faults encountered by these programs. Specifically, we focus on localized recovery of the task space in the presence of fail-stop failures. We present an approach to efficiently track, under work stealing, the relationships between the work executed by various threads. This information is used to identify and schedule the tasks to be re-executed without interfering with normal task execution. The algorithm precisely computes the work lost, incurs minimal re-execution overhead, and can recover from an arbitrary number of failures. Experimental evaluation demonstrates low overheads in the absence of failures, recovery overheads on the same order as the lost work, and much lower recovery costs than alternative strategies.

Kestor, Gokcen↗

Scenario Decomposition for 0-1 Stochastic Programs: Improvements and Asynchronous Implementation

We recently proposed scenario decomposition algorithm for stochastic 0-1 programs finds an optimal solution by evaluating and removing individual solutions that are discovered by solving scenario subproblems. In our work, we develop an asynchronous, distributed implementation of the algorithm which has computational advantages over existing synchronous implementations of the algorithm. Improvements to both the synchronous and asynchronous algorithm are proposed. We also test the results on well known stochastic 0-1 programs from the SIPLIB test library and is able to solve one previously unsolved instance from the test set.

97 MATHEMATICS AND COMPUTING↗

Evaluating performance and portability of high-level programming models: Julia, Python/Numba, and Kokkos on exascale nodes

We explore the performance and portability of the high-level programming models: the LLVM-based Julia and Python/Numba, and Kokkos on high-performance computing (HPC) nodes: AMD Epyc CPUs and MI250X graphical processing units (GPUs) on Frontier’s test bed Crusher system and Ampere’s Arm-based CPUs and NVIDIA’s A100 GPUs on the Wombat system at the Oak Ridge Leadership Computing Facilities. We compare the default performance of a hand-rolled dense matrix multiplication algorithm on CPUs against vendor-compiled C/OpenMP implementations, and on each GPU against CUDA and HIP. Rather than focusing on the kernel optimization per-se, we select this naive approach to resemble exploratory work in science and as a lower-bound for performance to isolate the effect of each programming model. Julia and Kokkos perform comparably with C/OpenMP on CPUs, while Julia implementations are competitive with CUDA and HIP on GPUs. Performance gaps are identified on NVIDIA A100 GPUs for Julia’s single precision and Kokkos, and for Python/Numba in all scenarios. We also comment on half-precision support, productivity, performance portability metrics, and platform readiness. We expect to contribute to the understanding and direction for high-level, high-productivity languages in HPC as the first-generation exascale systems are deployed.

Godoy, William↗

A General Framework for Bounding Approximate Dynamic Programming Schemes

For years, there has been interest in approximation methods for solving dynamic programming problems, because of the inherent complexity in computing optimal solutions characterized by Bellman’s principle of optimality. A wide range of approximate dynamic programming (ADP) methods now exists. It is of great interest to guarantee that the performance of an ADP scheme be at least some known fraction, say ß , of optimal. This letter introduces a general approach to bounding the performance of ADP methods, in this sense, in the stochastic setting. The approach is based on new results for bounding greedy solutions in string optimization problems, where one has to choose a string (ordered set) of actions to maximize an objective function. This bounding technique is inspired by submodularity theory, but submodularity is not required for establishing bounds. Instead, the bounding is based on quantifying certain notions of curvature of string functions; the smaller the curvatures the better the bound. The key insight is that any ADP scheme is a greedy scheme for some surrogate string objective function that coincides in its optimal solution and value with those of the original optimal control problem. The ADP scheme then yields to the bounding technique mentioned above, and the curvatures of the surrogate objective determine the value ß of the bound. The surrogate objective and its curvatures depend on the specific ADP.

discrete event systems↗

The Early Years and Evolution of the DOE Computational Science Graduate Fellowship Program

The U.S. Department of Energy Computational Graduate Fellowship Program, celebrating 30 years of existence in 2021, is one of the most successful graduate fellowships in the world as well as one of the longest running programs in the U.S. Department of Energy. Furthermore, this article discusses the conception, early years and evolution of the fellowship over the past thirty years.

97 MATHEMATICS AND COMPUTING↗

Status of the 16 T Dipole Development Program for a Future Hadron Collider

A next step of energy increase of hadron colliders beyond the LHC requires high-field superconducting magnets capable of providing a dipolar field in the range of 16 T in a 50-mm aperture with accelerator quality. These elements could meet the requirements for an upgrade of the LHC to twice the present beam energy or for a 100-TeV center of mass energy future circular collider. Here, we summarize the activities and plans for the development of these magnets, in particular within the 16 T Magnet Technology Program, the WP5 of the EuroCirCol, and the U.S. Magnet Development Program.

43 PARTICLE ACCELERATORS↗

Ordering Traces Logically to Identify Lateness in Message Passing Programs

Event traces are valuable for understanding the behavior of parallel programs. However, automatically analyzing a large parallel trace is difficult, especially without a specific objective. We aid this endeavor by extracting a trace's logical structure, an ordering of trace events derived from happened-before relationships, while taking into account developer intent. Using this structure, we can calculate an operation's delay relative to its peers on other processes. The logical structure also serves as a platform for comparing and clustering processes as well as highlighting communication patterns in a trace visualization. We present an algorithm for determining this idealized logical structure from traces of message passing programs, and we develop metrics to quantify delays and differences among processes. We implement our techniques in Ravel, a parallel trace visualization tool that displays both logical and physical timelines. Rather than showing the duration of each operation, we display where delays begin and end, and how they propagate. As a result, we apply our approach to the traces of several message passing applications, demonstrating the accuracy of our extracted structure and its utility in analyzing these codes.

97 MATHEMATICS AND COMPUTING↗

Generation Expansion Planning With Large Amounts of Wind Power via Decision-Dependent Stochastic Programming

Power generation expansion planning needs to deal with future uncertainties carefully, given that the invested generation assets will be in operation for a long time. Many stochastic programming models have been proposed to tackle this challenge. However, most previous works assume predetermined future uncertainties (i.e., fixed random outcomes with given probabilities). In several recent studies of generation assets' planning (e.g., thermal versus renewable), new findings show that the investment decisions could affect the future uncertainties as well. To this end, this paper proposes a multistage decision-dependent stochastic optimization model for long-term large-scale generation expansion planning, where large amounts of wind power are involved. In the decision-dependent model, the future uncertainties are not only affecting but also affected by the current decisions. In particular, the probability distribution function is determined by not only input parameters but also decision variables. To deal with the nonlinear constraints in our model, a quasi-exact solution approach is then introduced to reformulate the multistage stochastic investment model to a mixed-integer linear programming model. The wind penetration, investment decisions, and the optimality of the decision-dependent model are evaluated in a series of multistage case studies. The results show that the proposed decision-dependent model provides effective optimization solutions for long-term generation expansion planning.

Zhan, Yiduo↗

SU-C-BRD-05: Implementation of Incident Learning in the Safety and Quality Management of Radiotherapy: The Primary Experience in a New Established Program with Advanced Techniques

Purpose: To explore the implementation and effectiveness of incident learning for the safety and quality of radiotherapy in a new established radiotherapy program with advanced technology. Methods: Reference to the consensus recommendations by American Association of Physicist in Medicine, an incident learning system was specifically designed for reporting, investigating, and learning of individual radiotherapy incidents in a new established radiotherapy program, with 4D CBCT, Ultrasound guided radiotherapy, VMAT, gated treatment delivered on two new installed linacs. The incidents occurring in external beam radiotherapy from February, 2012 to January, 2014 were reported. Results: A total of 33 reports were analyzed, including 28 near misses and 5 incidents. Among them, 5 originated in imaging for planning, 25 in planning, 1 in plan transfer, 1 in commissioning and 1 in treatment delivery. Among them, three near misses originated in the safety barrier of the radiotherapy process. In terms of error type, 1 incident was classified as wrong patient, 7 near misses/incidents as wrong site, 6 as wrong laterality, 5 as wrong dose, 7 as wrong prescription, and 7 as suboptimal plan quality. 5 incidents were all classified as grade 1/2 of dosimetric severity, 1 as grade 0, and the other 4 as grade 1 of medical severity. For the causes/contributory factors, negligence, policy not followed, inadequate training, failure to develop an effective plan, and communication contributed to 19, 15, 12, 5 and 3 near misses/incidents, respectively. The average incident rate per 100 patients treated was 0.4; this rate fell to 0.28% in the second year from 0.56% in the first year. The rate of near miss fell to 1.24% from 2.22%. Conclusion: Effective incident learning can reduce the occurrence of near miss/incidents, enhance the culture of safety. Incident learning is an effective proactive method for improving the quality and safety of radiotherapy.

07 ISOTOPE AND RADIATION SOURCES↗

SU-C-BRD-01: Multi-Centre Collaborative Quality Assurance Program for IMRT Planning and Delivery: Year 3 Results

Purpose: A multi-centre quality assurance program was developed to enable quality improvement by coupling measurement of intensity modulated radiotherapy (IMRT) planning and delivery performance for site-specific planning exercises with diagnostic testing. The third year of the program specifically assessed the quality of spine stereotactic body radiotherapy (SBRT) planning and delivery amongst the participating centres. Methods: A spine SBRT planning exercise (24 Gy in 2 fractions) was created and completed by participants prior to an on-site visit. The delivery portion of the on-site visit included spine SBRT plan delivery and diagnostic testing, which included portal image acquisition for quantification of phantom positioning error and multi-leaf collimator (MLC) calibration accuracy. The measured dose was compared to that calculated in the treatment planning system (TPS) using 3%/2mm composite analysis and 3%/3mm gamma analysis. Results: Fourteen institutions participated, creating 17 spine SBRT plans (15 VMAT and 2 IMRT). Three different TPS, two beam energies (6 MV and 6 MV FFF), and four MLC designs from two linac vendors were tested. Large variation in total monitor units (MU) per plan (2494–6462 MU) and dose-volume parameters was observed. The maximum point dose in the plans ranged from 116–149% and was dependent upon the TPS used. Pass rates for measured to planned dose comparison ranged from 89.4–100% and 97.3–100% for 3%/2mm and 3%/3mm criteria respectively. The largest measured MLC error did Result in one of the poorer pass rates. No direct correlation between phantom positioning error and pass rates overall. Conclusion: Significant differences were observed in the planning exercise for some plan and dose-volume parameters based on the TPS used. Standard evaluation criteria showed good agreement between planned and measured dose for all participants, however on an individual plan basis, diagnostic tests were able to identify contributing factors for poorer results, when using more stringent evaluation criteria. Funding from Cancer Care Ontario is acknowledged.

60 APPLIED LIFE SCIENCES↗

TU-AB-201-02: An Automated Treatment Plan Quality Assurance Program for Tandem and Ovoid High Dose-Rate Brachytherapy

Purpose: For tandem and ovoid (T&O) HDR brachytherapy in our clinic, it is required that the planning physicist manually capture ∼10 images during planning, perform a secondary dose calculation and generate a report, combine them into a single PDF document, and upload it to a record- and-verify system to prove to an independent plan checker that the case was planned correctly. Not only does this slow down the already time-consuming clinical workflow, the PDF document also limits the number of parameters that can be checked. To solve these problems, we have developed a web-based automatic quality assurance (QA) program. Methods: We set up a QA server accessible through a web- interface. A T&O plan and CT images are exported as DICOMRT files and uploaded to the server. The software checks 13 geometric features, e.g. if the dwell positions are reasonable, and 10 dosimetric features, e.g. secondary dose calculations via TG43 formalism and D2cc to critical structures. A PDF report is automatically generated with errors and potential issues highlighted. It also contains images showing important geometric and dosimetric aspects to prove the plan was created following standard guidelines. Results: The program has been clinically implemented in our clinic. In each of the 58 T&O plans we tested, a 14- page QA report was automatically generated. It took ∼45 sec to export the plan and CT images and ∼30 sec to perform the QA tests and generate the report. In contrast, our manual QA document preparation tooks on average ∼7 minutes under optimal conditions and up to 20 minutes when mistakes were made during the document assembly. Conclusion: We have tested the efficiency and effectiveness of an automated process for treatment plan QA of HDR T&O cases. This software was shown to improve the workflow compared to our conventional manual approach.

60 APPLIED LIFE SCIENCES↗

SU-F-J-116: Clinical Experience-Based Verification and Improvement of a 4DCT Program

Purpose: To demonstrate the role of continuous improvement fulfilled by the Medical Physicist in clinical 4DCT and CBCT scanning. Methods: Lung (SABR and Standard) patients’ 4D respiratory motion and image data were reviewed over a 3, 6 and 12 month period following commissioning testing. By identifying trends of clinically relevant parameters and respiratory motions, variables were tested with a programmable motion phantom and assessed. Patient traces were imported to a motion phantom and 4DCT and CBCT imaging were performed. Cos6 surrogate and sup-inf motion was also programmed into the phantom to simulate the long exhale of patients for image contrast tests. Results: Patient surrogate motion amplitudes were 9.9+5.2mm (3–35) at 18+6bpm (6–30). Expiration/Inspiration time ratios of 1.4+0.5second (0.6–2.9) showed image contrast effects evident in the AveCT and 3DCBCT images. Small differences were found for patients with multiple 4DCT data sets. Patient motion assessments were simulated and verified with the phantom within 2mm. Initial image reviews to check for reconstructed artefacts and data loss identified a small number of patients with irregularities in the automatic placement of inspiration and expiration points. Conclusion: The Physicist’s involvement in the continuous improvements of a clinically commissioned technique, processes and workflows continues beyond the commissioning stage of a project. Our experience with our clinical 4DCT program shows that Physics presence is required at the clinical 4DCT scan to assist with technical aspects of the scan and also for clinical image quality assessment prior to voluming. The results of this work enabled the sharing of information from the Medical Physics group with the Radiation Oncologists and Radiation Therapists. This results in an improved awareness of clinical patient respiration variables and how they may affect 4D simulation images and also may also affect the treatment verification images.

60 APPLIED LIFE SCIENCES↗

SU-G-201-01: An Automated Treatment Plan Quality Assurance Program for High-Dose Rate (HDR) Brachytherapy with a VaginalCylinder Applicator

Purpose: Plan specific quality assurance (QA) is an important step in high dose rate (HDR) brachytherapy to ensure the integrity of a treatment plan. The conventional approach is to assemble a set of plan screen-captures in a document and have an independent plan-checker to verify it. Not only is this approach cumbersome and time-consuming, using a document also limits the items that can be verified, hindering plan quality and patient safety. We have initiated efforts to develop a web-based HDR brachytherapy QA system called AutoBrachy QA, for comprehensive and efficient QA. This abstract reports a new plugin in this system for the QA of a cylinder HDR brachytherapy treatment. Methods: A cylinder plan QA module was developed using Python. It was plugged into our AutoBrachy QA system. This module extracted information from CT images and treatment plan. Image processing techniques were employed to obtain geometric parameters, e.g. cylinder diameter. A comprehensive set of eight geometrical and eight dosimetric features of the plan were validated against user specified planning parameter, such as prescription value, treatment depth and length, etc. A PDF document was generated, consisting of a summary QA sheet with all the QA results, as well as images showing plan details. Results: The cylinder QA program has been implemented in our clinic. To date, it has been used in 11 patient cases and was able to successfully perform QA tests in all of them. The QA program reduced the average plan QA time from 7 min using conventional manual approach to 0.5 min. Conclusion: Being a new module in our AutoBrachy QA system, an automated treatment plan QA module for cylinder HDR brachytherapy has been successfully developed and clinically implemented. This module improved clinical workflow and plan integrity compared to the conventional manual approach.

60 APPLIED LIFE SCIENCES↗

MO-DE-BRA-01: Flipped Physics Courses Within a Radiologic Technologist Program: Video Production and Long Term Outcomes

Purpose: To determine if the flipped class format has an effect on examination results for a radiologic technologist (RT) program and discuss benefits from creating video resources. Methods: From 2001–2015, students had taken both a radiological physics and quality control (QC) class as a part of their didactic training. In 2005/2006, the creation of videos of didactic lectures and QC test demonstrations allowed for a flip where content was studied at home while exercises and reviews were done in-class. Final examinations were retrospectively reviewed from this timeframe. 12 multiple choice physics questions (MCP) and 5 short answer QC questions (SAQC) were common to pre and post flip exams. The RT program’s ARRT exam scores were also obtained and compared to national averages. Results: In total, 36 lecture videos and 65 quality control videos were created for the flipped content. Data was ∼2.4GB and distributed to students via USB or CD media. For MCP questions, scores improved by 7.9% with the flipped format and significance (Student’s t-test, p<0.05) was found for 3 of the 12 questions. SAQC questions showed improvement by 14.6% and significance was found for 2 of the 5 questions. Student enrollment increased from ∼14 (2001–2004) to ∼23 students (2005–15). Content was continuously added post-flip due to the efficiency of delivery. The QC class in 2003 covered 45 test setups in-class while 65 were covered with video segments in 2014. Flipped materials are currently being repurposed. In 2015, this video content was restructured into an ARRT exam review guide and in 2016, the content was reorganized for fluoroscopy training for physicians. Conclusion: We believe that flipped classes can improve efficiency of content delivery and improve student performance even with an increase in class size. This format allows for flexibility in learning as well as re-use in multiple applications.

07 ISOTOPE AND RADIATION SOURCES↗

Sci-Fri PM: Radiation Therapy, Planning, Imaging, and Special Techniques - 05: A novel respiratory motion simulation program for VMAT treatment plans: a phantom validation study

Purpose: To develop and validate a computational method to simulate craniocaudal respiratory motion in a VMAT treatment plan. Methods: Three 4DCTs of the QUASAR respiratory motion phantom were acquired with a 2cm water-density spherical tumour embedded in cedar to simulate lung. The phantom was oscillating sinusoidally with an amplitude of 2cm and periods of 3, 4, and 5 seconds. An ITV was contoured and 5mm PTV margin was added. High and a low modulation factor VMAT plans were created for each scan. An in-house program was developed to simulate respiratory motion in the treatment plans by shifting the MLC leaf positions relative to the phantom. Each plan was delivered to the phantom and the dose was measured using Gafchromic film. The measured and calculated plans were compared using an absolute dose gamma analysis (3%/3mm). Results: The average gamma pass rate for the low modulation plan and high modulation plans were 91.1% and 51.4% respectively. The difference between the high and low modulation plans gamma pass rates is likely related to the different sampling frequency of the respiratory curve and the higher MLC leaf speeds in the high modulation plan. A high modulation plan has a slower gantry speed and therefore samples the breathing cycle at a coarser frequency leading to inaccuracies between the measured and planned doses. Conclusion: A simple program, including a novel method for increasing sampling frequency beyond the control point frequency, has been developed to simulate respiratory motion in VMAT plans by shifting the MLC leaf positions.

60 APPLIED LIFE SCIENCES↗