Significant Advances in Computational Simulation Workflow for National Security Applications.
Abstract not provided.
Witkowski, Walter R.↗
SEARCH · Engineering Papers
Results for “Advanced Workflow”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Accelerating Advanced Light Source Science Through Multi-Facility HPC Workflows
Synchrotron light sources support a wide array of techniques to investigate materials, often producing complex, high-volume data that challenge traditional workflows. At the Advanced Light Source (ALS), we developed infrastructure to move microtomography data over ESnet to ALCF and NERSC, where CPU- and GPU-based algorithms generate 3D reconstructed volumes of experimental samples. We employ two data movement and reconstruction models: real-time processing as data streams directly to NERSC compute nodes, and automated file transfer to NERSC and ALCF file systems. The streaming pipeline provides users with feedback in under ten seconds, while the file-based workflow produces high-quality reconstructions suitable for deeper analysis in 20-30 minutes. This infrastructure enables users to utilize HPC resources without direct access to backend systems. We plan to extend this architecture to more endstations, supporting our beamline scientists and users.
Abramov, David↗
From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak
Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.
integrated data analysis↗
Advancing SiC clad fuel performance model: bridging micro- and macro-scale models and experimental validation
This report presents a workflow for advancing fuel performance modeling of SiC composite cladding for light-water reactors by linking microscale, experimental data-informed finite element analysis with rod-scale fuel performance codes such as BISON. The workflow uses X-ray computed tomography (XCT) to capture the actual geometry and processing-induced defects of as-fabricated SiC composite tube specimens, particularly porosity and wall-thickness variations, and converts the segmented XCT volumes into image-based finite element meshes for high fidelity structural analysis.
Koyanagi, Takaaki [Oak Ridge National Laboratory (↗
WE-DE-207A-00: Advances in Image-Guided Neurointerventions-Clinical Pull and Technology Push
1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.
60 APPLIED LIFE SCIENCES↗
WE-DE-207A-01: Parallels in the Evolution of X-Ray Angiographic Systems and Devices Used for Minimally Invasive Endovascular Therapy
1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.
60 APPLIED LIFE SCIENCES↗
WE-DE-207A-03: Recent Advances in Devices Used in Neuro--Interventions
1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.
60 APPLIED LIFE SCIENCES↗
WE-DE-207A-04: Advances in Radiological Neuro-Endovascular Interventional Imaging
1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.
60 APPLIED LIFE SCIENCES↗
Applications of Deep Learning to physics workflows
Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms to increase workflow efficiency. Not only can these algorithms improve the physics performance of current algorithms, but they can often be executed more quickly, especially when run on coprocessors such as GPUs or FPGAs. In the winter of 2023, MIT hosted the Accelerating Physics with ML at MIT workshop, which brought together researchers from gravitational-wave physics, multi-messenger astrophysics, and particle physics to discuss and share current efforts to integrate ML tools into their workflows. The following white paper highlights examples of algorithms and computing frameworks discussed during this workshop and summarizes the expected computing needs for the immediate future of the involved fields.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Distributed Machine Learning Workflow with PanDA and iDDS in LHC ATLAS
Machine Learning (ML) has become one of the important tools for High Energy Physics analysis. As the size of the dataset increases at the Large Hadron Collider (LHC), and at the same time the search spaces become bigger and bigger in order to exploit the physics potentials, more and more computing resources are required for processing these ML tasks. In addition, complex advanced ML workflows are developed in which one task may depend on the results of previous tasks. How to make use of vast distributed CPUs/GPUs in WLCG for these big complex ML tasks has become a popular research area. In this paper, we present our efforts enabling the execution of distributed ML workflows on the Production and Distributed Analysis (PanDA) system and intelligent Data Delivery Service (iDDS). First, we describe how PanDA and iDDS deal with large-scale ML workflows, including the implementation to process workloads on diverse and geographically distributed computing resources. Next, we report real-world use cases, such as HyperParameter Optimization, Monte Carlo Toy confidence limits calculation, and Active Learning. Finally, we conclude with future plans.
97 MATHEMATICS AND COMPUTING↗
Utilizing Distributed Heterogeneous Computing with PanDA in ATLAS
In recent years, advanced and complex analysis workflows have gained increasing importance in the ATLAS experiment at CERN, one of the large scientific experiments at LHC. Support for such workflows has allowed users to exploit remote computing resources and service providers distributed worldwide, overcoming limitations on local resources and services. The spectrum of computing options keeps increasing across the Worldwide LHC Computing Grid (WLCG), volunteer computing, high-performance computing, commercial clouds, and emerging service levels like Platform-as-a-Service (PaaS), Container-as-a-Service (CaaS) and Function-as-a-Service (FaaS), each one providing new advantages and constraints. Users can significantly benefit from these providers, but at the same time, it is cumbersome to deal with multiple providers, even in a single analysis workflow with fine-grained requirements coming from their applications’ nature and characteristics. In this paper, we will first highlight issues in geographically-distributed heterogeneous computing, such as the insulation of users from the complexities of dealing with remote providers, smart workload routing, complex resource provisioning, seamless execution of advanced workflows, workflow description, pseudointeractive analysis, and integration of PaaS, CaaS, and FaaS providers. We will also outline solutions developed in ATLAS with the Production and Distributed Analysis (PanDA) system and future challenges for LHC Run4.
97 MATHEMATICS AND COMPUTING↗
Task Parallelism to Optimize Performance of Environmental Modeling Software
Climate modeling is an integral part of environmental research, from studying rare phenomena to predicting future climate trends. The need for more accurate models is only growing, but as climate modeling capabilities advance, existing workflows require optimization to recoup performance. A solution comes in the form of task parallelism, a novel programming capability that provides an opportunity for optimization at execution time by allowing tasks to be executed in parallel, reducing runtime significantly. Using Parsl, an intuitive and scalable parallel scripting library for Python, we implement task parallelism within support software to aid in the continuous advancement of climate modeling technology.
54 ENVIRONMENTAL SCIENCES↗
Optimization of the Second Target Station cold source moderators using an automated workflow
The Second Target Station (STS) at the US Department of Energy’s Oak Ridge National Laboratory is designed to become the world’s highest peak-brightness spallation source of cold neutrons. Successful completion of the STS, which is currently in the preliminary design phase, will provide transformative new capabilities to examine novel materials for future technologies. At STS, neutrons will be generated by spallation reactions in a solid tungsten target. They will be moderated and thermalized in two cold (20 K) para-hydrogen moderators. Careful optimization of these moderators is essential to the project’s success. To find optimal moderator designs, an advanced optimization workflow integrates high-fidelity neutronics calculations using the Monte Carlo N-Particle (MCNP) transport code MCNP6.2 with state-of-the-art optimization algorithms in the Dakota optimization toolkit. For each design iteration, a parametrized solid CAD geometry is generated in Creo and automatically converted into an unstructured mesh geometry by Attila 4MC for the neutronics calculation with MCNP. Iterations repeat until optimal designs are found. Herein this paper presents the results of a sensitivity and optimization study for the cylindrical and tube moderators. Both moderators can be optimized for maximum peak brightness, maximum time-integrated brightness, or any combination between these extremes. Maximum peak brightness is achieved by using smaller optimal dimensions of the moderators, whereas maximum time-integrated brightness is achieved by using larger dimensions. A Pareto front details the designs that optimally balance both brightness metrics. The Pareto front can be found in only 40–110 iterations with 4–5 design parameters when using the efficient global and Pareto-set optimization algorithms in Dakota. Additionally, important engineering constraints can be taken into account, such as the coupling between the cylindrical moderator radius and aluminum vessel wall thicknesses required to ensure structural integrity of the vessels. This interaction has a significant impact on the resulting optimal designs. Our new, highly efficient, fully automated optimization workflow will be used to optimize additional STS components in the future and can be adopted for design and optimization studies at other experimental neutron and accelerator facilities.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Artificial intelligence–powered biofoundries for protein engineering and metabolic engineering
Synthetic biology is rapidly evolving through the integration of artificial intelligence (AI) and automated biofoundries. This convergence accelerates the design–build–test–learn cycle, shifting protein engineering and metabolic engineering from labor-intensive manual experimentation to autonomous experimentation. This review summarizes recent advances in workflow development, AI models, and their integration with biofoundries for automated or autonomous protein engineering and metabolic engineering. Particularly, we highlight the potential of AI-powered biofoundries for accelerated scientific discovery and innovation in synthetic biology.
Chen, Junyu [Univ. of Illinois at Urbana-Champaign↗
Data automation at light sources
Rapidly growing data volumes at light sources demand increasingly automated data collection, distribution, and analysis processes, in order to enable new scientific discoveries while not overwhelming finite human capabilities. We present here the case for automating and outsourcing light source science using cloud-hosted data automation and enrichment services, institutional computing resources, and high- performance computing facilities to provide cost-effective, scalable, and reliable implementations of such processes. We discuss three specific services that accomplish these goals for data distribution, automation, and transformation. In the first, Globus cloud-hosted data automation services are used to implement data capture, distribution, and analysis workflows for Advanced Photon Source and Advanced Light Source beamlines, leveraging institutional storage and computing. In the second, such services are combined with cloud-hosted data indexing and institutional storage to create a collaborative data publication, indexing, and discovery service, the Materials Data Facility (MDF), built to support a host of informatics applications in materials science. The third integrates components of the previous two projects with machine learning capabilities provided by the Data and Learning Hub for science (DLHub) to enable on-demand access to machine learning models from light source data capture and analysis workflows, and provides simplified interfaces to train new models on data from sources such as MDF on leadership scale computing resources. We draw conclusions about best practices for building next-generation data automation systems for future light sources.
Blaiszik, Ben↗
Exploration Technologies for Operations
Although the International Space Station (ISS) assembly has been completed, the Operations support teams continue to seek more efficient and effective ways to prepare for and conduct the ISS operations and future exploration missions beyond low earth orbit. This search for improvement has led to a significant collaboration between the NASA research and advanced software development community at NASA Ames Research Center and the Mission Operations community at NASA Johnson Space Center. Since 2001, NASA Ames Research Center has been developing and applying its advanced intelligent systems and human systems integration research to mission operations tools for several of the unmanned Mars missions operations. Since 2006, NASA Ames Research Center has also been developing and applying its advanced intelligent systems and human systems integration research to mission operations tools for manned operations support with the Mission Operations Directorate at NASA Johnson Space Center. This paper discusses the completion of the development and deployment of a variety of intelligent and human systems technologies adopted for manned mission operations. The technologies associated with the projects include advanced software systems for operations and human-centered computing. Human-centered computing looks to the processes and procedures that people do to perform any given job, then attempts to identify opportunities to improve these processes and procedures. In particular, for mission operations, improvements are quantified by specifically identifying how a tool can increase a persons efficiency, enhance a persons functional capability, andor improve the assurance of a persons decisions. The Ames development team has collaborated with the Mission Operations team to identify areas of efficiencies through technology infusion applications in support of the Plan, Train, and Fly activities of human-spaceflight mission operations. The specific applications discussed in this paper are in the areas of mission planning systems, mission operations design modeling and workflow automation, advanced systems monitoring, mission control technologies, search tools, training management tools, spacecraft solar array management, spacecraft power management, and spacecraft attitude planning. We discuss these specific projects between the Ames Research Center and the Johnson Space Centers Mission Operations Directorate, and how these technologies and projects are enhancing the mission operations support for the International Space Station. We also discuss the challenges, problems, and successes associated with long-distance and multi-year development projects between the research team at Ames and the Mission Operations customers at Johnson Space center. Finally, we discuss how these technology infusion applications and underlying technologies might be used in the future to support on-board operations of the crew and spacecraft systems as human exploration expands beyond low earth orbit to destinations in the solar system where communications delays will require more on-board autonomy and planning by the crew. Longer communications delays will require that the ground mission operations support will be primarily strategic in nature, while the tactical level of planning, systems monitoring and control, and failure analysisisolationrecovery will be the responsibility of both the spacecraft autonomous systems and the crew. Our expectation is that the technologies
mission operations↗
Next-Generation Analysis and Visualization Platform for Manufacturing and Engineering Workflows (Final Report)
Advanced manufacturing and engineering are fundamental to the economic strength and national security of the United States. With the introduction of advanced modeling and simulation practices in manufacturing and engineering over the last several decades, we are producing better products, more quickly, and at decreased cost. Through the adoption of high-performance computing (HPC) enabled workflows, in small- to medium-sized manufacturers and engineering firms, which employ fewer than 500 people, is renewing United States manufacturing and engineering. Despite successes, there are significant barriers to widespread adoption of these tools. Our Phase I SBIR project, Next-Generation Analysis and Visualization Platform for Manufacturing and Engineering Workflows, aims to address several of these barriers. Our project helped us evaluate the feasibility and benefits and mitigate risks of asynchronous processing for analysis and visualization workflows. We evaluated the impact of asynchronous, non-blocking communication can have on the user experience in a complex visualization application. Besides the impact on users, we wanted to understand the impacts on developers (development application programming interfaces (APIs))and generated applications (robustness and stability). Any asynchronous platform implementation is bound to rely on multiple threads which can make the programming model extraordinarily complex and prone to bugs. If not managed carefully, the complexity and resulting instability would be an unacceptable evolution for widely used production tools like ParaView and putting the success of the Phase II project at risk.
42 ENGINEERING↗
Advancing anomaly detection in computational workflows with active learning
Not Available
Raghavan, Krishnan↗