Parallel Tasking Library (PTL) v1.0.0
Lightweight C++11 multithreading tasking system featuring thread-pool, task-groups, and lock-free task queue.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Lightweight C++11 multithreading tasking system featuring thread-pool, task-groups, and lock-free task queue.
Performing a variety of numerical computations efficiently and, at the same time, in a portable fashion requires both an overarching design followed by a number of implementation strategies. All of these are exemplified below as we present transitioning the PLASMA numerical library from relying on dependence-driven large tasks to achieving utilization of fine grain tasking and offload to hardware accelerators while keeping its core dependence sets: OpenMP source code pragmas and runtime for most system-level functionality and basic low-level numerical kernels provided directly by hardware vendors or open source projects with vendor contributions. We also present new algorithmic methods and their efficient parallel implementations including fine grained tasking for eigen-spectrum slicing and offload for mixed-precision eigenvalue refinement. We provide performance, scaling, and numerical results showing sizable gains over the available solutions from either the open source and vendor-provided packages.
The DECOVALEX Project is an on-going international research collaboration, established in 1992, to advance the understanding and modeling of coupled Thermal (T), Hydrological (H), Mechanical (M) and Chemical (C) processes in geological in geological systems. This document is the final report of Task A which was proposed by the DECOVALEX Project and coordinated by the British Geological Survey (BGS), presenting the technical definitions of the problems studied, approaches applied, achievements made and outstanding issues for future research. The purpose of Task A under DECOVALEX-2019 is to better understand the processes governing the advective movement of gas in both low-permeability argillaceous repository host rocks and clay-based engineered barriers. Special attention is given to the mechanisms controlling gas entry, flow and pathway sealing and their impact on the performance of the engineered clay barrier. Previous work suggests gas flow may be accompanied by the creation of dilatant pathways whose properties change temporally and spatially within the medium. Thus, new numerical representations for the quantitative prediction of gas migration fluxes through argillaceous rock formations have been developed. These provide an invaluable tool with which to assess the impact of gas flow on repository layout and therefore design of any future facility. In addition, experience gained through this task is of direct relevance to other clay-based engineering issues where immiscible gas flow is a consideration including shale gas, hydrocarbon migration, carbon capture and storage and landfill design.
The DECOVALEX Project is an on-going international research collaboration, established in 1992, to advance the understanding and modeling of coupled Thermal (T), Hydrological (H), Mechanical (M) and Chemical (C) processes in geological in geological systems. DECOVALEX was initially motivated by the recognition that prediction of these coupled effects is an essential part of the performance and safety assessment of geologic disposal systems for radioactive waste and spent nuclear fuel. This document is the final report of Task B which was proposed and coordinated by the Swiss Federal Nuclear Safety Inspectorate (ENSI) and Lawrence Berkeley National Laboratory (LBNL), presenting the technical definitions of the problems studied, approaches applied, achievements made and outstanding issues for future research. Task B focused mainly on modelling of fault activation experiments (FS experiment) recently performed at the Mont Terri underground research laboratory, Switzerland. The FS experiment explores the coupling between fault reactivation in a clay host rock and the potential-enhanced fluid displacement through a previously low-permeability formation. Based on this experiment, the DECOVALEX-2019 Task B addresses how the change in permeability induced by the fault activation and the resulting fluid flow within the fault can be simulated including the dependence on its mechanical behavior. This will support the understanding of the processes during fault activation itself and it can help to determine consequences for contaminant transport due to potentially created permeable flow paths in otherwise low permeability argillaceous rocks.
The DECOVALEX Project is an on-going international research collaboration, established in 1992, to advance the understanding and modeling of coupled Thermal (T), Hydrological (H), Mechanical (M) and Chemical (C) processes in geological in geological systems. This document is the final report of Task C which was proposed and coordinated by the Japan Atomic Energy Agency (JAEA), presenting the technical definitions of the problems studied, approaches applied, achievements made and outstanding issues for future research. DECOVALEX-2019 Task C aims to develop modelling and prediction methods using numerical simulation based on the water-filling experiment to examine the post-driftclosure environment recovery processes. Three research teams, JAEA, Sandia National Laboratories in the United States (SNL), and the Technical University of Liberec in the Czech Republic (TUL) were challenged to simulate the observed environmental changes. The Task consisted of following three main steps. The simulation targets were the water pressure drawdown/recovery and the variation of water chemistry during the tunnel excavation and closure, as observed in the monitoring boreholes and the CTD.
The DECOVALEX Project is an on-going international research collaboration, established in 1992, to advance the understanding and modeling of coupled Thermal (T), Hydrological (H), Mechanical (M) and Chemical (C) processes in geological in geological systems. This document is the final report of Task D which was proposed by the DECOVALEX Project and coordinated by CIMNE_UPC, presenting the technical definitions of the problems studied, approaches applied, achievements made and outstanding issues for future research. Task D of the DECOVALEX 2019 project is devoted to the study of the hydro-mechanical (HM) and thermo-hydro-mechanical (THM) Interactions in Bentonite Engineered Barriers (INBEB). Special attention is paid to the evolution of barrier heterogeneity under transient conditions. A proper understanding of the processes occurring during the transient period requires the appropriate simulation of the behavior of the engineered barrier by means of coupled numerical analyses. In this context, the main objective of the Task is to assess the capabilities of numerical formulations and codes to simulate and interpret the HM and THM behavior of the bentonite barrier, with a particular focus on the final state reached on saturation.
Climate modeling is an integral part of environmental research, from studying rare phenomena to predicting future climate trends. The need for more accurate models is only growing, but as climate modeling capabilities advance, existing workflows require optimization to recoup performance. A solution comes in the form of task parallelism, a novel programming capability that provides an opportunity for optimization at execution time by allowing tasks to be executed in parallel, reducing runtime significantly. Using Parsl, an intuitive and scalable parallel scripting library for Python, we implement task parallelism within support software to aid in the continuous advancement of climate modeling technology.
The purpose of this project task was to make automotive composite part manufacturing more cost competitive for low volume production and thereby drive composite application innovation. The strategy was to incorporate low-cost preforming, snap cure resins, and RapidClave® processing to create an alternative to conventional automotive composite manufacturing based on SMC. The program used RapidClave® technology from Globe Machine Manufacturing, fast-curing (“snap cure”) epoxy resins from Hexion, and conformable/stretchable glass fiber reinforcement mats produced by Owens Corning for rapid preforming. O’Gara Armoring retrofits vehicles to meet special security needs, such as larger doors to facilitate easier entry into the vehicle. O’Gara has a variety of custom vehicles in need of custom doors that require affordable tooling to produce approximately 100 ship sets/year. The project focused on a composite door panel application provided by O’Gara that is currently made by manual chopped fiber spray-up processing. UDRI reverse-engineered the current composite door panel and created tooling for use in the RapidClave®. UDRI designed an improved composite door using MultiMat fiberglass reinforcement from Owens Corning. UDRI made snap cure resin films from Hexion resin. Finally, UDRI conducted molding trials to compare autoclave processing with RapidClave® processing. The technical goals of the project were to reduce tooling cost by 50% as compared to SMC compression molding and to reduce cycle time by 50% compared to current manual spray-up process. The approach to reduce tool costs is based on use of single sided tooling for use at 100 psi, as compared to matched metal SMC tooling. An added benefit realized from the program is that the Owens Corning mat provided more uniform thickness and improved performance. Tensile and flexural strengths and moduli were increased by at least 50%. This task also demonstrated a 75% decrease in cycle time. O’Gara is evaluating the technology demonstrated in this project for some of their current production. Additionally, there are new products O’Gara is pursuing which require higher production rates than their current products. O’Gara has identified these new products as good candidates for the RapidClave® technology. The cost advantages demonstrated by this project would then lead to significant economic development. In conclusion, this task successfully combined the RapidClave® technology from Globe with a snap cure epoxy resin film system from Hexion and preform material from Owens Corning. Further research is needed to better map the technical limits such as cycle time of these technologies. Additionally, the technology should be extended in terms of size and shape to include large parts outside of automotive applications, such as a small aircraft fuselage.
This report is the revised (Revision 8) Task F specification for DECOVALEX-2023. Task F is a comparison of the models and methods used in deep geologic repository performance assessment. The task proposes to develop a reference case for a mined repository in a fractured crystalline host rock and a reference case for a mined repository in a salt formation. Teams may choose to participate in the comparison for either or both of the reference cases. For each reference case, a common set of conceptual models and parameters describing features, events, and processes that impact performance will be given, and teams will be responsible for determining how best to implement and couple the models. The comparison will be conducted in stages, beginning with a comparison of key outputs of individual process models, followed by a comparison of a single deterministic simulation of the full reference case, and moving on to uncertainty propagation and uncertainty and sensitivity analysis. This report provides background information, a summary of the proposed reference cases, and a staged plan for the analysis.
PNNL staff performed an independent technical review (ITR) of the aluminum-clad spent nuclear fuel (ASNF) program Task 2. The objective of Task 2 is to determine G-values for the radiolytic production of gaseous molecular hydrogen (H 2 ) from the aluminum oxyhydroxide layers present on ASNF cladding. The G-values need to be defensible, bounding, but not overly conservative. As part of the ITR, the team reviewed program documents, Task 2 work plans, and results to date. In addition, the team held three separate video conferences with the program research staff to ask clarifying questions and obtain additional detail. The PNNL ITR team concludes that if the program follows the methodology and rigor outlined in the test matrices, the program will develop G-values for a defensible technical basis of extended storage of ASNF. Recommendations for improvement are given.
Task 5 consisted of two parts, wave energy converter (WEC) arrays and current energy converter (CEC) arrays. The two parts of the project were executed independently, and this report covers only the work on WECs. In this part of the task, the team characterized the behavior of and developed control schemes for wave energy converter (WEC) arrays that improved performance (i.e., maximized aggregate power generation and reduced the levelized cost of energy) over baseline, non-coordinated control approaches. Specifically, for WEC arrays: the team developed optimal layouts of arrays that considered the effect of WEC placement within an array on coordinated array control with real-time estimation schemes. The numerical codes developed through this task were made available to users for array design. These tools utilized existing commercial software as well as software developed within the project team.
The Full-scale Emplacement (FE) heater experiment at the Mont Terri Underground Rock Laboratory (URL) was designed and conducted by Nagra to replicate an emplacement tunnel of Nagra’s reference repository design at 1:1 scale. Alongside testing the technical feasibility of constructing disposal tunnels, emplacing waste containers in the tunnels and then backfilling them, the main goals of the FE experiment are (1) to obtain a better understanding of the coupled effects of induced thermo-hydro-mechanical (THM) processes that may occur and (2) to validate existing coupled THM models (Müller et al., 2017). A key aspect of ensuring safety for repositories located in low-permeability rock involves minimizing any damage to the rock itself, thereby preserving its integrity and promoting a stable environment Amongst a number of processes that could damage the rock is the increase in pore pressure due to thermal loading caused by heat emitted from the waste. To reduce the potential damage of the rock, it is important to analyse the evolution of heat over time due to the heat load of the containers and assess possible consequences by coupled THM models. The aim of Task C of DECOVALEX-2023 was to build 3D numerical models of the FE experiment, focussing in particular on the heating induced pore pressure change in the Opalinus Clay. Data from a large number of sensors were available from the FE experiment for model comparison. These sensors measured temperature and relative humidity in the bentonite around the heaters, and temperature, pressure and displacement/strain in the surrounding Opalinus clay. Data were available from the start of excavation (April 2012) up to August 2020 for most sensors (more than 5 years from the start of heating in December 2014). To fulfil the overall aim of the task, the work was broken down into a number of steps, starting with simpler models to build confidence in each team’s approach and then moving to more complex models that better represent the FE experiment. Step 0 consisted of 2D benchmark models, gradually increasing the number of processes that are represented from thermal (T) only models in Step 0a, to coupled thermal hydraulic (TH) models in Step 0b with a representation of changing porosity, to coupled thermo-hydro-mechanical (THM) models in Step 0c, where porosity changes are calculated by the mechanical model. A detailed specification of processes, parameters, initial and boundary conditions was provided for this step, with the ambition that all teams would work towards close agreement in their model results, thus building confidence in the model implementations. vi It was not straightforward to achieve agreement between the teams, so additional steps (Step 0b2, 0b3, 0c2, 0c3) were added along with derivation of some analytical solutions against which the models could be compared. The reasons for the differences between teams were investigated and found to be caused primarily by different conceptual model assumptions (including temperature dependence of the thermal expansion of water), different model formulations (including porosity evolution) and differences in modelled domain sizes, boundary conditions and grid discretisation. This demonstrates that comparisons between multiple modelling teams and/or comparison with analytical results and experimental data are highly beneficial in providing an indication of uncertainty in model predictions. At the conclusion of Step 0, almost all teams had achieved a close agreement in model results and those that had not achieved an agreement knew the reason for this. Step 1 moved from 2D models to 3D models of the FE experiment without adding technical features like shotcrete or EDZ, and only considering the heating phase. Initially the 3D model was tightly specified to continue to build confidence in the model implementations (Step 1a). The results of Step 1a were compared to the data from the FE-experiment without the teams seeing the data. The teams were then provided with a sub-set of the data from the FE-experiment and invited to consider how best to use the large dataset for model comparison (Step 1b). Teams were then asked to use the data provided to calibrate their models, only changing material property values rather than adding features or processes to their models (Step 1c). In Step 1, teams were asked to only model the heating phase of the experiment, so pressure in the Opalinus Clay was reported as change in pressure since the initial conditions were specified rather than modelled. The change from 2D to 3D models was accompanied by an increase in the dispersion of results between the teams. Some of this was resolved during the task, but some remained and is potentially due to model discretisation. Calibration of parameters was useful in improving the fit of the models to the data but the remaining differences indicated that the models were missing features or processes. In Step 2, the teams were asked to update their models with additional features and processes as well as calibrating parameters to try and improve the fit of the models to the data. Teams were encouraged to represent ventilation of the open FE tunnel prior to backfilling with heaters and bentonite and in Step 2, the absolute pressure in the Opalinus Clay was compared between the teams. Teams took different approaches, but there was consideration of adding shotcrete and an EDZ into the model, representing stress change during excavation and different approaches to modelling ventilation of the FE tunnel. Overall, the documented results showed a very good agreement for temperature. The results for porewater pressure evolution showed a significant improvement for most teams compared to Step 1c with a good agreement to the measurements for several teams whereas some teams overpredicted the pressure increase and others overpredicted the drainage effect especially for the sensors close to the heater. Step 3 was an opportunity for teams to use the models developed in Step 1 and Step 2 to make predictions about the temperature and pressure changes that will be expected at the FE experiment over the next few years in light of the planned changes in thermal output of the heaters.
The Midwest Regional Carbon Initiative (MRCI) Task 3.0 was defined to facilitate development of carbon capture, utilization, and storage (CCUS) in the region by collection and sharing of existing and new technical data from CCUS projects and research. The task also included support for further analysis and assessment of tools by the project team and by researchers working on programs such as National Risk Assessment Partnership (NRAP), machine learning (ML) techniques, and assessment and improvement of CCUS site assessment, operations, and monitoring aspects. Work under Task 3.0 addressed key issues related to CCUS deployment and provided foundational research and datasets to help establish CCUS projects in the MRCI. Report Authors and Principal Technical Contributors: Joel Sminchak, Laura Keister, Mackenzie Scharenberg, Priya Ravi-Ganesh, Autumn Haagsma, Srikanta Mishra, Jared Hawkins, Jared Schuetter, Amy Lang, Jaelen Lewis, Derrick James, Jorge Barrios, Stuart Skopec, and Sanjay Mawalkar (Battelle). Chris Korose, Carl Carmen, Nate Grigsby, Nathan Webb (Illinois State Geological Survey). Principal Investigators: Dr Neeraj Gupta, Dr. Chris Korose.
The goal of the MRCI Task 5 – Promoting Regional Technology Transfer is to leverage existing and new relationships with critical CCUS stakeholders (national and international stakeholders include state geological surveys, universities, industrial partners and advisors, energy production and utilization companies, and NGOs) within the regional initiative and globally and become a key resource for CCUS information, acceptance, and development. Work completed under Task 5 is categorized through four actions: • Promote acceleration of CCUS deployment by providing general support for commercialization and technology transfer • Compile and communicate information from previous tasks to interested stakeholders • Engage with federal and state governments, industry consortia and NGOs • Engage with global institutions
The Downstream Passage and Survival (Acoustic Telemetry) task was one of several tasks for the Evaluation of Howard A. Hanson Dam (HAHD) Juvenile Fish Passage and Survival study. For this task, a juvenile fish passage and survival study was conducted at HAHD from March 10, 2024 through June 27, 2024 for arrays in the HAHD Reservoir and Green River, and through July 9, 2024 for the arrays in the Duwamish River. Fish releases occurred over four times from March through May. Active tag (acoustic telemetry) technology was used to provide biological baseline information for the passage and survival of juvenile Puget Sound (PS) Chinook salmon (Oncorhynchus tshawytscha). Results will be used by biologists, engineers, resource managers, and regional decision-makers to inform the engineering design of the new fish passage facility (FPF) at HAHD. However, hatchery sub-yearling PS Chinook salmon of the appropriate size for tag implantation during the study period (> 95 mm in fork length, Geist et al. 2018) were unavailable. Therefore, yearling Coho salmon (O. kisutch) were used as a surrogate species for this acoustic telemetry study.
Most parallel scientific programs contain compiler directives (pragmas) such as those from OpenMP, explicit calls to runtime library procedures such as those implementing the Message Passing Interface (MPI), or compiler-specific language extensions such as those provided by CUDA. By contrast, the recent Fortran standards empower developers to express parallel algorithms without directly referencing lower-level parallel programming models. Fortran’s parallel features place the language within the Partitioned Global Address Space (PGAS) class of programming models. When writing programs that exploit data-parallelism, application developers often find it straightforward to develop custom parallel algorithms. Problems involving complex, heterogeneous, staged calculations, however, pose much greater challenges. Such applications require careful coordination of tasks in a manner that respects dependencies prescribed by a directed acyclic graph. When rolling one’s own solution proves difficult, extending a customizable framework becomes attractive. The paper presents the design, implementation, and use of the Framework for Extensible Asynchronous Task Scheduling (FEATS), which we believe to be the first task-scheduling tool written in modern Fortran. We describe the benefits and compromises associated with choosing Fortran as the implementation language, and we propose ways in which future Fortran standards can best support the use case in this paper.
This task in the Separations Consortium focuses on the development of counter-current chromatography (CCC), which is an advanced liquid-liquid chromatography method. Today, CCC is primarily practiced in batch mode operation, but continuous operation will be required for at-scale deployment in a biorefinery setting. In this task, we are developing a continuous CCC process in collaboration with a company that builds CCC units. This work will be demonstrated on the biorefining challenge of lignin valorization. Specifically, we demonstrate use of continuous CCC for both monomer-monomer and monomer-oligomer separations in multiple lignin streams of relevance to the biorefining industry. Breakthroughs in this area would be useful for BETO goals in both sustainable aviation fuel and biochemicals production, including directly contributing to BETO's 2030 lignin valorization goal. Our approach includes developing new computational modeling approaches to optimize both batch and continuous CCC processes, experimental work to determine optimal solvent systems for multiple lignin streams sourced from BETO-funded projects and industrial collaborators, and techno-economic analysis and life cycle assessment to identify the most impactful areas to ultimately enable this approach in the biorefinery. This task overall will enable high-resolution, multi-component, continuous separations at scale, demonstrated on a grand challenge biorefining problem.
A compilation system can define, at compile time, the data blocks to be managed by an Even Driven Task (EDT) based runtime/platform, and can also guide the runtime/platform on when to create and/or destroy the data blocks, so as to improve the performance of the runtime/platform. The compilation system can also guide, at compile time, how different tasks may access the data blocks they need in a manner that can improve performance of the tasks.