Exploring Spatial Indexing for Accelerated Feature Retrieval in HPC.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Not provided.
Not provided.
In this paper, we propose a framework called FPDeep, which uses a hybrid of model and layer paral- lelism to configure distributed reconfigurable clusters to train DNNs. This approach has numerous benefits. First, the design does not suffer from batch size growth. Second, novel workload and weight partitioning leads to balanced loads of both among nodes. And third, the entire system is fine-grained pipeline. This leads to high parallelism and utilization and also minimizes the time features need to be cached while waiting for back-propagation.
Not provided.
Writing large amounts of data concurrently to stable storage is a typical I/O pattern of many HPC workflows. This pattern introduces high I/O overheads and results in increased storage space utilization especially for workflows that need to capture the evolution of data structures with high frequency as checkpoints. In this context, many applications, such as graph pattern matching, perform sparse updates to large data structures between checkpoints. For these applications, incremental checkpointing techniques that save only the differences from one checkpoint to another can dramatically reduce the checkpoint sizes, I/O bottlenecks, and storage space utilization. However, such techniques are not without challenges: it is non-trivial to transparently determine what data has changed since a previous checkpoint and assemble the differences in a compact fashion that does not result in excessive metadata. State-of-art data reduction techniques (e.g., compression and de-duplication) have significant limitations when applied to modern HPC applications that leverage GPUs: slow at detecting the differences, generate a large amount of metadata to keep track of the differences, and ignore crucial spatiotemporal checkpoint data redundancy. This paper addresses these challenges by proposing a Merkle tree-based incremental checkpointing method to exploit GPUs' high memory bandwidth and massive parallelism. Experimental results at scale show a significant reduction of the I/O overhead and space utilization of checkpointing compared with state-of-the-art incremental checkpointing and compression techniques.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
The goal of the 2-year workplan was to see if electron beam (EB) could be used to break down a sub-set of the larger chemical family of per and polyfluoroalkylated substances (PFAS) in an energy efficient and economical manner when compared to conventional water treatment technologies. Year one (Y1) work focused on sample EB treatment work in the Fermi National Accelerator Laboratory’s (FNALs) Accelerator Applications Demonstration and Development (A2D2) EB accelerator. While there are reportedly thousands of types of PFAS, for the point of most of the work herein, a small subset was examined, typically perfluorooctane sulfonate (PFOS) and perfluorooctanoate (PFOA). PFOA and PFOS are two of the most well studied PFAS and are studied for baseline evaluations and are considered most useful. The work from Y1 provided information about the optimal operating parameters and additives to use when treating PFOS and PFOA via EB. The data were then used to see where in a water treatment system an EB accelerator would be best suited to treat PFAS. A conventional water treatment technology, GAC, was then compared to e-beam treatment technology with respect to energy and costs for treatment. In year two (Y2), several conventional e-beam accelerator designs, and FNAL’s developmental compact SRF accelerator design, were evaluated for their suitability in PFAS treatment, from an energy efficiency and cost standpoint. Several EB parameters were evaluated and optimized for the removal of PFOA and PFOS from water at normal pressure and temperature, measured as total PFAS removal. Under the optimized test conditions both PFOA showed complete destruction to inorganic fluoride, and PFOS to inorganic fluoride and sulfate, with mass balance. The effect on PFAS removal relative to solution pH, total EB dose, EB dose rate, dissolved oxygen concentration (DO), temperature, and initial PFAS concentration were evaluated. In general, PFOA was easier to destroy than PFOS. Degradation products, typically observed under less-than-optimal EB conditions, provided insight to degradation mechanisms. Products were identified to rule out possible deleterious biproduct formation. The water radiolysis radical reaction kinetics with PFOS and PFOA were not dependent on the initial concentration over 5-orders of magnitude from 2 μg/L to 20 mg/L. This is thought to be because there was an overabundance of the reactive water radiolysis radicals relative to PFAS molecules and largely attributed to aqueous electrons. The reaction rates appeared to be diffusion limited. Testing at higher concentrations (100-200 mg/L) showed a decrease in removal efficiency, suggesting alternative kinetics, possibly second order rates, at higher concentrations. In all, we successfully defined a set of optimal EB parameters to treat PFOA and PFOS at concentrations of 20 mg/L in water with destruction efficiencies near 100%. We further tested the optimized EB parameters with other types of PFAS, including shorter and longer fluorocarbon chain homologs of PFOA and PFOS, and PFAS with alternative functional groups such as sulfonamides. Based on our results EB can be optimized as an effective destructive technology for removing PFAS from water. The conditions optimized for PFOA and PFOS were less effective with ultra-short fluorocarbon compounds like TFMS, PFES, PFPS and PFBS, and likely require re-optimization of parameters to them. In all, it was determined that from a cost and energy efficiency standpoint, EB would be best applied to waste streams with relatively high concentrations of PFOS and PFOA and is not as cost effective as GAC treatment for removing low concentrations of PFAS from water. Higher concentrations of PFAS can be found in the wastewater of conventional treatment processes such as RO and IE and therefore EB may be used to supplement such treatment technologies. Some real-world IE regeneration wash water and RO reject water containing higher concentrations of PFAS and obtained from pilot scale industrial wastewater treatment system at a fluorochemical manufacturing facility, showed that EB could remove PFAS from such types of wastewaters. The IE regenerant wash water appeared to be the most efficient of the two types of wastewaters tested. However, some further optimization of the EB parameters for the specific PFAS types present in those wastewaters may be required. Also, the effects of co-present TOC and mineral salts should be considered during such optimization efforts. From the experimental Y1 results it was seen that the aqueous electron drives degradation of the PFAS. In a hypothetical water treatment skid using EB for PFAS destruction the parameters of the system should be optimized to promote aqueous electron production. Before EB treatment, the PFAS should be preconcentrated when possible, the pH should be raised to pH 10 or higher to enhance aqueous electron production, and the water should be nitrogen purged to remove dissolved oxygen to minimize aqueous electron scavenging. An excel spreadsheet was created that calculates optimal conditions based on inlet PFAS concentration and desired outlet concentration, by optimizing the accelerator power, dose rate, water treatment rate, pH and dissolved oxygen levels to reach the desired endpoint. Given this information on accelerator operating conditions five different EB accelerator systems were compared. One EB system was a continuous-wave, linear superconducting accelerator being designed at Fermilab. Three other EB systems (IMPELA at 5% and 25% duty factor and the ILU-14) were normal conducting pulsed linear accelerators. The fifth system was an IBA Rhodotron which is a normal conducting, circular, continuous-wave accelerator. The accelerator efficiency (% of the incoming power that is used in water treatment) was the dominating factor in accelerator choice. The radio frequency (RF) power supply and the accelerator design (superconducting versus warm technology) drive the accelerator efficiency. The IBA Rhodotron was seen to be the most energy efficient commercially available technology with a wall-plug (total) power efficiency of 43% at 400 kW. The Fermilab design, with a prototype for a different application currently being fabricated, was the most energy efficient at 55% when driven by a Klystron RF power supply and as high as 77% when powered by a magnetron. As the Fermilab design was the most energy efficient by approximately 10-30%, further design work was done on the accelerator and beam delivery system specific to the destruction of PFAS in water. The Fermilab design is unique from industrial accelerators in that is superconducting. Superconducting technology allows for the acceleration of electrons without losses. The accelerator must be cooled to below the point where it is superconducting and is operated around 4 degrees Kelvin. The bulk of the design work for the accelerator is on making the accelerator as energy efficient as possible so that it does not require liquid helium and can be cooled with conduction cooling via cryocoolers. Final design work resulted in an EB accelerator that would operate at minimally 200 kW and 10 MeV. Prototype construction would cost $\$ $7.8 million dollars when driven by a Klystron power supply. A second version of the same accelerator would cost $\$ $5.5 million dollars when driven by a magnetron that is still under development. The commercially available 300 kW IBA Rhodotron cost was estimated at approximately $\$ $9 million. While it is hard to directly compare, an operational GAC system used by 3M for groundwater treatment capital cost (2022 dollars) was estimated to cost $\$ $3.3 million. While the capital expense of the EB accelerator systems was higher than GAC, the accelerator EB treatment would result in destruction of the PFAS and not just sequestration of PFAS to form a new waste stream that requires further treatment or disposal. The operating cost to destroy the PFAS via 400 kw EB system was less than $\$ $1000/kg of PFAS destroyed when treating at a 20 mg/L PFAS concentration, compared to GAC with operating costs that calculated at $\$ $27,530 per kg of PFAS sequestered when treating 100 μg/L PFOA and PFOS combined concentration.
PULSED plasma accelerators typically operate by storing energy in a capacitor bank and then discharging this energy through a gas. The current in such discharges will ionize the gas and produce a strong magnetic field, which interacts with the flowing current to accelerate the plasma through the Lorentz body force. For the present work, two plasma accelerator types employing this general scheme are of interest: the gas-fed pulsed plasma thruster (PPT) 1 and the quasi-steady magnetoplasmadynamic (MPD) accelerator. 2 The gas-fed pulsed plasma accelerator is generally understood as a completely transient device discharging in ∼1-10 μs. When the capacitor bank is discharged through the gas, a current sheet forms at the breech of the thruster and propagates forward under a j × B body force, entraining and accelerating propellant it encounters. This process is sometimes referred to in literature as 'snowplowing' the propellant or accelerating the gas in a detonation-mode because the current sheet representation approximates that of a strong detonation shockwave propagating through the gas. For these devices, acceleration of the initial current sheet ceases when either the current sheet reaches the end of the device and is ejected or when the current in the circuit reverses, striking a new 'crowbar' discharge at the breech and depriving the initial sheet of additional acceleration. In general, PPTs typically claim thrust efficiencies (ratio of jet kinetic energy to input electrical energy) registering in the teens or lower. 3 In the quasi-steady MPD accelerator, the pulse is lengthened to ∼1 ms or longer and maintained at an approximately constant level during discharge through the use of a pulse-forming network (PFN) of capacitors. After an initial transient discharge, which is typically short relative to the overall discharge period, the plasma assumes a relatively steady-state configuration, known as 'quasi-steady' MPD operation. 2 In this state, ionized gas flows through a stationary current channel in a manner that is sometimes referred to as deflagration-mode operation owing to the similarities to deflagration waves in gases. The plasma experiences electromagnetic acceleration as the plasma flows through the current channel towards the exit of the device. Quasi-steady MPD thrusters claim efficiencies up to 50% for certain propellants.4 There has been significant and sustained research over several decades on both gas-fed PPTs and quasi-steady MPD thrusters, however there have been pulsed thrusters that do not appear to exactly fit either classification, instead possessing a mixture of operational qualities characteristic of both thruster variants. The Coaxial High ENerGy (CHENG) thruster by Cheng, et al.5 operated on the short 10 μs timescales characteristic of PPTs, but claimed the high thrust densities, high efficiencies, and low electrode erosion rates that are more consistent with the MPD/deflagration mode of plasma acceleration. Gas-fed PPT research by Ziemer, et al. 3, 6 identified two separate regimes of performance in those thrusters. The regime at higher mass bits (termed Mode I in that work) possessed relatively constant thrust efficiency as a function of mass bit, while the second regime at very low mass bits (termed Mode II) exhibited an increase in efficiency with decreasing mass bit. Work by Poehlmann et al.7 and by Sitaraman and Raja8 sought to understand the performance of the CHENG thruster and the Mode I/Mode II performance in PPTs by modeling the acceleration using the Hugoniot Relation, with the detonation and deflagration modes of plasma acceleration representing two distinct sets of solutions to the relevant conservation laws. In these works, it was proposed that the values of the various controllable parameters determined whether the accelerator would operate in detonation or deflagration mode. Our hypothesized view of the acceleration process in the CHENG thruster and in PPTs experiencing a transition from Mode I to Mode II is inspired by observations of the transition from the PPT mode of operation to the quasi-steady MPD mode. Specifically, the quasi-steady MPD was discovered by driving a PPT to extended pulse lengths. Above a certain pulse length threshold the transient plasma current sheet transitions into a stable plasma acceleration mode that 'replicates in every observable detail steady flow self-field magnetoplasmadynamic acceleration.' 9 In the present work, instead of treating the accelerator as if it were only operating in a single mode during a pulse, we consider the initial stage of the discharge in all cases as a current sheet forming at the breach of the accelerator and moving towards the exit as a detonation wave. If the current sheet reaches the exit of the accelerator before the discharge is completed, the view of the acceleration mode transitions to the deflagration mode-type found in quasi-steady MPD thrusters. In previous work10 we presented a modeling framework that first captured the time-evolution of the current sheet (detonation) mode of the thruster and then transitioned into the quasi-steady MPD (deflagration) mode of plasma acceleration. In the present work, variations of the controllable parameters - specifically the pulsed circuit properties, the amount of mass injected into the thruster, and the relative timing between the initial gas injection and the initiation of the plasma current sheet - will be used to explore the thruster performance. A range of parameters are explored to demonstrate that standard gas-fed pulsed plasma accelerators, the CHENG thruster, and the quasi-steady MPD accelerator are variations of the same device, with the overall acceleration of the plasma depending upon the behavior of the plasma discharge during initial transient phase and the relative lengths of the detonation and deflagration modes of operation.
We have conducted an intensive, pioneering program to demonstrate novel concepts for achieving high gradient acceleration at frequencies from the conventional microwave bands up to the millimeter wave /THz bands. High gradient accelerators hold the promise of smaller and less costly accelerators for applications ranging from the largest scale accelerators used for discovery science down to the smallest accelerators used for industrial, homeland security and medical applications. The research consisted of two major research thrusts: 1.) Structure-based wakefield accelerator (SWFA) research in collaboration with the Argonne Wakefield Accelerator research group and 2.) Millimeter Wave / THz high gradient acceleration in collaboration with SLAC. The specific goals of the research program were: Design novel metallic metamaterial structures that increase the beam-wave coupling for the accelerator mode and reduce the effect of high order modes; test novel metamaterial structures to achieve higher output power, > 1 GW at X-Band (11.7 GHz), in test at the Argonne Wakefield Accelerator (AWA); determine the experimental breakdown threshold for nanosecond-scale pulses at X-Band in testing at the AWA; test a 110 GHz accelerator structure with a field emission electron gun, built at SLAC, using pulses from a 1 MW, 110 GHz gyrotron; design, build and test a 110 GHz quasi-optical, resonant-ring pulse compressor to compress microsecond pulses from the 1 MW gyrotron into > 20 MW, 5 ns output pulses for accelerator structure testing. The proposed research program built on our successes in our research program including: Generation of 510 MW, 2.1 ns (FWHM) pulses at 11.7 GHz from a metallic metamaterial structure in test at the Argonne Wakefield Accelerator using a train of eight 65 MeV electron bunches spaced at 1.3 GHz with a total charge of 280 nC. The metamaterial structure consisted of 100 copper unit cells each consisting of a “wagon-wheel” plate and a spacer plate with a total structure length of 0.2 m. The 510 MW pulse generated an on-axis wakefield of 130 MV/m that could be used to accelerate a trailing witness bunch. Demonstration of coupling of an unprecedented rf power level of 575kW into a 110 GHz accelerator structure using a quasi-optical setup. The standing structure consisted of a central copper cavity located between two matching cavities fed by a TM01 mode. The 6 ns input pulses were sliced from 3 microsecond pulses from the gyrotron using a laser-driven silicon switch. We obtained an unprecedented high gradient up to 230MV/m corresponding to a peak surface electric field of more than 520 MV/m.
For over half a century, high-energy particle accelerators have been a major enabling technology for particle and nuclear physics research as well as sources of X-rays for photon science research in material science, chemistry and biology. Particle accelerators for energy and intensity Frontier research in particle and nuclear physics continuously push the accelerator community to invent ways to increase the energy and improve the performance of accelerators, reduce their cost, and make them more power efficient. The accelerator community has demonstrated imagination and creativity in developing a plethora of future accelerator ideas and proposals. The technical maturity of the proposed facilities ranges from shovel-ready to those that are still largely conceptual. At this time, over 100 contributed papers have been submitted to the Accelerator Frontier of the US particle physics decadal community planning exercise known as Snowmass’2021. These papers cover a broad spectrum of topics: beam physics and accelerator education, accelerators for neutrinos, colliders for Electroweak/Higgs studies and multi-TeV energies, accelerators for Physics Beyond Colliders and rare processes, advanced accelerator concepts, and accelerator technology for Radio Frequency cavities (RF), magnets, targets and sources. This paper provides an overview of the present state of accelerators for particle physics and gives a brief description of some of the major facilities that have been proposed, their perceived advantages and some of the remaining challenges.