Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Adaptable”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

A feasibility study of dynamic adaptive radiotherapy for nonsmall cell lung cancer

Purpose: The final state of the tumor at the end of a radiotherapy course is dependent on the doses given in each fraction during the treatment course. This study investigates the feasibility of using dynamic adaptive radiotherapy (DART) in treating lung cancers assuming CBCT is available to observe midtreatment tumor states. DART adapts treatment plans using a dynamic programming technique to consider the expected changes of the tumor in the optimization process. Methods: DART is constructed using a stochastic control formalism framework. It minimizes the total expected number of tumor cells at the end of a treatment course, which is equivalent to maximizing tumor control probability, subject to the uncertainty inherent in the tumor response. This formulation allows for nonstationary dose distributions as well as nonstationary fractional doses as needed to achieve a series of optimal plans that are conformal to the tumor over time, i.e., spatiotemporally optimal plans. Sixteen phantom cases with various sizes and locations of tumors and organs-at-risk (OAR) were generated using in-house software. Each case was planned with DART and conventional IMRT prescribing 60 Gy in 30 fractions. The observations of the change in the tumor volume over a treatment course were simulated using a two-level cell population model. Monte Carlo simulations of the treatment course for each case were run to account for uncertainty in the tumor response. The same OAR dose constraints were applied for both methods. The frequency of replanning was varied between 1, 2, 5 (weekly), and 29 times (daily). The final average tumor dose and OAR doses have been compared to quantify the potential dosimetric benefits of DART. Results: The average tumor max, min, mean, and D95 doses using DART relative to these using conventional IMRT were 124.0%–125.2%, 102.1%–114.7%, 113.7%–123.4%, and 102.0%–115.9% (range dependent on the frequency of replanning). The average relative maximum doses for the cord and esophagus, mean doses for the heart and lungs, and D05 for the unspecified tissue resulting 84%–102.4%, 99.8%–106.9%, 66.9%–85.6%, 58.2%–78.8%, and 85.2%–94.0%, respectively. Conclusions: It is feasible to apply DART to the treatment of NSCLC using CBCT to observe the midtreatment tumor state. Potential increases in the tumor dose and reductions in the OAR dose, particularly for parallel OARs with mean or dose–volume constraints, could be achieved using DART compared to nonadaptive IMRT.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-C-BRA-01: Interactive Auto-Segmentation for Bowel in Online Adaptive MRI-Guided Radiation Therapy by Using a Multi-Region Labeling Algorithm

Purpose: In MRI-guided online adaptive radiation therapy, re-contouring of bowel is time-consuming and can impact the overall time of patients on table. The study aims to auto-segment bowel on volumetric MR images by using an interactive multi-region labeling algorithm. Methods: 5 Patients with locally advanced pancreatic cancer underwent fractionated radiotherapy (18–25 fractions each, total 118 fractions) on an MRI-guided radiation therapy system with a 0.35 Tesla magnet and three Co-60 sources. At each fraction, a volumetric MR image of the patient was acquired when the patient was in the treatment position. An interactive two-dimensional multi-region labeling technique based on graph cut solver was applied on several typical MRI images to segment the large bowel and small bowel, followed by a shape based contour interpolation for generating entire bowel contours along all image slices. The resulted contours were compared with the physician’s manual contouring by using metrics of Dice coefficient and Hausdorff distance. Results: Image data sets from the first 5 fractions of each patient were selected (total of 25 image data sets) for the segmentation test. The algorithm segmented the large and small bowel effectively and efficiently. All bowel segments were successfully identified, auto-contoured and matched with manual contours. The time cost by the algorithm for each image slice was within 30 seconds. For large bowel, the calculated Dice coefficients and Hausdorff distances (mean±std) were 0.77±0.07 and 13.13±5.01mm, respectively; for small bowel, the corresponding metrics were 0.73±0.08and 14.15±4.72mm, respectively. Conclusion: The preliminary results demonstrated the potential of the proposed algorithm in auto-segmenting large and small bowel on low field MRI images in MRI-guided adaptive radiation therapy. Further work will be focused on improving its segmentation accuracy and lessening human interaction.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-C-BRA-03: An Automated and Quick Contour Errordetection for Auto Segmentation in Online Adaptive Radiotherapy

Purpose: To develop a tool that can quickly and automatically assess contour quality generated from auto segmentation during online adaptive replanning. Methods: Due to the strict time requirement of online replanning and lack of ‘ground truth’ contours in daily images, our method starts with assessing image registration accuracy focusing on the surface of the organ in question. Several metrics tightly related to registration accuracy including Jacobian maps, contours shell deformation, and voxel-based root mean square (RMS) analysis were computed. To identify correct contours, additional metrics and an adaptive decision tree are introduced. To approve in principle, tests were performed with CT sets, planned and daily CTs acquired using a CT-on-rails during routine CT-guided RT delivery for 20 prostate cancer patients. The contours generated on daily CTs using an auto-segmentation tool (ADMIRE, Elekta, MIM) based on deformable image registration of the planning CT and daily CT were tested. Results: The deformed contours of 20 patients with total of 60 structures were manually checked as baselines. The incorrect rate of total contours is 49%. To evaluate the quality of local deformation, the Jacobian determinant (1.047±0.045) on contours has been analyzed. In an analysis of rectum contour shell deformed, the higher rate (0.41) of error contours detection was obtained compared to 0.32 with manual check. All automated detections took less than 5 seconds. Conclusion: The proposed method can effectively detect contour errors in micro and macro scope by evaluating multiple deformable registration metrics in a parallel computing process. Future work will focus on improving practicability and optimizing calculation algorithms and metric selection.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-C-202-05: Pilot Study of Online Treatment Evaluation and Adaptive Re-Planning for Laryngeal SBRT

Purpose: We have instigated a phase I trial of 5-fraction stereotactic body radiotherapy (SBRT) for advanced-stage laryngeal cancer. We conducted this pilot dosimetric study to confirm the potential utility of online adaptive re-planning to preserve treatment quality. Methods: Ten cases of larynx cancer were evaluated. Baseline and daily SBRT treatment plans were generated per trial protocol. Daily volumetric images were acquired prior to every fraction of treatment. Reference simulation CT images were deformably registered to daily volumetric images using Eclipse. Planning contours were then deformably propagated to daily images. Reference SBRT plans were directly copied to calculate delivered dose distributions on deformed reference CT images. In-house software platform has been developed to calculate cumulative dose over a course of treatment in four steps: 1) deforming delivered dose grid to reference CT images using deformation information exported from Eclipse; 2) generating tetrahedrons using deformed dose grid as vertices; 3) resampling dose to a high resolution within every tetrahedron; 4) calculating dose-volume histograms. Our inhouse software was benchmarked with a commercial software, Mirada. Results: In all ten cases including 49 fractions of treatments, delivered daily doses were completely evaluated and treatment could be re-planned within 10 minutes. Prescription dose coverage of PTV was less than intended in 53% of fractions of treatment (mean: 94%, range: 84%–98%) while minimum coverage of CTV and GTV was 94% and 97%, respectively. Maximum bystander point dose limits to arytenoids, parotids, and spinal cord remained respected in all cases, although variances in carotid artery doses were observed in a minority of cases. Conclusion: Although GTV and CTV coverage is preserved by in-room 3D image guidance of larynx SBRT, PTV coverage can vary significantly from intended plans. Online adaptive treatment evaluation and re-planning is potentially necessary and our procedure is clinically applicable to fully preserve treatment quality. This project is supported by CPRIT Individual Investigator Research Award RP150386.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-J-97: A Joint Registration and Segmentation Approach for Large Bladder Deformations in Adaptive Radiotherapy

Purpose: To improve results of deformable image registration (DIR) in adaptive radiotherapy for large bladder deformations in CT/CBCT pelvis imaging. Methods: A variational multi-modal DIR algorithm is incorporated in a joint iterative scheme, alternating between segmentation based bladder matching and registration. Using an initial DIR to propagate the bladder contour to the CBCT, in a segmentation step the contour is improved by discrete image gradient sampling along all surface normals and adapting the delineation to match the location of each maximum (with a search range of +−5/2mm at the superior/inferior bladder side and step size of 0.5mm). An additional graph-cut based constraint limits the maximum difference between neighboring points. This improved contour is utilized in a subsequent DIR with a surface matching constraint. By calculating an euclidean distance map of the improved contour surface, the new constraint enforces the DIR to map each point of the original contour onto the improved contour. The resulting deformation is then used as a starting guess to compute a deformation update, which can again be used for the next segmentation step. The result is a dense deformation, able to capture much larger bladder deformations. The new method is evaluated on ten CT/CBCT male pelvis datasets, calculating Dice similarity coefficients (DSC) between the final propagated bladder contour and a manually delineated gold standard on the CBCT image. Results: Over all ten cases, an average DSC of 0.93±0.03 is achieved on the bladder. Compared with the initial DIR (0.88±0.05), the DSC is equal (2 cases) or improved (8 cases). Additionally, DSC accuracy of femoral bones (0.94±0.02) was not affected. Conclusion: The new approach shows that using the presented alternating segmentation/registration approach, the results of bladder DIR in the pelvis region can be greatly improved, especially for cases with large variations in bladder volume. Fraunhofer MEVIS received funding from a research grant by Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-G-BRA-09: Estimation of Motion Tracking Uncertainty for Real-Time Adaptive Imaging

Purpose: kV fluoroscopic imaging combined with MV treatment beam imaging has been investigated for intrafractional motion monitoring and correction. It is, however, subject to additional kV imaging dose to normal tissue. To balance tracking accuracy and imaging dose, we previously proposed an adaptive imaging strategy to dynamically decide future imaging type and moments based on motion tracking uncertainty. kV imaging may be used continuously for maximal accuracy or only when the position uncertainty (probability of out of threshold) is high if a preset imaging dose limit is considered. In this work, we propose more accurate methods to estimate tracking uncertainty through analyzing acquired data in real-time. Methods: We simulated motion tracking process based on a previously developed imaging framework (MV + initial seconds of kV imaging) using real-time breathing data from 42 patients. Motion tracking errors for each time point were collected together with the time point’s corresponding features, such as tumor motion speed and 2D tracking error of previous time points, etc. We tested three methods for error uncertainty estimation based on the features: conditional probability distribution, logistic regression modeling, and support vector machine (SVM) classification to detect errors exceeding a threshold. Results: For conditional probability distribution, polynomial regressions on three features (previous tracking error, prediction quality, and cosine of the angle between the trajectory and the treatment beam) showed strong correlation with the variation (uncertainty) of the mean 3D tracking error and its standard deviation: R-square = 0.94 and 0.90, respectively. The logistic regression and SVM classification successfully identified about 95% of tracking errors exceeding 2.5mm threshold. Conclusion: The proposed methods can reliably estimate the motion tracking uncertainty in real-time, which can be used to guide adaptive additional imaging to confirm the tumor is within the margin or initialize motion compensation if it is out of the margin.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-G-BRA-12: Development of An Intra-Fractional Motion Tracking and Dose Reconstruction System for Adaptive Stereotactic Body Radiation Therapy in High-Risk Prostate Cancer

Purpose: A clinical trial on stereotactic body radiation therapy (SBRT) for high-risk prostate cancer is undergoing at our institution. In addition to escalating dose to the prostate, we have increased dose to intra-prostatic lesions. Intra-fractional prostate motion deteriorates well planned radiation dose, especially for the small intra-prostatic lesions. To solve this problem, we have developed a motion tracking and 4D dose-reconstruction system to facilitate adaptive re-planning. Methods: Patients in the clinical trial were treated with VMAT using four arcs and 10 FFF beam. KV triggered x-ray projections were taken every 3 sec during delivery to acquire 2D projections of 3D anatomy at the direction orthogonal to the therapeutic beam. Each patient had three implanted prostate markers. Our developed system first determined 2D projection locations of these markers and then 3D prostate translation and rotation via 2D/3D registration of the markers. Using delivery log files, our GPU-based Monte Carlo tool (goMC) reconstructed dose corresponding to each triggered image. The calculated 4D dose distributions were further aggregated to yield the delivered dose. Results: We first tested each module in our system. MC dose engine were commissioned to our treatment planning system with dose difference of <0.5%. For motion tracking, 1789 kV projections from 7 patients were acquired. The 2D marker location error was <1 mm. For 3D motion tracking, root mean square (RMS) errors along LR, AP, and CC directions were 0.26mm, 0.36mm, and 0.01mm respectively in simulation studies and 1.99mm, 1.37mm, and 0.22mm in phantom studies. We also tested the entire system workflow. Our system was able to reconstruct delivered dose. Conclusion: We have developed a functional intra-fractional motion tracking and 4D dose re-construction system to support our clinical trial on adaptive high-risk prostate cancer SBRT. Comprehensive evaluations have shown the capability and accuracy of our system.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-H-207B-04: Strategies for Adaptive RT

In recent years, steady progress has been made towards the implementation of MRI in external beam radiation therapy for processes ranging from treatment simulation to in-room guidance. Novel procedures relying mostly on MR data are currently implemented in the clinic. This session will cover topics such as (a) commissioning and quality control of the MR in-room imagers and simulators specific to RT, (b) treatment planning requirements, constraints and challenges when dealing with various MR data, (c) quantification of organ motion with an emphasis on treatment delivery guidance, and (d) MR-driven strategies for adaptive RT workflows. The content of the session was chosen to address both educational and practical key aspects of MR guidance. Learning Objectives: Good understanding of MR testing recommended for in-room MR imaging as well as image data validation for RT chain (e.g. image transfer, filtering for consistency, spatial accuracy, manipulation for task specific); Familiarity with MR-based planning procedures: motivation, core workflow requirements, current status, challenges; Overview of the current methods for the quantification of organ motion; Discussion on approaches for adaptive treatment planning and delivery. T. Stanescu - License agreement with Modus Medical Devices to develop a phantom for the quantification of MR image system-related distortions.; T. Stanescu, N/A.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-CD-202-10: Tumor Metabolic Control Probability & Dose Response Mapping for Adaptive Dose Painting by Number

Purpose: Adaptive dose-painting-by-number (DPbN) requires a dose-response-mapping (DRM) obtained early in the treatment course. To obtain DRM, voxel-by-voxel tumor dose response needs to be quantified. Our recent study has demonstrated that voxel-by-voxel radio-sensitivity of patient tumor can be determined using tumor-metabolic-ratio measured early during the treatment using FDG-PET images. In this study, the measurements were utilized to construct tumor metabolic control probability (TMCP) and DRM for DPbN. Methods: FDG-PET/CT images of 18 HN cancer patients obtained pre- and weekly during the treatment were used. Spatial parametric images of tumor-metabolic-ratio (dSUV) were constructed following voxel-by-voxel deformable image registration. Each voxel value in dSUV was a function of baseline SUV and delivered dose. Utilizing all values of dSUV in the controlled tumor group at the last treatment week, a cut-off function between the baseline SUV and dSUV was formed, and applied in early treatment days on dSUV of all tumors to model the TMCP. At the treatment week k, TMCP was constructed with respect to the tumor voxel dSUV appeared at the week using the maximum likelihood estimation for all dose levels, and used for DRM construction. Results: TMCPs estimated in the week 2 & 3 have D{sub 50}=11.1∼47.6Gy; γ{sub 50}=0.55∼0.92 respectively with respect to dSUV=0.3∼1.2. The corresponding DRM between tumor voxel dSUV and the expected treatment dose has sigmoid shape. The expected treatment dose are 26∼40Gy (for 95% TMCP) for high sensitive tumor voxels with dSUV=0.3∼0.5; and 65∼110Gy for low sensitive tumor voxels with the dSUV>1.0 depending on the time of the estimation. Conclusion: TMCP can be constructed voxel-by-voxel in human tumor using multiple FDG-PET imaging obtained in early treatment days. TMCP provides a potential quantitative objective of tumor DRM for DPbN to plan the best dose, escalate or de-escalate, in tumor adaptively based on its own radio-sensitivity.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Mechanical morphotype switching as an adaptive response in mycobacteria

Invading microbes face a myriad of cidal mechanisms of phagocytes that inflict physical damage to microbial structures. How intracellular bacterial pathogens adapt to these stresses is not fully understood. Here, we report the discovery of a virulence mechanism by which changes to the mechanical stiffness of the mycobacterial cell surface confer refraction to killing during infection. Long-term time-lapse atomic force microscopy was used to reveal a process of “mechanical morphotype switching” in mycobacteria exposed to host intracellular stress. A “soft” mechanical morphotype switch enhances tolerance to intracellular macrophage stress, including cathelicidin. Both pharmacologic treatment, with bedaquiline, and a genetic mutant lacking uvrA modified the basal mechanical state of mycobacteria into a soft mechanical morphotype, enhancing survival in macrophages. Our study proposes microbial cell mechanical adaptation as a critical axis for surviving host-mediated stressors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Leveraging data mining, active learning, and domain adaptation for efficient discovery of advanced oxygen evolution electrocatalysts

Developing advanced catalysts for acidic oxygen evolution reaction (OER) is crucial for sustainable hydrogen production. This study presents a multistage machine learning (ML) approach to streamline the discovery and optimization of complex multimetallic catalysts. Our method integrates data mining, active learning, and domain adaptation throughout the materials discovery process. Unlike traditional trial-and-error methods, this approach systematically narrows the exploration space using domain knowledge with minimized reliance on subjective intuition. Then, the active learning module efficiently refines element composition and synthesis conditions through iterative experimental feedback. The process culminated in the discovery of a promising Ru-Mn-Ca-Pr oxide catalyst. Our workflow also enhances theoretical simulations with domain adaptation strategy, providing deeper mechanistic insights aligned with experimental findings. By leveraging diverse data sources and multiple ML strategies, we demonstrate an efficient pathway for electrocatalyst discovery and optimization. This comprehensive, data-driven approach represents a paradigm shift and potentially benchmark in electrocatalysts research.

Science & Technology - Other Topics↗
DOE OSTI2021

Temperature-adaptive radiative coating for all-season household thermal regulation

The sky is a natural heat sink that has been extensively used for passive radiative cooling of households. A lot of focus has been on maximizing the radiative cooling power of roof coating in the hot daytime using static, cooling-optimized material properties. However, the resultant overcooling in cold night or winter times exacerbates the heating cost, especially in climates where heating dominates energy consumption. In this work, we approached thermal regulation from an all-season perspective by developing a mechanically flexible coating that adapts its thermal emittance to different ambient temperatures. The fabricated temperature-adaptive radiative coating (TARC) optimally absorbs the solar energy and automatically switches thermal emittance from 0.20 for ambient temperatures lower than 15°C to 0.90 for temperatures above 30°C, driven by a photonically amplified metal-insulator transition. Simulations show that this system outperforms existing roof coatings for energy saving in most climates, especially those with substantial seasonal variations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Genetic Basis of Chromate Adaptation and the Role of the Pre-existing Genetic Divergence during an Experimental Evolution Study with Desulfovibrio vulgaris Populations

Hexavalent chromium [Cr(VI)] is a common environmental pollutant. However, little is known about the genetic basis of microbial evolution under Cr(VI) stress and the influence of the prior evolution histories on the subsequent evolution under Cr(VI) stress. In this study, Desulfovibrio vulgaris Hildenborough (DvH), a model sulfate-reducing bacterium, was experimentally evolved for 600 generations. By evolving the replicate populations of three genetically diverse DvH clones, including ancestor (AN, without prior experimental evolution history), non-stress-evolved EC3-10, and salt stress-evolved ES9-11, the contributions of adaptation, chance, and pre-existing genetic divergence to the evolution under Cr(VI) stress were able to be dissected. Significantly decreased lag phases under Cr(VI) stress were observed in most evolved populations, while increased Cr(VI) reduction rates were primarily observed in populations evolved from EC3-10 and ES9-11. The pre-existing genetic divergence in the starting clones showed strong influences on the changes in lag phases, growth rates, and Cr(VI) reduction rates. Additionally, the genomic mutation spectra in populations evolved from different starting clones were significantly different. A total of 14 newly mutated genes obtained mutations in at least two evolved populations, suggesting their importance in Cr(VI) adaptation. An in-frame deletion mutation of one of these genes, the chromate transporter gene DVU0426, demonstrated that it played an important role in Cr(VI) tolerance. Overall, our study identified potential key functional genes for Cr(VI) tolerance and demonstrated the important role of pre-existing genetic divergence in evolution under Cr(VI) stress conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

MADNESS: A Multiresolution, Adaptive Numerical Environment for Scientific Simulation

MADNESS (multiresolution adaptive numerical environment for scientific simulation) is a high-level software environment for solving integral and differential equations in many dimensions that uses adaptive and fast harmonic analysis methods with guaranteed precision based on multiresolution analysis and separated representations. Underpinning the numerical capabilities is a powerful petascale parallel programming environment that aims to increase both programmer productivity and code scalability. This paper describes the features and capabilities of MADNESS and briefly discusses some current applications in chemistry and several areas of physics.

00A72↗
DOE OSTI2017

In-memory integration of existing software components for parallel adaptive unstructured mesh workflows

Unstructured mesh methods, like finite elements and finite volumes, support the effective analysis of complex physical behaviors modeled by partial differential equations over general threedimensional domains. The most reliable and efficient methods apply adaptive procedures with a-posteriori error estimators that indicate where and how the mesh is to be modified. Although adaptive meshes can have two to three orders of magnitude fewer elements than a more uniform mesh for the same level of accuracy, there are many complex simulations where the meshes required are so large that they can only be solved on massively parallel systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Machine and Application Aware Partitioning for Adaptive Mesh Refinement Applications. In: HPDC '17 Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing

Load balancing and partitioning are critical when it comes to parallel computations. Popular partitioning strategies based on space filling curves focus on equally dividing work. The partitions produced are independent of the architecture or the application. Given the ever-increasing relative cost of data movement and increasing heterogeneity of our architectures, it is no longer sufficient to only consider an equal partitioning of work. Minimizing communication costs are equally if not more important. Our hypothesis is that an unequal partitioning that minimizes communication costs significantly can scale and perform better than conventional equal-work partitioning schemes. This tradeoff is dependent on the architecture as well as the application. We validate our hypothesis in the context of a finite-element computation utilizing adaptive mesh-refinement. Our central contribution is a new partitioning scheme that minimizes the overall runtime of subsequent computations by performing architecture and application-aware non-uniform work assignment in order to decrease time to solution, primarily by minimizing data-movement. We evaluate our algorithm by comparing it against standard space-filling curve based partitioning algorithms and observing time-to-solution as well as energy-to-solution for solving Finite Element computations on adaptively refined meshes. We demonstrate excellent scalability of our new partition algorithm up to $262,144$ cores on ORNL's Titan and demonstrate that the proposed partitioning scheme reduces overall energy as well as time-to-solution for application codes by up to 22.0%.

Fernando, Milinda↗
DOE OSTI2021

Error-controlled, progressive, and adaptable retrieval of scientific data with multilevel decomposition

Extreme-scale simulations and high-resolution instruments have been generating an increasing amount of data, which poses significant challenges to not only data storage during the run, but also post-processing where data will be repeatedly retrieved and analyzed for a long period of time. The challenges in satisfying a wide range of post-hoc analysis needs while minimizing the I/O overhead caused by inappropriate and/or excessive data retrieval should never be left unmanaged. In this paper, we propose a data refactoring, compressing, and retrieval framework capable of 1) fine-grained data refactoring with regard to precision; 2) incrementally retrieving and recomposing the data in terms of various error bounds; and 3) adaptively retrieving data in multi-precision and multi-resolution with respect to different analysis. With the progressive data re-composition and the adaptable retrieval algorithms, our framework significantly reduces the amount of data retrieved when multiple incremental precision are requested and/or the downstream analysis time when coarse resolution is used. Experiments show that the amount of data retrieved under the same progressively requested error bound using our framework is 64% less than that using state-of-the-art single-error-bounded approaches. Parallel experiments with up to 1, 024 cores and ~ 600 GB data in total show that our approach yields 1.36× and 2.52× performance over existing approaches in writing to and reading from persistent storage systems, respectively.

Liang, Xin↗
DOE OSTI2022

CEAZ: Accelerating Parallel I/O Via Hardware-Algorithm Co-Designed Adaptive Lossy Compression

As supercomputers continue to grow to exa-scale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounded lossy compressors to reduce the data size and improve the I/O performance. However, little work has been done for effectively offloading lossy compression onto FPGA-based SmartNICs to reduce the compression overhead. In this paper, we propose a hardware-algorithm co-design of efficient and adaptive lossy compressor for scientific data on FPGAs (called CEAZ) to accelerate parallel I/O. Our contribution is fourfold: (1) We propose an efficient Huffman coding approach that can adaptively update Huffman codewords online based on codewords generated offline (from a variety of representative scientific datasets). (2) We derive a theoretical analysis to support a precise control of compression ratio under an error-bounded compression mode, enabling accurate offline Huffman codewords generation. This also help us create a fixed-ratio compression mode for consistent throughput. (3) We develop an efficient compression pipeline by adopting cuSZ’s dual-quantization algorithm to our hardware use case. (4) We evaluate CEAC on five real-world datasets with both a single FPGA board and 256 nodes from Bridges2 supercomputer. Experiments show that CEAZ outperforms the second-best FPGA-based lossy compressor by 2× of throughput and 9.6× of compression ratio. It also improves MPI_File_write and MPI_Gather throughputs by up to 32.7× and 31.4×, respectively.

Zhang, Chengming↗