Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SUMMIT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Porting Adaptive Ensemble Molecular Dynamics Workflows to the Summit Supercomputer

Molecular dynamics (MD) simulations must take very small (femtosecond) integration steps in simulation-time to avoid numerical errors. Efficient use of parallel programming models and accelerators in state-of-the art MD programs now is pushing Moore’s limit for time-per-MD step. As a result, directly simulating timescales beyond milliseconds will not be attainable directly, even at exascale. However, concepts from statistical physics can be used to combine many parallel simulations to provide information about longer timescales and to adequately sample the simulation space, while preserving details about the dynamics of the system. Implementing such an approach requires a workflow program that allows adaptable steering of task assignments based on extensive statistical analysis of intermediate results. Here we report the implementation of such an adaptable workflow program to drive simulations on the Summit IBM Power System AC922, a pre-exascale supercomputer at the Oak Ridge Leadership Computing Facility (OLCF). We compare to experiences on Titan, Summit’s predecessor, report the performance of the workflow and its components, and describe the porting process. We find that using a workflow program managed by a Mongo database can provide the fault tolerance, scalable performance, task dispatch rate, and reconfigurability required for robust and portable implementation of ensemble simulations such as are used in enhanced-sampling molecular dynamics. This type of workflow generator can also be used to provide adaptive steering of ensemble simulations for other applications in addition to MD.

Ossyra, John R.↗

Usage Pattern Analysis for the Summit Login Nodes

High performance computing (HPC) users interact with Summit through dedicated gateways, also known as login nodes. The performance and stability of these login nodes can have a significant impact on the user experience. In this study, the performance and stability of Summit’s five login nodes are evaluated by analyzing the log data from 2020 and 2021. The analysis focuses on the computing capability (CPU average load, users and tasks) and the storage performance, along with the associated job scheduler activity. The outcome of this study can serve as the foundation of a predictive modeling framework that enables the system admin of an HPC system to preemptively deploy countermeasures before the onset of a system failure.

Eiffert, Brett↗

Proteome-scale Deployment of Protein Structure Prediction Workflows on the Summit Supercomputer

Deep learning has contributed to major advances in the prediction of protein structure from sequence, a fundamental problem in structural bioinformatics. With predictions now approaching the accuracy of crystallographic experiments, and with accelerators like GPUs and TPUs making inference using large models rapid, genome-level structure prediction becomes an obvious aim. Leadership-class computing resources can be used to perform genome-scale protein structure prediction using state-of-the-art deep learning models, providing a wealth of new data for systems biology applications. Here we describe our efforts to efficiently deploy the AlphaFold v.2 program, for full-proteome structure prediction, at scale on the Oak Ridge Leadership Computing Facility's resources, including the Summit supercomputer. We performed inference to produce the predicted structures for 40,526 protein sequences, corresponding to four prokaryotic proteomes and one plant proteome, using under 4,400 total Summit node hours, equivalent to using the majority of the supercomputer for a little over one hour. We also designed an optimized structure refinement that reduced the time for the relaxation stage of the AlphaFold pipeline by over 10X for longer sequences. We demonstrate the types of analyses that can be performed on proteome-scale collections of sequences, including a search for novel quaternary structures and implications for functional annotation.

Gao, Mu↗

Toward Large-Scale Image Segmentation on Summit

Semantic segmentation of images is an important computer vision task that emerges in a variety of application domains such as medical imaging, robotic vision and autonomous vehicles to name a few. While these domain-specific image analysis tasks involve relatively small image sizes (~ 10 2 × 10 2 ), there are many applications that need to train machine learning models on image data with extents that are orders of magnitude larger (~10 4 × 10 4 ). Training deep neural network (DNN) models on large extent images is extremely memory-intensive and often exceeds the memory limitations of a single graphical processing unit, a hardware accelerator of choice for computer vision workloads. Here, an efficient, sample parallel approach to train U-Net models on large extent image data sets is presented. Its advantages and limitations are analyzed and near-linear strong-scaling speedup demonstrated on 256 nodes (1536 GPUs) of the Summit supercomputer. Using a single node of the Summit supercomputer, an early evaluation of a recently released model parallel framework called GPipe is demonstrated to deliver ~ 2X speedup in executing a U-Net model with an order of magnitude larger number of trainable parameters than reported before. Performance bottlenecks for pipelined training of U-Net models are identified and mitigation strategies to improve the speedups are discussed. Together, these results open up the possibility of combining both approaches into a unified scalable pipelined and data parallel algorithm to efficiently train U-Net models with very large receptive fields on data sets of ultra-large extent images.

Seal, Sudip↗

Troubleshooting deep-learner training data problems using an evolutionary algorithm on Summit

Architectural and hyper-parameter design choices can influence deep-learner (DL) model fidelity but can also be affected by malformed training and validation data. However, practitioners may spend significant time refining layers and hyper-parameters before discovering that distorted training data was impeding training progress. We found that an evolutionary algorithm (EA) can be used to diagnose this kind of DL problem. An EA evaluated thousands of DL configurations on Summit that yielded no overall improvement in DL performance, which suggested problems with the training and validation data. We suspected that Contrast Limited Adaptive Histogram Equalization (CLAHE) enhancement that was applied to previously generated digital surface models (DSMs), for which we were training DLs to find errors, had damaged the training data. Subsequent runs with an alternative global normalization yielded significantly improved DL performance. However, the DL Intersection Over Union (IOU) still exhibited consistent sub-par performance, which suggested further problems with the training data and DL approach. Nonetheless, we were able to diagnose this problem within a 12-hour span via Summit runs, which prevented several weeks of unproductive trial-and-error DL configuration refinement, and allowed for a more timely convergence on an ultimately viable solution.

97 MATHEMATICS AND COMPUTING↗

Unprecedented cloud resolution in a GPU-enabled full-physics atmospheric climate simulation on OLCF’s summit supercomputer

Clouds represent a key uncertainty in future climate projection. While explicit cloud resolution remains beyond our computational grasp for global climate, we can incorporate important cloud effects through a computational middle ground called the Multi-scale Modeling Framework (MMF), also known as Super Parameterization. This algorithmic approach embeds high-resolution Cloud Resolving Models (CRMs) to represent moist convective processes within each grid column in a Global Climate Model (GCM). The MMF code requires no parallel data transfers and provides a self-contained target for acceleration. This study investigates the performance of the Energy Exascale Earth System Model-MMF (E3SM-MMF) code on the OLCF Summit supercomputer at an unprecedented scale of simulation. Hundreds of kernels in the roughly 10K lines of code in the E3SM-MMF CRM were ported to GPUs with OpenACC directives. A high-resolution benchmark using 4600 nodes on Summit demonstrates the computational capability of the GPU-enabled E3SM-MMF code in a full physics climate simulation.

58 GEOSCIENCES↗

Report of the 2014 Programming Models and Environments Summit

Programming models and environments play the essential roles in high performance computing of enabling the conception, design, implementation and execution of science and engineering application codes. Programmer productivity is strongly influenced by the effectiveness of our programming models and environments, as is software sustainability since our codes have lifespans measured in decades, so the advent of new computing architectures, increased concurrency, concerns for resilience, and the increasing demands for high-fidelity, multi-physics, multi-scale and data-intensive computations mean that we have new challenges to address as part of our fundamental R&D requirements. Fortunately, we also have new tools and environments that make design, prototyping and delivery of new programming models easier than ever. The combination of new and challenging requirements and new, powerful toolsets enables significant synergies for the next generation of programming models and environments R&D. This report presents the topics discussed and results from the 2014 DOE Office of Science Advanced Scientific Computing Research (ASCR) Programming Models & Environments Summit, and subsequent discussions among the summit participants and contributors to topics in this report.

97 MATHEMATICS AND COMPUTING↗

Future of Water Infrastructure and Innovation Summit

Energy and water systems are interdependent, and the U.S. Department of Energy (DOE) has invested in energy and water for several years, including the Energy-Water Desalination Hub (led by the National Alliance for Water Innovation, NAWI), and research and development (R&D) in resource recovery from wastewater, among other areas. The Advanced Manufacturing Office (AMO) at the U.S. Department of Energy (DOE) held The Future of Water Infrastructure and Innovation Summit to inform the understanding of future opportunities in the water space. The virtual summit was held on October 27 and 28, 2020. The organizers gathered information from a diverse group of relevant water and wastewater stakeholders representing academia, industry, government, nongovernmental organizations, and local/regional utilities. Topics from Day 1 discussions included: desalination, water and wastewater treatment/recovery, produced water, industrial management of water, and hydropower, conveyance, and water systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Summary Report for the Virtual Summit on Decarbonizing the Agriculture Sector

A virtual summit on decarbonizing the agriculture sector was organized on September 21-22, 2021, by Oak Ridge National Laboratory (ORNL) in anticipation of federal activities surrounding a greater role for the US Department of Energy (DOE) in support of the US Department of Agriculture (USDA) in areas related to climate and carbon impacts on the US agriculture sector. A series of thought-provoking talks were presented by leaders from industry, academia, and DOE (see attachment—final agenda, Appendix A). About 50 to 70 scientists and engineers actively participated at any one time during the summit in the talks and in the topical breakouts (Appendix B).

54 ENVIRONMENTAL SCIENCES↗

Washington State Cyber Incident Response Summit Event Report

On September 7 and 8, 2022, Pacific Northwest National Laboratory and Washington State Adjutant General Major General Bret Daugherty, with support from the Department of Homeland Security Cybersecurity and Infrastructure Security Agency, hosted the Washington State Cyber Incident Response Summit at Camp Murray in Washington State. The invite-only summit convened 40 key decision makers and stakeholders from across the state to discuss strategies and pilot a collaborative approach to improve cyber incident response readiness within Washington. In small working groups, participants shared incident response lessons learned, best practices, and opportunities for improvement within the water and transportation sectors. This report highlights the details of the workshop presentations and discussions.

97 MATHEMATICS AND COMPUTING↗

Workflows Community Summit 2024: Future Trends and Challenges in Scientific Workflows

The 2024 Workflows Community Summit report presents the outcomes of a three-day international gathering that brought together 109 experts from 18 countries to discuss future trends and challenges in scientific workflows. The summit focused on six key areas: time-sensitive workflows, convergence of AI and HPC workflows, multi-facility workflows, heterogeneous HPC environments, user experience and interfaces, and FAIR computational workflows. Discussions highlighted emerging challenges such as integrating AI with traditional HPC, managing workflows across diverse facilities, addressing heterogeneity in computing environments, and ensuring workflows are findable, accessible, interoperable, and reusable (FAIR). The report outlines recent advances, ongoing challenges, and provides recommendations for each topic area, emphasizing the need for standardization, improved interoperability, and the development of more sophisticated tools and frameworks to support the evolving landscape of scientific workflows in the era of exascale computing and AI integration.

97 MATHEMATICS AND COMPUTING↗

Assessments of Ali, Dome A, and Summit Camp for mm-wave Observations Using MERRA-2 Reanalysis

NASA's latest MERRA-2 reanalysis of the modern satellite measurements has made atmospheric data easily accessible with unprecedented uniformity, fidelity, and completeness. In this paper, these data are used to evaluate five sites for millimeter-wave (mm-wave) observations. These include two established sites (South Pole and Chajnantor, Atacama), and three new sites (Ali in Tibet, Dome A in Antarctica, and Summit Camp in Greenland). Atmospheric properties including precipitable water vapor (PWV), sky brightness temperature fluctuations, and ice and liquid water paths are derived and compared. Dome A emerges to be the best among those evaluated, with PWV and fluctuations smaller than the second-best site, South Pole, by more than a factor of 2. It is found that the higher site in Ali (6100 m) is on par with Cerro Chajnantor (5612 m) in terms of transmission and stability. The lower site in Ali (5250 m) planned for the first stage of observations at 90/150 GHz provides conditions comparable to those on the Chajnantor Plateau. These analyses confirm Ali to be an excellent mm-wave site in the Northern Hemisphere that will complement well-established Southern sites. According to MERRA-2 data, the observing conditions at Summit Camp are also comparable to Cerro Chajnantor. Furthermore, it is more affected by the presence of liquid water clouds.

79 ASTRONOMY AND ASTROPHYSICS↗

Determination of Mercury Content in a Shallow Firn Core from Summit, Greenland by Isotope Dilution Inductively Coupled Plasma Mass Spectrometry

The total mercury Hg content was determined in 6 cm sections of a near-surface 7 m firn core and in surrounding surface snow from Summit, Greenland (elevation: 3238 m, 72.58 N, 38.53 W) in May 2001 by isotope dilution cold-vapor inductively coupled plasma mass spectrometry (ID-CV-ICP-MS). The focus of this research was to evaluate the capability of the ID-CV-ICPMS technique for measuring trace levels of Hg typical of polar snow and firn. Highly enriched Hg-201 isotopic spike is added to approximately 10 ml melted core and thoroughly mixed. The Hg(+2) in the sample is reduced on line with tin (II) chloride (SnCl2) and the elemental Hg (Hg(0)) vapor pre-concentrated on to gold gauze using a commercial amalgam system. The Hg is then thermally desorbed and introduced into a quadrupole ICP-MS. The blank corrected Hg concentrations determined for all samples ranged from 0.25 ng/L to 1.74 ng/L (ppt) (average 0.59 ng/L plus or minus 0.28 ng/L) and fall within the range of those previously determined by Boutron et al., 1998 (less than or equal to 0.05 ng/L to 2.0 ng/L) for the Summit site. The average blank value was 0.19 ng/L plus or minus 0.045 ng/L (n=6). The Hg values specifically for the firn core range from 0.25 ng/L to 0.87 ng/L (average 0.51 ng/L plus or minus 0.13 ng/L) and show both values declining with time and larger variability in concentration in the top 1.8 m.

Mann, Jacqueline L.↗

Scaling the Summit: Deploying the World's Fastest Supercomputer

Summit, the latest flagship supercomputer deployed at Oak Ridge Leadership Computing Facility (OLCF), became the number one system in the Top500 list in June 2018 and remains in the top spot in the most recent edition of the list. An extensive acceptance test plan was developed to evaluate the unique features introduced in the Summit architecture and system software stack. The acceptance test also includes tests to ensure that the system is reliable, stable, and performant.

Melesse Vergara, Veronica↗

Performance Evaluation of Python Based Data Analytics Frameworks in Summit: Early Experiences

The explosion in the volumes of data generated from ever-larger simulation campaigns and experiments or observations necessitates competent tools for data wrangling and analysis). While the Oak Ridge Leadership Computing Facility (OLCF) provides a variety of tools to perform data wrangling and data analysis tasks, Python based tools often lack scalability, or the ability to fully exploit the computational capability of OLCF’s Summit supercomputer. NVIDIA RAPIDS and Dask offer a promising solution to accelerate and distribute data analytics workloads from personal computers to heterogeneous supercomputing systems. We discuss early performance evaluation results of RAPIDS and Dask on Summit to understand their capabilities, scalability, and limitations. Our evaluation includes a subset of RAPIDS libraries, i.e., cuDF, cuML, and cuGraph, and Chainer’s CuPy, and their multi-GPU variants when available.We also draw on the observed trends from the performance evaluation results to discuss best practices for maximizing performance.

Hernandez Arreguin, Benjamin↗

Pseudonymized User-Perspective Summit Login Node Data for 2020 and 2021

This dataset contains hourly snapshot data from each of the 5 login nodes of the Summit supercomputer at Oak Ridge Leadership Computing Facility (OLCF) over a period of 2 years, starting January 2020 and ending after December 2021. The snapshots include lists of currently logged-in users, CPU and memory usage, status of users' batch jobs, and disk usage statistics. Usernames, project identifiers, and file paths have been pseudonymized in order to allow studies of user behavior without divulging Personally Identifiable Information (PII).

97 MATHEMATICS AND COMPUTING↗

Collection of Disk Failure Events from Alpine, the Parallel File System for Summit Supercomputer

This dataset contains disk (HDD) failure events collected from the Alpine storage system of the Summit supercomputer, hosted at OLCF, spanning from January 4, 2019, to December 21, 2023 (a total of 4 years, 11 months, and 18 days), covering 89% of its operational lifetime. It includes 3,766 disk failure events, each recorded with its detection timestamp (in ISO 8601 format) and detailed by its location within the storage system - rack, enclosure, and drive slot number.

97 MATHEMATICS AND COMPUTING↗

Assessment of NASA Airborne Laser Altimetry Data Using Ground-Based GPS Data near Summit Station, Greenland

A series of NASA airborne lidars have been used in support of satellite laser altimetry missions. These airbornelaser altimeters have been deployed for satellite instrument development, for spaceborne data validation, and to bridge the data gap between satellite missions. We used data from ground-based Global Positioning System (GPS) surveys of an 11 km long track near Summit Station, Greenland, to assess the surface elevation bias and measurement precision of three airborne laser altimeters including the Airborne Topographic Mapper (ATM), the Land, Vegetation, and Ice Sensor (LVIS), and the Multiple Altimeter Beam Experimental Lidar (MABEL). Ground-based GPS data from the monthly ground-based traverses, which commenced in 2006, allowed for the assessment of nine airborne lidar surveys associated with ATM and LVIS between 2007 and 2016. Surface elevation biases for these altimeters over the flat, ice-sheet interior are less than 0.12 m, while assessments of measurement precision are 0.09 m or better. Ground-based GPS positions determined both with and without differential post-processing techniques provided internally consistent solutions. Results from the analyses of ground-based and airborne data provide validation strategy guidance for the Ice, Cloud, and land Elevation Satellite 2 (ICESat-2) elevation and elevation-change data products.

Summit Station↗