Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Advanced Supercomputing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Generalizable coordination of large multiscale workflows: challenges and learnings at scale

The advancement of machine learning techniques and the heterogeneous architectures of most current supercomputers are propelling the demand for large multiscale simulations that can automatically and autonomously couple diverse components and map them to relevant resources to solve complex problems at multiple scales. Nevertheless, despite the recent progress in workflow technologies, current capabilities are limited to coupling two scales. In the first-ever demonstration of using three scales of resolution, we present a scalable and generalizable framework that couples pairs of models using machine learning and in situ feedback. We expand upon the massively parallel Multiscale Machine-Learned Modeling Infrastructure (MuMMI), a recent, award-winning workflow, and generalize the framework beyond its original design. We discuss the challenges and learnings in executing a massive multiscale simulation campaign that utilized over 600,000 node hours on Summit and achieved more than 98% GPU occupancy for more than 83% of the time. We present innovations to enable several orders of magnitude scaling, including simultaneously coordinating 24,000 jobs, and managing several TBs of new data per day and over a billion files in total. Finally, we describe the generalizability of our framework and, with an upcoming open-source release, discuss how the presented framework may be used for new applications.

Bhatia, Harsh↗

Parallel CFD design on network-based computer

Combining multiple engineering workstations into a network-based heterogeneous parallel computer allows application of aerodynamic optimization with advanced computational fluid dynamics codes, which can be computationally expensive on mainframe supercomputers. This paper introduces a nonlinear quasi-Newton optimizer designed for this network-based heterogeneous parallel computing environment utilizing a software called Parallel Virtual Machine. This paper will introduce the methodology behind coupling a Parabolized Navier-Stokes flow solver to the nonlinear optimizer. This parallel optimization package is applied to reduce the wave drag of a body of revolution and a wing/body configuration with results of 5% to 6% drag reduction.

Cheung, Samson↗

Review of multi-dimensional large-scale kinetic simulation and physics validation of ion acceleration in relativistic laser-matter interaction

Two new experimental technologies enabled realization of Break-out afterburner (BOA) - High quality Trident laser and free-standing C nm-targets. VPIC is an powerful tool for fundamental research of relativistic laser-matter interaction. Predictions from VPIC are validated - Novel BOA and Solitary ion acceleration mechanisms. VPIC is a fully explicit Particle In Cell (PIC) code: models plasma as billions of macro-particles moving on a computational mesh. VPIC particle advance (which typically dominates computation) has been optimized extensively for many different supercomputers. Laser-driven ions lead to realization promising applications - Ion-based fast ignition; active interrogation, hadron therapy.

ACCELERATION↗

Mapping Human Dynamics

Researchers at Oak Ridge National Laboratory are mapping the global footprints of human activity with unprecedented spatiotemporal resolution. With a global population now approaching 8 billion people, this herculean effort demands advanced machine learning, artificial intelligence, and one of the world’s fastest supercomputers.

Rose, Amy↗

Arctic sea-ice loss drives a strong regional atmospheric response over the North Pacific and North Atlantic on decadal scales

Previous studies have suggested that Arctic sea-ice loss can have a profound influence on atmospheric circulation far away from the Arctic. However, there is little scientific consensus on the features of these remote responses, with the opposite impacts reported. Here we present a multi-model analysis of the decadal climate response to Arctic sea-ice loss using state-of-the-art energy conserving methodologies to isolate the impacts of sea-ice decline. We observe weakening of the Aleutian Low and development of a geopotential ridge in the North Pacific, associated with drier winter conditions over the southwest United States. Over the Atlantic, a negative NAO-like response drives wetter winter conditions across the western Mediterranean. These decadal-scale impacts substantially differ from reported centennial-scale responses to Arctic sea-ice loss simulated using non-energy conserving methodologies. Factors such as the timescale of the response and methodologies used to isolate the impacts of disappearing sea-ice cover should be carefully considered when consolidating scientific understanding on the future impacts of changing Arctic.

54 ENVIRONMENTAL SCIENCES↗

Effective Use of Cray Supercomputers

The effective use of a supercomputer depends on many aspects, including the ability of users to write efficient programs to use the resources of the system in an optimal manner. However, it is the responsibility of the system managers of these systems to insure the maximum effectiveness of the overall system is achieved. Many varying techniques have been developed at the Numerical Aerodynamic Simulation (NAS) Program to advance the management of these critical systems. Many of the issues and techniques used for managing supercomputers are common to multi-user UNIX systems, regardless of the version of UNIX or the power of the hardware. However, a UNICOS supercomputer presents some special challenges and requires additional features and tools to be developed to effectively manage the system. Only part of the challenge is related to performance monitoring and improvement. Much of the responsibility of the system manager is to provide fair and consistent access to the system resources, which is at times a difficult problem. After an introduction to the environment at the Numerical Aerodynamic Simulation Project is given as background this paper will first discuss the areas which are common to UNDC system management. Then the paper will discuss the specific areas of UNICOS which must be used to operate the system efficiently. The paper goes on to discuss the methods of supporting individual users in order to increase their effectiveness and the efficiency of their programs. This is accomplished through a professional support staff who interact on a daily basis to support the NAS scientific client community.

Kramer, William T. C.↗

Oak Ridge National Laboratory's Strategic Research and Development Insights for Digital Twins

Oak Ridge National Laboratory (ORNL) is pleased to provide our response to the NITRD RFI on Digital Twins Research and Development. Digital twins are virtual representations of physical systems, leveraging real-time data to simulate and predict behaviors. ORNL is advancing digital twin technology across various disciplines, including neutron scattering, networking, science ecosystems, supercomputing, secure facilities, mobility technologies, materials design and discovery, power systems, fusion reactors, biological sciences, and earth observation. These efforts aim to enhance scientific research, operational efficiency, and decision-making processes. ORNL facilities, such as the High Flux Isotope Reactor (HFIR), Grid-C, Spallation Neutron Source (SNS), and Oak Ridge Leadership Computing Facility (OLCF), provide the infrastructure to develop and demonstrate these digital twin technologies. In this document, we lay out key challenges, research gaps, and future opportunities based on our experience with digital twins that aim to serve as useful contributions towards a National Digital Twins R&D Strategic Plan. In the remaining document, we address nine of the thirteen topic areas specified in the RFI.

97 MATHEMATICS AND COMPUTING↗

Computational aerodynamics and design

The availability of supercomputers and the ingenuity of computational aerodynamics in design, and prospects for continued advancement are assessed.

Ballhaus, W. F., Jr.↗

Analysis of the Cause of High External Q Modes in the JLab High Gradient Prototype Cryomodule Renascence

The Renascence cryomodule [1] installed in CEBAF in 2007 consists of 8 cavities as shown in Figure 1. The first three cavities (No.1-No.3) in the upstream end are of the Low Loss (LL) shape design, and the remaining 5 cavities (No.4-No.8) on the beam downstream end are the High Gradient (HG) shape design. The fundamental power couplers (FPCs) are the rectangular waveguides, and the little cylindrical structures are the HOM couplers. The locations of the FPC in the last four cavities are mirrored about the beam z axis. Cavities No.4 and No.5 form a back-to-back cavity pair. Among the HG cavities installed in the Renascence cryomodule, the only identifiable difference from their fabrication documentation is that cavity No.5 received an extra EBW pass on one equator weld, specifically cell 5. The non-uniform mechanical tuning required to compensate the fundamental mode tune and flatness for the extra shrinkage of this cell is believed to contribute the most significant differences from the other HG cavities. Beam based instability studies on this cryomodule in CEBAF have shown a significant beam breakup (BBU) threshold current reduction, well below design value. Frequency spectrum peaked by the off-sided beam power indicated the cause is due to abnormal high Q modes in the cavity No.5. Measured beam off-axis position at the cavity No.5 does not correspond to the shunt impedances calculated for an ideal cavity. Low power RF measurements have identified that the problematic modes are in the second dipole band (TM110 like). Three of the modes have external Qs two orders magnitude higher than the others, while the rest of modes in the first two dipole bands are normal in terms of the design values. The cause of this abnormality and the future impact on the BBU was not able to be resolved due to the limitations of information that can be obtained from the measurements. It is important to understand the cause of this abnormality so that effective QA/QC measures can be implemented to avoid such problem in the final upgrade design and manufacture. The goal of this work is to utilize advanced simulation tools to understand the high external Q (Q{sub ext}) problem observed in the Renascence cryomodule. In the past years, SLAC has built a set of state-of-the-art advanced simulation tools based on finite-element unstructured meshes and parallel computation implementations on supercomputers [2, 3]. The codes are capable of simulating large complex RF systems with unprecedented resolution and turnaround time. They have been successfully applied to many existing and future accelerator R&D projects to improve the machine performance and to optimize the designs. These tools are essential to perform accurate full system analyses such as the JLab's SRF cavities. We will use the simulation results and the data from the RF measurements to gain a better understanding of the cavity performance and tolerance issues and provide a solid foundation to do the BBU simulation and prediction for the 12GeV Upgrade project by using JLab's BBU codes. In this report, we will focus on the following two main tasks: (1) Ideal cavity simulation--to evaluate the effectiveness of the damping by the higher-order-mode (HOM) couplers, and search for possible trapped modes in a back-to-back cavity pair (e.g. cavity No.4 & No.5). (2) Abnormal cavity study--to understand the cause of the high Q{sub ext} modes in cavity No.5 using an advanced Shape Determination Tool.

43 PARTICLE ACCELERATORS↗

Science and Technology Review January/February 2008

This month's issue has the following articles: (1) The Edward Teller Centennial--Commentary by George H. Miller; (2) Edward Teller's Century: Celebrating the Man and His Vision--Colleagues at the Laboratory remember Edward Teller, cofounder of Lawrence Livermore, adviser to U.S. presidents, and physicist extraordinaire, on the 100th anniversary of his birth; (3) Quark Theory and Today's Supercomputers: It's a Match--Thanks to the power of BlueGene/L, Livermore has become an epicenter for theoretical advances in particle physics; and (4) The Role of Dentin in Tooth Fracture--Studies on tooth dentin show that its mechanical properties degrade with age.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Visualization on supercomputing platform level II ASC milestone (3537-1B) results from Sandia.

This report provides documentation for the completion of the Sandia portion of the ASC Level II Visualization on the platform milestone. This ASC Level II milestone is a joint milestone between Sandia National Laboratories and Los Alamos National Laboratories. This milestone contains functionality required for performing visualization directly on a supercomputing platform, which is necessary for peta-scale visualization. Sandia's contribution concerns in-situ visualization, running a visualization in tandem with a solver. Visualization and analysis of petascale data is limited by several factors which must be addressed as ACES delivers the Cielo platform. Two primary difficulties are: (1) Performance of interactive rendering, which is most computationally intensive portion of the visualization process. For terascale platforms, commodity clusters with graphics processors(GPUs) have been used for interactive rendering. For petascale platforms, visualization and rendering may be able to run efficiently on the supercomputer platform itself. (2) I/O bandwidth, which limits how much information can be written to disk. If we simply analyze the sparse information that is saved to disk we miss the opportunity to analyze the rich information produced every timestep by the simulation. For the first issue, we are pursuing in-situ analysis, in which simulations are coupled directly with analysis libraries at runtime. This milestone will evaluate the visualization and rendering performance of current and next generation supercomputers in contrast to GPU-based visualization clusters, and evaluate the performance of common analysis libraries coupled with the simulation that analyze and write data to disk during a running simulation. This milestone will explore, evaluate and advance the maturity level of these technologies and their applicability to problems of interest to the ASC program. Scientific simulation on parallel supercomputers is traditionally performed in four sequential steps: meshing, partitioning, solver, and visualization. Not all of these components are necessarily run on the supercomputer. In particular, the meshing and visualization typically happen on smaller but more interactive computing resources. However, the previous decade has seen a growth in both the need and ability to perform scalable parallel analysis, and this gives motivation for coupling the solver and visualization.

99 GENERAL AND MISCELLANEOUS↗

Airfoil Computational Fluid Dynamics - 2k shapes, 25 AoA's, 3 Re numbers

This dataset contains aerodynamic quantities - including flow field values (momentum, energy, and vorticity) and summary values (coefficients of lift, drag, and momentum) - for 1,830 airfoil shapes computed using the HAM2D CFD (computational fluid dynamics) model. The airfoil shapes were designed using the separable shape tensor parameterization that encodes two-dimensional shapes as elements of the Grassmann manifold. This data-driven approach learns two independent spaces of parameter from a collection of sample airfoils. The first captures large-scale, linear perturbations, and the second defines small-scale, higher-order perturbations. For this dataset, we used the G2Aero database of over 19,000 airfoil shapes to learn a parameter space that captured a wide array of shape characteristics. We sampled airfoil designs over both parameter spaces to explore the full range of possible shape variations. The aerodynamic quantities for the generated airfoil were obtained using the HAM2D code, which is a finite-volume Reynolds-averaged Navier-Stokes (RANS) flow solver. We employ a fifth-order WENO scheme for spatial reconstruction with Roe's flux difference scheme for inviscid flux and second-order central differencing for viscous flux. A preconditioned GMRES method is applied for implicit integration. The Spalart-Allmaras 1-eq turbulence model is used for the turbulence closure, and the Medida-Baeder 2-eq transition model is applied to account for the effects of laminar turbulent transition. The airfoil grid is generated with a total of 400 points on the airfoil surface, the initial wall-normal spacing of y+ = 1, and an outer boundary located at 300 chord lengths away from the wall. The CFD simulations are performed at a freestream Mach number of 0.1, for or three different Reynolds' numbers (3M, 6M, and 9M), and for 25 angles of attack from -4 deg. to 20 deg. with 1 degree increments. Across all these various parameters, this dataset includes the results from over 250,000 CFD simulations. The simulations were performed using the Bridges-2 system at the Pittsburgh Supercomputing Center in February 2023 as part of the INTEGRATE project funded by the Advanced Research Projects Agency - Energy, in the U.S. Department of Energy. The data was collected, reformatted, and preprocessed for this OEDI submission in July 2023 under the Foundational AI for Wind Energy project funded by the U.S. Department of Energy Wind Energy Technologies Office. This dataset is intended to serve as a benchmark against which new artificial intelligence (AI) or machine learning (ML) tools may be tested. Baseline AI/ML methods for analyzing this dataset have been implemented, and a link to their repository containing those models has been provided. The .h5 data file structure can be found in the GitHub Repository resource under explore_airfoil_2k_data.ipynb.

2k↗

Airfoil Computational Fluid Dynamics - 9k shapes, 2 AoA's

This dataset contains aerodynamic quantities - including flow field values (momentum, energy, and vorticity) and summary values (coefficients of lift, drag, and momentum) - for 8,996 airfoil shapes, computed using the HAM2D CFD (computational fluid dynamics) model. The airfoil shapes were designed using the separable shape tensor parameterization that encodes two-dimensional shapes as elements of the Grassmann manifold. This data-driven approach learns two independent spaces of parameter from a collection of sample airfoils. The first captures large-scale, linear perturbations, and the second defines small-scale, higher-order perturbations. For this data, we used the G2Aero database of over 19,000 airfoil shapes to learn a parameter space that captured a wide array of shape characteristics. We fixed the linear deformations to be the mean over the database and sampled new shapes over a four-dimensional parameter space of higher-order perturbation. This sampling approaches allows for isolated analysis of non-linear airfoil shape deformations while holding other aspects (e.g., airfoil thickness) approximately constant. The aerodynamic quantities for the generated airfoil were obtained using the HAM2D code, which is a finite-volume Reynolds-averaged Navier-Stokes (RANS) flow solver. We employ a fifth-order WENO scheme for spatial reconstruction with Roe's flux difference scheme for inviscid flux and second-order central differencing for viscous flux. A preconditioned GMRES method is applied for implicit integration. The Spalart-Allmaras 1-eq turbulence model is used for the turbulence closure, and the Medida-Baeder 2-eq transition model is applied to account for the effects of laminar turbulent transition. The airfoil grid is generated with a total of 400 points on the airfoil surface, the initial wall-normal spacing of y+ = 1, and an outer boundary located at 300 chord lengths away from the wall. The CFD simulations are performed at a freestream Mach number of 0.1, Reynolds number of 9M, and at two angles of attack, 4 deg. and 12 deg. The simulations were performed using the Bridges-2 system at the Pittsburgh Supercomputing Center in February 2023 as part of the INTEGRATE project funded by the Advanced Research Projects Agency - Energy in the U.S. Department of Energy. The data was collected, reformatted, and preprocessed for this OEDI submission in July 2023 under the Foundational AI for Wind Energy project funded by the U.S. Department of Energy Wind Energy Technologies Office. This dataset is intended to serve as a benchmark against which new artificial intelligence (AI) or machine learning (ML) tools may be tested. Baseline AI/ML methods for analyzing this dataset have been implemented, and a link to their repository containing those models has been provided. The .h5 data file structure can be found in the GitHub Repository resource under explore_airfoil_9k_data.ipynb.

9k↗

Aviation Research and the Internet

The Internet is a network of networks. It was originally funded by the Defense Advanced Research Projects Agency or DOD/DARPA and evolved in part from the connection of supercomputer sites across the United States. The National Science Foundation (NSF) made the most of their supercomputers by connecting the sites to each other. This made the supercomputers more efficient and now allows scientists, engineers and researchers to access the supercomputers from their own labs and offices. The high speed networks that connect the NSF supercomputers form the backbone of the Internet. The World Wide Web (WWW) is a menu system. It gathers Internet resources from all over the world into a series of screens that appear on your computer. The WWW is also a distributed. The distributed system stores data information on many computers (servers). These servers can go out and get data when you ask for it. Hypermedia is the base of the WWW. One can 'click' on a section and visit other hypermedia (pages). Our approach to demonstrating the importance of aviation research through the Internet began with learning how to put pages on the Internet (on-line) ourselves. We were assigned two aviation companies; Vision Micro Systems Inc. and Innovative Aerodynamic Technologies (IAT). We developed home pages for these SBIR companies. The equipment used to create the pages were the UNIX and Macintosh machines. HTML Supertext software was used to write the pages and the Sharp JX600S scanner to scan the images. As a result, with the use of the UNIX, Macintosh, Sun, PC, and AXIL machines, we were able to present our home pages to over 800,000 visitors.

Scott, Antoinette M.↗

Workflows for Science: A comprehensive guide for ensemble workflow tools usage with applications on OLCF systems

The growing demand for robust computational and workflow environments for scientific applications and user communities at the Oak Ridge Leadership Computing Facility (OLCF) has prompted collaboration with ensemble tools development teams and facility users to produce this technical paper. We connect science applications to the RADICAL-Pilot (RP) workflow tool to execute ensemble instantiations using the Frontier supercomputer. The documented installation, usage, and execution demonstrates how RP streamlines scientific workflows at OLCF. We outline the specific steps OLCF users can follow to integrate this tool with their applications and advance their research. This document stands as a comprehensive guide to OLCF users of ensemble workflow tools with examples on real applications using the Frontier supercomputer.

97 MATHEMATICS AND COMPUTING↗

Two new SciDAC institutes promote mathematical tools and software technology for high-performance computing

Bigger is often said to be better, and the newest extreme-scale computers certainly are bigger, with millions of processing units. Moreover, the breadth of science performed on the U.S. Department of Energy (DOE) computing facilities is expanding, with new technology such as artificial intelligence emerging. These advances are exciting, creating new opportunities for scientific discovery; however, they also raise new questions for scientists who want to exploit these advances for tackling more complex problems. Will my simulation code be able to utilize the accelerators in extreme-scale computing systems? Can I take advantage of the deepening memory hierarchy in heterogeneous processors? Is there a way around bottlenecks caused by the widening ratio of peak floating-point operations per second to I/0 bandwidth? How can I manage my huge amounts of data effectively? Can I analyze data in situ, or must I transfer it to offline storage for later analysis? To address such questions, DOE announced that it is providing $57.5 million over the next five years for two multidisciplinary teams — FASTMath and RAPIDS2 — to develop new tools and techniques to harness supercomputers for scientific discovery. The teams, called SciDAC Institutes, are part of the Scientific Discovery through Advanced Computing program.

97 MATHEMATICS AND COMPUTING↗

Argonne News Brief: Cancer’s Big Data Problem

Data is pouring into the hands of cancer researchers, thanks to improvements in imaging, models and understanding of genetics. But they’ll need a lot of help—and some powerful supercomputers—to translate this data into better, more personalized treatment for cancer patients. A new initiative called the Joint Design of Advanced Computing Solutions for Cancer, which taps four different national laboratories, is poised to help.

60 APPLIED LIFE SCIENCES↗

Exploring the Landscape of Distributed Graph Clustering on Leadership Supercomputers

The rapid growth of large-scale datasets in fields like biology and social networks has driven the need for advanced graph analytics techniques. Community detection, a fundamental task in graph analytics, identifies closely connected groups of nodes within a network, providing valuable insights across various disciplines. This study focuses on two classic community detection methods, the Louvain algorithm and Markov Clustering (MCL), and evaluates the performance of two prominent distributed community detection algorithms: HiPDPL-GPU, our prior implementation, and HipMCL. We conduct experiments on GPU-accelerated heterogeneous HPC systems, Summit and Frontier, to assess their performance under varying conditions. Our objective is to identify the strengths and weaknesses of these algorithms in terms of scalability, and quality of solutions. We evaluate these algorithms on a diverse set of 70+ networks spanning 13 domains, with sizes ranging up to 4.2 billion edges. Our results demonstrate that HiPDPL-GPU consistently outperforms HipMCL, especially for large-scale networks. HiPDPL-GPU achieves significantly faster runtimes (47x to 1439x), higher modularity scores, and improved scalability. These findings highlight HiPDPL-GPU as a promising solution for efficient and effective large-scale graph analytics in diverse application domains, and provide insights into the feasibility of using MCL-based approaches for certain application domains.

Community detection, graph algorithms↗