Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supercomputer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Single-Bubble Flow Boiling Phenomena - Interface Tracking Simulation

Boiling, as one of the most efficient heat transfer mechanisms, is widely used in various engineering systems. Better understanding and modeling of this process remains a major challenge in multiphase flow research. The distribution of vapor in boiling system affects the heat transfer rate and may cause unfavorable conditions, such as heater burn-out. A number of flow regimes have been observed experimentally. In general, there are three regimes under boiling conditions: nucleate boiling, transition boiling, and film boiling. The nucleate boiling regime is categorized into partial boiling regime and fully developed nucleate boiling, according to behavior of bubble dynamics and heat transfer characteristics. In the first region, as the wall temperature increases, the fraction of the wall surface subject to nucleate boiling increases until bubble formation occupies the entire heated surface. Heat transfer in this region is a complex mixture of single-phase forced convection and nucleate boiling. As bubble density increases, bubbles turn to coalesce and form insulating vapor patches, which impedes liquid flow back to the surface. The heat transfer rate under this condition reduces dramatically. This point is called Critical Heat Flux (CHF), which leads to boiling crisis. The behavior of boiling crisis is dependent on local fluid conditions due to bubble growth and departure. Experiments are the ultimate tool for boiling model development and verification, but they still lack some capabilities needed for better understanding of the local mechanism of this phenomena. It's difficult to capture many important details at the pressure/temperature conditions of interest using experimental techniques, such as full three dimensional measurements of velocity and temperature distribution and estimates of heat flux partitioning during the boiling process. The interface tracking simulation (ITS) is one of the promising approaches to describe heat transfer of boiling phenomena and their underlying mechanisms. The advances of high performance computing (HPC) in recent years made it possible to apply DNS to a wide variety of adiabatic flows. Some work has been done to implement evaporation / condensation models as well. Lee and Nydahl performed a numerical simulation of bubble growth and departure assuming that the bubble has the shape of a truncated sphere and a micro-layer exists during bubble growth. A 2-D cylindrical bubbles simulation has been done by Son with a simplified model to predict the heat flux in a thin liquid micro-layer. A direct simulation of 2D film boiling is conducted by Juric and Tryggvason. The film boiling, below critical pressure with a modified Level Set Method, is studied by Son and Dhir. Ose and Kunugi have developed a boiling and condensation model on subcooled boiling phenomena. Fuchs performed numerical simulations of bubble growth and departure considering wall conduction effects. Fully transient heat and fluid flow is modeled with a free surface of a rising bubble and a periodic calculation of the whole cycling of a growing, detaching, and rising bubble. Mukherjee and Kandikar have done a numerical simulation of an evaporating meniscus on a moving heated surface with level set method. The heat transfer associated with the advancing and receding contact angle has been studied. To develop the capability of physics-based boiling process, in the presented work the energy and momentum equations are coupled to simulate single-bubble growth scenarios. For a single bubble simulation in infinite liquid, the analytical solution exists and can be compared with the numerical results for verification purposes. The presented capabilities will be utilized in the large scale DNS of boiling flows in the future. The finite-element based code, PHASTA is used for the simulation. It is a parallel, hierarchic, higher-order accurate, adaptive, stabilized, transient analysis flow solver, which has been shown to be an effective tool for a wide range of single and two-phase flow problems. It has been shown to be highly scalable on top supercomputers ({approx}85% scaling on up to 3 million mesh partitions using a 92 billion element mesh . PHASTA has been shown to reliably predict the details of adiabatic bubbly flows as well as single-phase flows with heat transfer. To develop the capability of physics-based boiling process, in the presented work the energy and momentum equations are coupled to simulate a single-bubble growth scenario. For a single bubble growth in superheated water, the analytical solution exists and can be compared with the numerical results for verification purposes. The second-order accurate spatial and time discretization is used for the flow solver in the presented work. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Transforming Energy Through Computational Excellence: NREL HPC Resources for High Performance Computing for Energy Innovation (HPC4EI) Program

NREL hosts computing facilities for the U.S. Department of Energy's Office of Energy Efficiency and Renewable Energy (EERE). In 2024, NREL introduced Kestrel, the 3rd generation, EERE-sponsored supercomputer dedicated to renewable energy and energy efficiency research. Kestrel has already been used for hundreds of research projects by NREL, other national laboratories, and university partners. This includes HPC4EI-sponsored industrial partnerships.

high-performance computing↗

A Foundation for the Accurate Prediction of the Soft Error Vulnerability of Scientific Applications

Understanding the soft error vulnerability of supercomputer applications is critical as these systems are using ever larger numbers of devices that have decreasing feature sizes and, thus, increasing frequency of soft errors. As many large scale parallel scientific applications use BLAS and LAPACK linear algebra routines, the soft error vulnerability of these methods constitutes a large fraction of the applications overall vulnerability. This paper analyzes the vulnerability of these routines to soft errors by characterizing how their outputs are affected by injected errors and by evaluating several techniques for predicting how errors propagate from the input to the output of each routine. The resulting error profiles can be used to understand the fault vulnerability of full applications that use these routines.

99 GENERAL AND MISCELLANEOUS↗

Modeling Subsurface Reactive Flows Using Leadership-Class Computing

We describe our experiences running PFLOTRAN - a code for simulation of coupled hydro-thermal-chemical processes in variably saturated, non-isothermal, porous media - on leadership-class supercomputers, including initial experiences running on the petaflop incarnation of Jaguar, the Cray XT5 at the National Center for Computational Sciences at Oak Ridge National Laboratory. PFLOTRAN utilizes fully implicit time-stepping and is built on top of the Portable, Extensible Toolkit for Scientific Computation (PETSc). We discuss some of the hurdles to 'at scale' performance with PFLOTRAN and the progress we have made in overcoming them on leadership-class computer architectures.

99 GENERAL AND MISCELLANEOUS↗

Field-scale model for the natural attenuation of uranium at the Hanford 300 area using high performance computing

Three-dimensional reactive flow and transport simulations are carried out to better understand the persistence of uranium [U(VI)] at the Hanford 300 Area bordering the Columbia River. The massively parallel code PFLOTRAN developed under a DOE SciDAC-2 project is employed in the simulations. The calculations were carried out on 4096 processor cores on ORNL's Jaguar XT4 & 5 Cray supercomputers with run times on the order of 6 hours, equivalent to several years if performed on a single processor with sufficient memory. A new conceptual model is presented for understanding present-day and future attenuation rates of U(VI) at the 300 Area site. Unique to the conceptual model is the recognition of three distinct phases in the evolution of the site corresponding to: (I) initial emplacement of waste; (II) present-day conditions of slow leaching of U(VI) from the Hanford sediments; and (III) the complete removal of non-labile U(VI) from the source region. This work focuses on Phase II. Both labile and non-labile forms of U(VI) are included in the model as sorbed and mineralized forms of U(VI), respectively. The non-labile form plays an important role in providing a long-term source of U(VI) as it slowly leaches out of the Hanford sediment. Rapid fluctuations in the Columbia River stage on hourly, weekly and seasonal time scales are found to' playa major role in determining the migration behavior of U(VI). The calculations demonstrate that U(VI) is released into the Columbia River at a highly fluctuating rate in a ratchet-like behavior with nonzero U(VI) flux occurring only during flow from contaminated sediment into the river. The cumulative flux, however, is found to increase approximately linearly with time. The flow rate and U(VI) flux into the Columbia River predicted by the model is highly sensitive to the value used in the conductance boundary condition at the river-sediment interface. By fitting the conductance to the measured piezometric head at well 399-2-1, good agreement was obtained with observation for both the mean flux of water and U(VI) at the river-aquifer boundary with no other adjustable parameters. It was found that a multirate sorption model developed to account for long tails observed in U(VI) breakthrough curves obtained from column experiments with contaminated Hanford sediments, gave similar results for Phase II as an equilibrium surface complexation model for the discharge rate of U(VI) into the Columbia River.

54 ENVIRONMENTAL SCIENCES↗

Tracking tropical cloud systems - Observations for the diagnosis of simulations by the Weather Research and Forecasting (WRF) Model

To aid in improving model parameterizations of clouds and convection, we examine the capability of models, using explicit convection, to simulate the life cycle of tropical cloud systems in the vicinity of the ARM Tropical Western Pacific sites. The cloud life cycle is determined using a satellite cloud tracking algorithm (Boer and Ramanathan, 1997), and the statistics are compared to those of simulations using the Weather Research and Forecasting (WRF) Model. Using New York Blue, a Blue Gene/L supercomputer that is co-operated by Brookhaven and Stony Brook, simulations are run at a resolution comparable to the observations. Initial results suggest a computational paradox where, even though the size of the simulated systems are about half of that observed, their longevities are still similar. The explanation for this seeming incongruity will be explored.

54 ENVIRONMENTAL SCIENCES↗

The Evolution of Research and Education Networks and their Essential Role in Modern Science

ESnet - the Energy Sciences Network - has the mission of enabling the aspects of the US Department of Energy's Office of Science programs and facilities that depend on large collaborations and large-scale data sharing to accomplish their science. The Office of Science supports a large fraction of all U.S. physical science research and operates many large science instruments and supercomputers that are used by both DOE and University researchers. The network requirements of this community have been explored in some detail by ESnet and a long-term plan has been developed in order to ensure adequate networking to support the science. In this paper we describe the planning process (which has been in place for several years and was the basis of a new network that is just now being completed and a new set of network services) and examine the effectiveness and adequacy of the planning process in the light of evolving science requirements.

42 ENGINEERING↗

Tracking tropical cloud systems for the diagnosis of simulations by the weather research and forecasting (WRF) model

To aid in improving model parameterizations of clouds and convection, we examine the capability of models, using explicit convection, to simulate the life cycle of tropical cloud systems in the tropical warm pool. The cloud life cycle is determined using a satellite cloud tracking algorithm (Boer and Ramanathan, J. Geophys. Res., 1997), and the statistics are compared to those of simulations using the Weather Research and Forecasting (WRF) Model. Using New York Blue, a Blue Gene/L supercomputer that is co-operated by Brookhaven and Stony Brook, simulations are run at a resolution comparable to the observations. Initial results suggest that the organization of the mesoscale convective systems is particularly sensitive to the cloud microphysics parameterization used.

54 ENVIRONMENTAL SCIENCES↗

Reducing Application Runtime Variability on Jaguar XT5

Operating system (OS) noise is defined as interference generated by the OS that prevents a compute core from performing ``useful'' work. Compute node kernel daemons, network interfaces, and other OS related services are major sources of such interference. This interference on individual compute cores can vary in duration and frequency, and can cause de-synchronization (jitter) in collective communication tasks and thus results in variable (degraded) overall parallel application performance. This behavior is more observable in large-scale applications using certain types of collective communication primitives, such as MPI\_Allreduce. This paper presents our effort towards reducing the overall effect of OS noise on our large-scale parallel applications. Our tests were performed on the quad-core Jaguar, the Cray XT5 at the Oak Ridge National Laboratory Leadership Computing Facility (OLCF). At the time of these tests, Jaguar was a 1.4 PFLOPS supercomputer with 149,504 compute cores and 8 cores per node. We aggregated OS noise sources onto a single core for each node. The scientific application was then run on six of the remaining cores in each node. Our results show that we were able to improve the MPI_Allreduce performance by two orders of magnitude. We demonstrated up to a 30% boost in the performance of the Parallel Ocean Program (POP) using this technique.

97 MATHEMATICS AND COMPUTING↗

Plasticity and Failure in Nanocrystalline BCC Metals via MD Simulation

Advances in the ability to generate extremely high pressures in dynamic experiments such as at the National Ignition Facility has motivated the need for special materials optimized for those conditions as well as ways to probe the response of these materials as they are deformed. We need to develop a much deeper understanding of the behavior of materials subjected to high pressure, especially the effect of rate at the extremely high rates encountered in those experiments. Here we use large-scale molecular dynamics (MD) simulations of the high-rate deformation of nanocrystalline tantalum at pressures less than 100 GPa to investigate the processes associated with plastic deformation for strains up to 100%. We focus on 3D polycrystalline systems with typical grain sizes of 10-20 nm. We also study a rapidly quenched liquid (amorphous solid) tantalum. We apply a constant volume (isochoric), constant temperature (isothermal) shear deformation over a range of strain rates, and compute the resulting stress-strain curves to large strains for both uniaxial and biaxial compression. We study the rate dependence and identify plastic deformation mechanisms. The identification of the mechanisms is facilitated through a novel technique that computes the local grain orientation, returning it as a quaternion for each atom. This analysis technique is robust and fast, and has been used to compute the orientations on the fly during our parallel MD simulations on supercomputers. We find both dislocation and twinning processes are important, and they interact in the weak strain hardening in these extremely fine-grained microstructures. We also present some results on void growth in nanocrystalline BCC metals under tension.

36 MATERIALS SCIENCE↗

Reconciling Scratch Space Consumption, Exposure, and Volatility to Achieve Timely Staging of Job Input Data

Innovative scientific applications and emerging dense data sources are creating a data deluge for high-end computing systems. Processing such large input data typically involves copying (or staging) onto the supercomputer's specialized high-speed storage, scratch space, for sustained high I/O throughput. The current practice of conservatively staging data as early as possible makes the data vulnerable to storage failures, which may entail re-staging and consequently reduced job throughput. To address this, we present a timely staging framework that uses a combination of job startup time predictions, user-specified intermediate nodes, and decentralized data delivery to coincide input data staging with job start-up. By delaying staging to when it is necessary, the exposure to failures and its effects can be reduced. Evaluation using both PlanetLab and simulations based on three years of Jaguar (No. 1 in Top500) job logs show as much as 85.9% reduction in staging times compared to direct transfers, 75.2% reduction in wait time on scratch, and 2.4% reduction in usage/hour.

99 GENERAL AND MISCELLANEOUS↗

The Automatic Library Tracking Database

A library tracking database has been developed and put into production at the National Institute for Computational Sciences and the Oak Ridge Leadership Computing Facility (both located at Oak Ridge National Laboratory.) The purpose of the library tracking database is to track which libraries are used at link time on Cray XT5 Supercomputers. The database stores the libraries used at link time and also records the executables run in a batch job. With this data, many operationally important questions can be answered such as which libraries are most frequently used and which users are using deprecated libraries or applications. The infrastructure design and reporting mechanisms are presented along with collected production data.

97 MATHEMATICS AND COMPUTING↗

Scalable I/O Tracing and Analysis

As supercomputer performance approached and then surpassed the petaflop level, I/O performance has become a major performance bottleneck for many scientific applications. Several tools exist to collect I/O traces to assist in the analysis of I/O performance problems. However, these tools either produce extremely large trace files that complicate performance analysis, or sacrifice accuracy to collect high-level statistical information. We propose a multi-level trace generator tool, ScalaIOTrace, that collects traces at several levels in the HPC I/O stack. ScalaIOTrace features aggressive trace compression that generates trace files of near constant size for regular I/O patterns and orders of magnitudes smaller for less regular ones. This enables the collection of I/O and communication traces of applications running on thousands of processors. Our contributions also include automated trace analysis to collect selected statistical information of I/O calls by parsing the compressed trace on-the-fly and time-accurate replay of communication events with MPI-IO calls. We evaluated our approach with the Parallel Ocean Program (POP) climate simulation and the FLASH parallel I/O benchmark. POP uses NetCDF as an I/O library while FLASH I/O uses the parallel HDF5 I/O library, which internally maps onto MPI-IO. We collected MPI-IO and low-level POSIX I/O traces to study application I/O behavior. Our results show constant size trace files of only 145KB irrespective of the number of nodes for FLASH I/O benchmark, which exhibits regular I/O and communication pattern. For POP, we observe up to two orders of magnitude reduction in trace file sizes compared to flat traces. Statistical information gathered reveals insight on the number of I/O and communication calls issued in the POP and FLASH I/O. Such concise traces are unprecedented for isolated I/O and combined I/O plus communication tracing.

97 MATHEMATICS AND COMPUTING↗

Engineering PFLOTRAN for Scalable Performance on Cray XT and IBM BlueGene Architectures

We describe PFLOTRAN - a code for simulation of coupled hydro-thermal-chemical processes in variably saturated, non-isothermal, porous media - and the approaches we have employed to obtain scalable performance on some of the largest scale supercomputers in the world. We present detailed analyses of I/O and solver performance on Jaguar, the Cray XT5 at Oak Ridge National Laboratory, and Intrepid, the IBM BlueGene/P at Argonne National Laboratory, that have guided our choice of algorithms.

99 GENERAL AND MISCELLANEOUS↗

Jaguar/Kraken Time Lapse

Time lapse video of the upgrade to ORNL's Jaguar and the University of Tennessee's Kraken, the world's fastest and third-fastest supercomputers.

97 MATHEMATICS AND COMPUTING↗

Three dimensional simulations of Richtmyer-Meshkov instabilities in gas-curtain shock-tube experiments

It is not feasible to compute high Reynolds-number (Re) turbulent flows by directly resolving all scales of motion and material interfaces; instead, macroscale portions of the unsteady turbulent motion are computed while the rest of the flow physics including molecular diffusion and other micro scale physics (e.g., combustion) remains unresolved. In large eddy simulation (LES), the large energy containing structures are resolved whereas the smaller, presumably more isotropic, structures are filtered out and their unresolved subgrid scale (SGS) effects are modeled. The construction of SGS models for LES is pragmatic and based primarily on empirical information. Adding to the physics based difficulties in developing and validating SGS models, truncation terms due to discretization are comparable to SGS models in typical LES strategies, and LES resolution requirements become prohibitively expensive for practical flows and regimes. Implicit LES (ILES) - and monotone integrated LES (MILES) introduced earlier, effectively address the seemingly insurmountable issues posed to LES by underresolution, by relying on the use of SGS modeling and filtering provided implicitly by physics capturing numerics. Extensive work has demonstrated that predictive unresolved simulations of turbulent velocity fields are possible using any of the class of nonoscillatory finite-volume (NFV) numerical algorithms. Popular NFV methods such as flux-corrected transport (FCT), the piecewise parabolic method (PPM), total variation diminishing (TVD), and hybrid algorithms are being used for ILES. In many applications of interest, turbulence is generated by shock waves via Richtmyer-Meshkov instabilities (RMI). The instability results in vorticity being introduced at material interfaces by the impulsive loading of the shock wave. A critical feature of this impulsive driving is that the turbulence decays as dissipation removes kinetic energy from the system. RMI add the complexity of shock waves and other compressible effects to the basic physics associated with mixing; compressibility further affects the basic nature of material mixing when mass density and material mixing fluctuation effects are not negligible. Because RMI are shock-driven, resolution requirements make direct numerical simulation impossible even on the largest supercomputers. State-of-the-art simulations of RMI instabilities use hybrid methods which require switching between the use of shock capturing schemes and conventional (explicit) LES depending on the local flow conditions. On the other hand. because ILES is based on (locally adaptive) NFV methods it is naturally capable of emulating shock physics. The unique combination of shock and turbulence emulation capabilities supports direct use of ILES as an effective simulation anzatz in RMI research. This possibility is explored in the current paper in the context of a prototypical case study for which the available laboratory data can be used to test and validate ILES modeling based on various NFV methods.

74 ATOMIC AND MOLECULAR PHYSICS↗

Plasticity and Failure in Nanocrystalline BCC Metals via Molecular Dynamics Simulation

Advances in the ability to generate extremely high pressures in dynamic experiments such as at the National Ignition Facility has motivated the need for special materials optimized for those conditions as well as ways to probe the response of these materials as they are deformed. We need to develop a much deeper understanding of the behavior of materials subjected to high pressure, especially the effect of rate at the extremely high rates encountered in those experiments. Here we use large-scale molecular dynamics (MD) simulations of the high-rate deformation of nanocrystalline tantalum at pressures less than 100 GPa to investigate the processes associated with plastic deformation for strains up to 100%. We focus on 3D polycrystalline systems with typical grain sizes of 10-20 nm. We also study a rapidly quenched liquid (amorphous solid) tantalum. We apply a constant volume (isochoric), constant temperature (isothermal) shear deformation over a range of strain rates, and compute the resulting stress-strain curves to large strains for both uniaxial and biaxial compression. We study the rate dependence and identify plastic deformation mechanisms. The identification of the mechanisms is facilitated through a novel technique that computes the local grain orientation, returning it as a quaternion for each atom. This analysis technique is robust and fast, and has been used to compute the orientations on the fly during our parallel MD simulations on supercomputers. We find both dislocation and twinning processes are important, and they interact in the weak strain hardening in these extremely fine-grained microstructures. We also present some results on void growth in nanocrystalline BCC metals under tension.

36 MATERIALS SCIENCE↗

Functional Partitioning to Optimize End-to-End Performance on Many-core Architectures

Scaling computations on emerging massive-core supercomputers is a daunting task, which coupled with the significantly lagging system I/O capabilities exacerbates applications end-to-end performance. The I/O bottleneck often negates potential performance benefits of assigning additional compute cores to an application. In this paper, we address this issue via a novel functional partitioning (FP) runtime environment that allocates cores to specific application tasks - checkpointing, de-duplication, and scientific data format transformation - so that the deluge of cores can be brought to bear on the entire gamut of application activities. The focus is on utilizing the extra cores to support HPC application I/O activities and also leverage solid-state disks in this context. For example, our evaluation shows that dedicating 1 core on an oct-core machine for checkpointing and its assist tasks using FP can improve overall execution time of a FLASH benchmark on 80 and 160 cores by 43.95% and 41.34%, respectively.

97 MATHEMATICS AND COMPUTING↗