Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “high performance computing systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Scaling to 150K cores: recent algorithm and performance engineering developments enabling XGC1 to run at scale

Particle-in-cell (PIC) methods have proven to be effective in discretizing the Vlasov-Maxwell system of equations describing the core of toroidal burning plasmas for many decades. Recent physical understanding of the importance of edge physics for stability and transport in tokamaks has lead to development of the fi rst fully toroidal edge PIC code - XGC1. The edge region poses special problems in meshing for PIC methods due to the lack of closed flux surfaces, which makes fi eld-line following meshes and coordinate systems problematic. We present a solution to this problem with a semi- field line following mesh method in a cylindrical coordinate system. Additionally, modern supercomputers require highly concurrent algorithms and implementations, with all levels of the memory hierarchy being effe ciently utilized to realize optimal code performance. This paper presents a mesh and particle partitioning method, suitable to our meshing strategy, for use on highly concurrent cache-based computing platforms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Distributing Power Grid State Estimation on HPC Clusters A System Architecture Prototype

The future power grid is expected to further expand with highly distributed energy sources and smart loads. The increased size and complexity lead to increased burden on existing computational resources in energy control centers. Thus the need to perform real-time assessment on such systems entails efficient means to distribute centralized functions such as state estimation in the power system. In this paper, we present our early prototype of a system architecture that connects distributed state estimators individually running parallel programs to solve non-linear estimation procedure. The prototype consists of a middleware and data processing toolkits that allows data exchange in the distributed state estimation. We build a test case based on the IEEE 118 bus system and partition the state estimation of the whole system model to available HPC clusters. The measurement from the testbed demonstrates the low overhead of our solution.

Distributed architecture↗

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

This work examines the performance of leading-edge systems designed for machine learning computing, including the NVIDIA DGX-2, Amazon Web Services (AWS) P3, IBM Power System Accelerated Compute Server AC922, and a consumer-grade Exxact TensorEX TS4 GPU server. Representative deep learning workloads from the fields of computer vision and natural language processing are the focus of the analysis. Performance analysis is performed along with a number of important dimensions. Performance of the communication interconnects and large and high-throughput deep learning models are considered. Different potential use models for the systems as standalone and in the cloud also are examined. The effect of various optimization of the deep learning models and system configurations is included in the analysis.

97 MATHEMATICS AND COMPUTING↗

SystemBurn: Principles of Design and Operation, Release 2.0

As high performance computing technology progresses toward the progressively more extreme scales required to address critical computational problems of both national and global interest, power and cooling for these extreme scale systems is becoming a growing concern. A standardized methodology for testing system requirements under maximal system load and validating system environmental capability to meet those requirements is critical to maintaining system stability and minimizing power and cooling risks for high end data centers. Moreover, accurate testing permits the high end data center to avoid issues of under- or over-provisioning power and cooling capacity saving resources and mitigating hazards. Previous approaches to such testing have employed an ad hoc collection of tools, which have been anecdotally perceived to produce a heavy system load. In this report, we present SystemBurn, a software tool engineered to allow a system user to methodically create a maximal system load on large scale systems for the purposes of testing and validation.

99 GENERAL AND MISCELLANEOUS↗

Improved natural convection heat transfer correlations for reactor cavity cooling systems of high-temperature gas-cooled reactors: From computational fluid dynamics to Pronghorn

The Reactor Cavity Cooling System (RCCS) is a common reactor safety system in High Temperature Gas Cooled Reactors (HTGR) that removes heat from the Reactor Pressure Vessel (RPV) by radiation ($\sim 80\%$) and natural convection ($\sim 20\%$). For simulation of accident scenarios of HTGRs, intermediate fidelity and system codes models must be employed for limiting the models' execution time. While accurate quantification of the radiative heat transfer is available in these models, quantification of natural convection must rely on correlations of questionable accuracy for the Nusselt number. Commonly used correlations are based in experiments performed at low Rayleigh numbers and/or using isothermal walls in simplified geometries. Here, this work improves on the accuracy of natural convection heat transfer correlations in support for HTGR designs. These correlations include both local and average Nusselt numbers as a function of the global Rayleigh number, the local Rayleigh number, and the temperature profile at the hot wall of the RCCS. In the absence of dedicated experiments and the difficulty of performing high-fidelity simulations at realistic Rayleigh numbers, the data to fit the correlations are generated with Computational Fluid Dynamics (CFD) using Reynolds Averaged Navier-Stokes (RANS) models. First, a careful selection of the RANS turbulence model is performed by comparing the results obtained with different RANS turbulence models against high fidelity simulations of natural convection at $Ra \ 1 \times 10^{11}$ in a rectangular cavity. Next, the selected model is used to perform simulations of an HTGR cavity at different high Rayleigh numbers $\in [6.1 \times 10^{11},2.9 \times 10^{13}]$ to encompass several HTGR designs, assuming an isothermal RPV wall. The results obtained are used to fit a correlation for the average and space-varying Nusselt number as a function of the global and local Rayleigh numbers via a sparsity-promoting least-squares method. The selected RANS model is then used to perform simulations of a PBMR 400 HTGR cavity with the temperature profiles at the RPV wall obtained during a PLOFC transient. We use the results obtained to fit a temperature-dependent correction to the space-varying Nusselt number with the sparsity-promoting least-squares method. The results obtained in this work, enable system-level codes, such as Pronghorn, to perform higher-fidelity simulations of the heat exchange process in the RCCS while still maintaining a low computational cost.

42 ENGINEERING↗

SystemBurn: Principles of Design and Operation Release 2.1

As high performance computing technology progresses toward the progressively more extreme scales required to address critical computational problems of both national and global interest, power and cooling for these extreme scale systems is becoming a growing concern. A standardized methodology for testing system requirements under maximal system load and validating system environmental capability to meet those requirements is critical to maintaining system stability and minimizing power and cooling risks for high end data centers. Moreover, accurate testing permits the high end data center to avoid issues of under- or over-provisioning power and cooling capacity saving resources and mitigating hazards. Previous approaches to such testing have employed an ad hoc collection of tools, which have been anecdotally perceived to produce a heavy system load. In this report, we present SystemBurn, a software tool engineered to allow a system user to methodically create a maximal system load on large scale systems for the purposes of testing and validation.

99 GENERAL AND MISCELLANEOUS↗

Regression-based reduced-order models to predict transient thermal output for enhanced geothermal systems

Reduced-order modeling is a promising approach, as many phenomena can be described by a few parameters/mechanisms. An advantage and attractive aspect of a reduced-order model is that it is computational inexpensive to evaluate when compared to running a high-fidelity numerical simulation. A reduced-order model takes couple of seconds to run on a laptop while a high-fidelity simulation may take couple of hours to run on a high-performance computing cluster. The goal of this paper is to assess the utility of regression-based reduced-order models (ROMs) developed from high-fidelity numerical simulations for predicting transient thermal power output for an enhanced geothermal reservoir while explicitly accounting for uncertainties in the subsurface system and site-specific details. Numerical simulations are performed based on equally spaced values in the specified range of model parameters. Key sensitive parameters are then identified from these simulations, which are fracture zone permeability, well/skin factor, bottom hole pressure, and injection flow rate. We found the fracture zone permeability to be the most sensitive parameter. The fracture zone permeability along with time, are used to build regression-based ROMs for the thermal power output. The ROMs are trained and validated using detailed physics-based numerical simulations. Finally, predictions from the ROMs are then compared with field data. We propose three different ROMs with different levels of model parsimony, each describing key and essential features of the power production curves. The coefficients in the proposed regression-based ROMs are developed by minimizing a non-linear least-squares misfit function using the Levenberg–Marquardt algorithm. The misfit function is based on the difference between numerical simulation data and reduced-order model. ROM-1 is constructed based on polynomials up to fourth order. ROM-1 is able to accurately reproduce the power output of numerical simulations for low values of permeabilities and certain features of the field-scale data. ROM-2 is a model with more analytical functions consisting of polynomials up to order eight, exponential functions and smooth approximations of Heaviside functions, and accurately describes the field-data. At higher permeabilities, ROM-2 reproduces numerical results better than ROM-1, however, there is a considerable deviation from numerical results at low fracture zone permeabilities. ROM-3 consists of polynomials up to order ten, and is developed by taking the best aspects of ROM-1 and ROM-2. ROM-1 is relatively parsimonious than ROM-2 and ROM-3, while ROM-2 overfits the data. ROM-3 on the other hand, provides a middle ground for model parsimony. Based on R 2 -values for training, validation, and prediction data sets we found that ROM-3 is better model than ROM-2 and ROM-1. For predicting thermal drawdown in EGS applications, where high fracture zone permeabilities (typically greater than 10 –15 m 2 ) are desired, ROM-2 and ROM-3 outperform ROM-1. As per computational time, all the ROMs are 10 4 times faster when compared to running a high-fidelity numerical simulation. In conclusion, this makes the proposed regression-based ROMs attractive for real-time EGS applications because they are fast and provide reasonably good predictions for thermal power output.

58 GEOSCIENCES↗

Statistical iterative reconstruction to improve image quality for digital breast tomosynthesis

Purpose: Digital breast tomosynthesis (DBT) is a novel modality with the potential to improve early detection of breast cancer by providing three-dimensional (3D) imaging with a low radiation dose. 3D image reconstruction presents some challenges: cone-beam and flat-panel geometry, and highly incomplete sampling. A promising means to overcome these challenges is statistical iterative reconstruction (IR), since it provides the flexibility of accurate physics modeling and a general description of system geometry. The authors’ goal was to develop techniques for applying statistical IR to tomosynthesis imaging data. Methods: These techniques include the following: a physics model with a local voxel-pair based prior with flexible parameters to fine-tune image quality; a precomputed parameter λ in the prior, to remove data dependence and to achieve a uniform resolution property; an effective ray-driven technique to compute the forward and backprojection; and an oversampled, ray-driven method to perform high resolution reconstruction with a practical region-of-interest technique. To assess the performance of these techniques, the authors acquired phantom data on the stationary DBT prototype system. To solve the estimation problem, the authors proposed an optimization-transfer based algorithm framework that potentially allows fewer iterations to achieve an acceptably converged reconstruction. Results: IR improved the detectability of low-contrast and small microcalcifications, reduced cross-plane artifacts, improved spatial resolution, and lowered noise in reconstructed images. Conclusions: Although the computational load remains a significant challenge for practical development, the superior image quality provided by statistical IR, combined with advancing computational techniques, may bring benefits to screening, diagnostics, and intraoperative imaging in clinical applications.

60 APPLIED LIFE SCIENCES↗

Split-pane electrochromic window control based on an embedded photometric device with real-time daylighting computing

Well-designed electrochromic (EC) glazing control can improve the energy performance of buildings and visual comfort of occupants in highly glazed buildings. Here in this paper, we designed and demonstrated a compact integrated EC glazing automation system to control tint states of a split-pane EC window according to variations of sky conditions. The control is based on monitoring the luminance distribution of the sky and real-time lighting computation for a building interior, using an embedded photometric device (EPD). It optimizes tint states of EC glazing to offer sufficient daylight provision and temper discomfort glare for occupants, which potentially mitigates excessive solar heat gain. ’In-situ’ experiments were conducted in a full-scale testbed to demonstrate the daylighting performance under various sky conditions. Finally, experimental results showed 83% of the working time for work-plane illuminance (WPI) and 95% of the time for daylight glare probability (DGP) were constrained in comfort range (WPIϵ[500, 2000] lux, DGP ≤ 0.35) by the automated EC glazing (controlled by EPD) under clear skies; 68% of the time for WPI and 94% of the time for DGP in confined range under clear skies with thin clouds; 62% of the time for WPI and 85% of the time for DGP in confined range under partly cloudy skies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Interface Problem Formulation Improvements with Application to Nuclear Fuel Performance Analysis

The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation Program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. This report documents new developments and robustness improvements in mechanical and thermal (gap heat transfer) contact formulations. The improvements range from the migration of industrial level (“assessment”) nuclear fuel model setups to the usage of mortar formulations, the addition of frictional contact to one-dimensional layered representations of fuel and cladding components, and the addition of the Petrov-Galerkin approach to dual mortar, which improves performance on curved, relatively coarse meshes. In addition, the Lagrange-multiplier enforcement of mechanical mortar contact constraints has been extended to two additional types of enforcement: penalty and augmented Lagrange-Uzawa. We show that the latter approach yields the same interface results as dual mortar in the Multiphysics Object-Oriented Simulation Environment, with the advantage of not worsening the condition number of the system matrix—thereby enabling the use of some general implementations of iterative preconditioners, at the expense of additional system evaluations (i.e., augmentations).

42 ENGINEERING↗

Variable Time-Step Implementation for Rapid Quasi-Static Time-Series (QSTS) Simulations of Distributed PV

Distribution system analysis with high penetrations of distributed PV require quasi-static time-series (QSTS) analysis to model the variability introduced on the distribution system, but current QSTS algorithms are prohibitively burdensome and computationally intensive. This paper proposes a variable timestep algorithm to calculate the critical time periods when QSTS simulations should be solved at higher or lower time-resolution and to backtrack for any critical periods that were missed. This variable time-step solver is a new method of performing timeseries simulations with high accuracy while performing the simulation more than 50 times faster. The scalability of the algorithm is demonstrated using a real utility distribution system model with thousands of buses.

14 SOLAR ENERGY↗

Novel Modified Optical Fibers for High Temperature In-Situ Miniaturized Gas Sensors in Advanced Fossil Energy Systems

This report covers the technical progress on the program “Novel Modified Optical Fibers for High Temperature In-Situ Miniaturized Gas Sensors in Advanced Fossil Energy Systems”, funded by the National Energy Technology Laboratory of the U.S. Department of Energy, and performed by the Materials Science & Engineering and Electrical & Computer Engineering Departments at Virginia Tech, and summarizes technical progress from July 1st, 2005 –June 30th, 2014. The objective of this program was to develop novel fiber materials for high temperature gas sensors based on evanescent wave absorption in optical fibers. This project focused on two primary areas: the study of a sapphire photonic crystal fiber (SPCF) for operation at high temperature and long wavelengths, and a porous glass based fiber optic sensor for gas detection. The sapphire component of the project focused on the development of a sapphire photonic crystal fiber, modeling of the new structures, fabrication of the optimal structure, development of a long wavelength interrogation system, testing of the optical properties, and gas and temperature testing of the final sensor. The fabrication of the 6 rod SPCF gap bundle (diameter of 70μm) with a hollow core was successfully constructed with lead-in and lead-out 50μm diameter fiber along with transmission and gas detection testing. Testing of the sapphire photonic crystal fiber sensor capabilities with the developed long wavelength optical system showed the ability to detect CO 2 at or below 1000ppm at temperatures up to 1000°C. Work on the porous glass sensor focused on the development of a porous clad solid core optical fiber, a hollow core waveguide, gas detection capabilities at room and high temperature, simultaneous gas species detection, suitable joining technologies for the lead-in and lead-out fibers and the porous sensor, sensor system sensitivity improvement, signal processing improvement, relationship between pore structure and fiber geometry to optical properties, and the development of a sensor packaging prototype for laboratory testing. Analysis and experiments determined that a bonding technique using a CO 2 laser is the most suitable joining technique. Pore morphology alteration showed that transmission improved with increasing annealing temperature (producing smaller pores), while the sensor response time increased and the mechanical strength decreased with increasing annealing temperature. Software was developed for data acquisition and signal processing to collect and interpret spectral gas absorption data. Gas detection on porous glass sensors was completed and the detection limit was evaluated using acetylene and was found to be around 1- 200ppm. A complete materials package for porous glass sensors was manufactured for testing.

36 MATERIALS SCIENCE↗

Auxiliary Density Matrix Methods for Hartree-Fock Exchange Calculations

The calculation of Hartree-Fock exchange (HFX) is computationally demanding for large systems described with high-quality basis sets. In this work, we show that excellent performance and good accuracy can nevertheless be obtained if an auxiliary density matrix is employed for the HFX calculation. Several schemes to derive an auxiliary density matrix from a high-quality density matrix are discussed. Key to the accuracy of the auxiliary density matrix methods (ADMM) is the use of a correction based on standard generalized gradient approximations for HFX. ADMM integrates seamlessly in existing HFX codes and, in particular, can be employed in linear scaling implementations. Demonstrating the performance of the method, the effect of HFX on the structure of liquid water is investigated in detail using Born-Oppenheimer molecular dynamics simulations (300 ps) of a system of 64 molecules. Representative for large systems are calculations on a solvated protein (Rubredoxin), for which ADMM outperforms the corresponding standard HFX implementation by approximately a factor 20.

Chemistry↗

Attacking the Opioid Epidemic: Determining the Epistatic and Pleiotropic Genetic Architectures for Chronic Pain and Opioid Addiction

We describe the CoMet application for large-scale epistatic Genome-Wide Association Studies (eGWAS) and pleiotropy studies. High performance is attained by transforming the underlying vector comparison methods into highly performant generalized distributed dense linear algebra operations. The 2-way and 3-way Proportional Similarity metric and Custom Correlation Coefficient are implemented using native or adapted GEMM kernels optimized for GPU architectures. By aggressive overlapping of communications, transfers and computations, high efficiency with respect to single GPU kernel performance is maintained up to the full Titan and Summit systems. Nearly 300 quadrillion element comparisons per second and over 2.3 mixed precision ExaOps are reached on Summit by use of Tensor Core hardware on the Nvidia Volta GPUs. Performance is four to five orders of magnitude beyond comparable state of the art. CoMet is currently being used in projects ranging from bioenergy to clinical genomics, including for the genetics of chronic pain and opioid addiction.

Joubert, Wayne↗

Irregular Applications: Architectures & Algorithms

Irregular applications are characterized by irregular data structures, control and communication patterns. Novel irregular high performance applications which deal with large data sets and require have recently appeared. Unfortunately, current high performance systems and software infrastructures executes irregular algorithms poorly. Only coordinated efforts by end user, area specialists and computer scientists that consider both the architecture and the software stack may be able to provide solutions to the challenges of modern irregular applications.

99 GENERAL AND MISCELLANEOUS↗

Defense strategies and expected capacity of high performance computing infrastructures

We consider high performance computing infrastructures consisting of multiple sites connected over a wide-area network. These sites house heterogeneous computing systems, network elements and local-area connections, and the wide-area network plays a critical, asymmetric role of providing the vital connectivity between them. We model this infrastructure as a recursive system of systems, wherein the basic systems at the finest levels are composed of discrete cyber and physical components. These components may be disabled by cyber and physical disruptions, and their reinforcements protect against them albeit at a cost. We utilize results from a game formulation based on (i) characterizing the disruptions between systems at each level of recursion using aggregate failure correlation functions, and within basic systems using the multiplier functions, and (ii) using utility functions expressed in terms of the number of basic system components attacked and reinforced. At Nash Equilibrium, we derive expressions for the expected capacity of the infrastructure given by the number of computing nodes that are operational and connected to the network.

Rao, Nageswara↗

Cooperative Research and Development Agreement among National Energy Technology Laboratory, Advanced Manufacturing LLC, and Connecticut Center for Advanced Technology [Abstract]

The National Energy Technology Laboratory (NETL), Advanced Manufacturing LLC (AMLLC) and Connecticut Center for Advanced Technology (CCAT) will collaborate to develop and manufacture cost-effective, oxide dispersion-strengthened, NiCrFeCo-rich high entropy alloys that are superior to Nickel-based superalloys (e.g. IN740) for repair or replacement service in extreme environments. The new alloys can result in higher efficiency and reduced cost of advanced power systems such as advanced ultra-supercritical (AUSC) boilers and gas turbines. High throughput, multiscale computational modeling will be performed to accelerate alloy discovery by interrogating the intrinsic properties of the alloys including thermodynamic, kinetic, and mechanical properties. Validation and evaluation will be performed, including additive manufacturing, microstructure characterization, and mechanical properties tests.

36 MATERIALS SCIENCE↗

Modeling Astrophysical Explosions and Nucleosynthesis (Final Technical Report)

The goal of this project was to further our theoretical understanding of the extreme physics and heavy element nucleosynthesis occurring in stellar explosions, in particular supernovae and neutron star mergers. To study these systems, we further developed and applied numerical simulations (radiation hydrodynamical models and nuclear reaction networks) run on high performance computers. The numerical calculations and companion theoretical analysis helped to better define the sites of astrophysical nucleosynthesis, and make predictions of the associated observables (nucleosynthetic yields and electromagnetic signals) that can be used to anticipate and interpret experimental data. This project enhances the scientific value of the nuclear data obtained from current and future experimental facilities (e.g., rare isotope beams) by improving our understanding of the astrophysical context and specific physical conditions under which we expect such reactions to take place in Nature.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗