Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “high performance computing systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

The Science DMZ: A Network Design Pattern for Data-Intensive Science

The ever-increasing scale of scientific data has become a significant challenge for researchers that rely on networks to interact with remote computing systems and transfer results to collaborators worldwide. Despite the availability of high-capacity connections, scientists struggle with inadequate cyberinfrastructure that cripples data transfer performance, and impedes scientific progress. The Science DMZ paradigm comprises a proven set of network design patterns that collectively address these problems for scientists. We explain the Science DMZ model, including network architecture, system configuration, cybersecurity, and performance tools, that creates an optimized network environment for science. We describe use cases from universities, supercomputing centers and research laboratories, highlighting the effectiveness of the Science DMZ model in diverse operational settings. In all, the Science DMZ model is a solid platform that supports any science workflow, and flexibly accommodates emerging network technologies. As a result, the Science DMZ vastly improves collaboration, accelerating scientific discovery.

42 ENGINEERING↗

Newton trust-region methods with primary variable switching for simulating high temperature multiphase porous media flow

Coupling multiphase flow with energy transport due to high temperature heat sources introduces significant new challenges since boiling and condensation processes can lead to dry-out conditions with subsequent re-wetting. The transition between two-phase and single-phase behavior can require changes to the primary dependent variables adding discontinuities as well as extending constitutive nonlinear relations to extreme physical conditions. Practical simulations of large-scale engineered domains lead to Jacobian systems with a very large number of unknowns that must be solved efficiently using iterative methods in parallel on high-performance computers. Performance assessment of potential nuclear repositories, carbon sequestration sites and geothermal reservoirs can require numerous Monte-Carlo simulations to explore uncertainty in material properties, boundary conditions, and failure scenarios. Due to the numerical challenges, standard NR iteration may not converge over the range of required simulations and require more sophisticated optimization method like trust-region. In this study, we use the open-source simulator PFLOTRAN for the important practical problem of the safety assessment of future nuclear waste repositories in the U.S. DOE geologic disposal safety assessment Framework. The simulator applies the PETSc parallel framework and a backward Euler, finite volume discretization. We demonstrate failure of the conventional NR method and the success of trust-region modifications to Newton’s method for a series of test problems of increasing complexity. Trust-region methods essentially modify the Newton step size and direction under some circumstances where the standard NR iteration can cause the solution to diverge or oscillate. Furthermore, we show how the Newton Trust-Region method can be adapted for Primary Variable Switching (PVS) when the multiphase state changes due to boiling or condensation. The simulations with high-temperature heat sources which led to extreme nonlinear processes with many state changes in the domain did not converge with NR, but they do complete successfully with the trust-region methods modified for PVS. This implementation effectively decreased weeks of simulation time needing manual adjustments to complete a simulation down to a day. Finally, we show the strong scalability of the methods on a single node and multiple nodes in an HPC cluster.

54 ENVIRONMENTAL SCIENCES↗

Distribution of Prostate Sentinel Nodes: A SPECT-Derived Anatomic Atlas

Purpose: The randomized Radiation Therapy Oncology Group 94-13 trial revealed that coverage of the pelvic lymph nodes in high-risk prostate cancer confers an advantage (progression-free survival and biochemical failure) in patients with {>=}15% risk of lymph node involvement. To facilitate an improved definition of the adjuvant target volume, precise knowledge regarding the location of the relevant lymph nodes is necessary. Therefore, we generated a three-dimensional sentinel lymph node atlas. Methods and Materials: In 61 patients with high-risk prostate cancer, a three-dimensional visualization of sentinel lymph nodes was performed using a single photon emission computed tomography system after transrectal intraprostatic injection of 150 to 362 (median 295) mega becquerel (MBq) {sup 99m}Technetium-nanocolloid (1.5-3h after injection) followed by an anatomic functional image fusion. Results: In all, 324 sentinel nodes in 59 of 61 patients (96.7%) were detected, with 0 to 13 nodes per patient (median 5, mean 5.3). The anatomic distribution of the sentinel nodes was as follows: external iliac 34.3%, internal iliac 17.9%, common iliac 12.7%, sacral 8.6%, perirectal 6.2%, left paraaortic 5.3%, right paraaortic 5.3%, seminal vesicle lymphatic plexus 3.1%, deep inguinal 1.5%, superior rectal 1.2%, internal pudendal 1.2%, perivesical 0.9%, inferior rectal 0.9%, retroaortic 0.3%, superficial inguinal 0.3%, and periprostatic 0.3%. Conclusions: The distribution of sentinel nodes as detected by single photon emission computed tomography imaging correlates well with the distribution determined by intraoperative gamma probe detection. A lower detection rate of sentinels in close proximity to the bladder and seminal vesicles is probably caused by the radionuclide accumulation in the bladder. In regard to intensity-modulated radiotherapy techniques, the presented anatomic atlas may allow optimized target volume definitions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Three-Dimensional Dosimetric Validation of a Magnetic Resonance Guided Intensity Modulated Radiation Therapy System

Purpose: To validate the dosimetric accuracy of a commercially available magnetic resonance guided intensity modulated radiation therapy (MRgIMRT) system using a hybrid approach: 3-dimensional (3D) measurements and Monte Carlo calculations. Methods and Materials: We used PRESAGE radiochromic plastic dosimeters with remote optical computed tomography readout to perform 3D high-resolution measurements, following a novel remote dosimetry protocol. We followed the intensity modulated radiation therapy commissioning recommendations of American Association of Physicists in Medicine Task Group 119, adapted to incorporate 3D data. Preliminary tests (“AP” and “3D-Bands”) were delivered to 9.5-cm usable diameter cylindrical PRESAGE dosimeters to validate the treatment planning system (TPS) for nonmodulated deliveries; assess the sensitivity, uniformity, and rotational symmetry of the PRESAGE dosimeters; and test the robustness of the remote dosimetry protocol. Following this, 4 clinical MRgIMRT plans (“MultiTarget,” “Prostate,” “Head/Neck,” and “C-Shape”) were measured using 13-cm usable diameter PRESAGE dosimeters. For all plans, 3D-γ (3% or 3 mm global, 10% threshold) passing rates were calculated and 3D-γ maps were examined. Point doses were measured with an IBA-CC01 ionization chamber for validation of absolute dose. Finally, by use of an in-house-developed, GPU-accelerated Monte Carlo algorithm (gPENELOPE), we independently calculated dose for all 6 Task Group 119 plans and compared against the TPS. Results: For PRESAGE measurements, 3D-γ analysis yielded passing rates of 98.7%, 99.2%, 98.5%, 98.0%, 99.2%, and 90.7% for AP, 3D-Bands, MultiTarget, Prostate, Head/Neck, and C-Shape, respectively. Ion chamber measurements were within an average of 0.5% (±1.1%) from the TPS dose. Monte Carlo calculations demonstrated good agreement with the TPS, with a mean 3D-γ passing rate of 98.5% ± 1.9% using a stricter 2%/2-mm criterion. Conclusions: We have validated the dosimetric accuracy of a commercial MRgIMRT system using high-resolution 3D techniques. We have demonstrated for the first time that hybrid 3D remote dosimetry is a comprehensive and feasible approach to commissioning MRgIMRT. This may provide better sensitivity in error detection compared with standard 2-dimensional measurements and could be used when implementing complex new magnetic resonance guided radiation therapy technologies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Photoinduced Electron–Nuclear Dynamics of Fullerene and Its Monolayer Networks in Solvated Environments

The recently synthesized monolayer fullerene network in a quasi-hexagonal phase (qHP-C 60 ) exhibits superior electron mobility and optoelectronic properties compared to molecular fullerene (C 60 ), making it highly promising for a variety of applications. However, the microscopic carrier dynamics of qHP-C 60 remain unclear, particularly in realistic environments, which are of significant importance for applications in optoelectronic devices. Unfortunately, traditional ab initio methods are prohibitive for capturing the real-time carrier dynamics of such large systems due to their high computational cost. In this work, we present the first real-time electron–nuclear dynamics study of qHP-C 60 using velocity-gauge density functional tight binding, which enables us to perform several picoseconds of excited-state electron–nuclear dynamics simulations for nanoscale systems with periodic boundary conditions. When applied to C 60 , qHP-C 60 , and their solvated counterparts, we demonstrate that water/moisture significantly increases the electron–hole recombination time in C 60 but has little impact on qHP-C 60 . Our excited-state electron–nuclear dynamics calculations show that qHP-C 60 is extremely unique and enable exploration of time-resolved dynamics for understanding excited-state processes of large systems in complex, solvated environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scidac-Data: Enabling Data Driven Modeling of Exascale Computing

Here, the SciDAC-Data project is a DOE-funded initiative to analyze and exploit two decades of information and analytics that have been collected by the Fermilab data center on the organization, movement, and consumption of high energy physics (HEP) data. The project analyzes the analysis patterns and data organization that have been used by NOvA, MicroBooNE, MINERvA, CDF, D0, and other experiments to develop realistic models of HEP analysis workflows and data processing. The SciDAC-Data project aims to provide both realistic input vectors and corresponding output data that can be used to optimize and validate simulations of HEP analysis. These simulations are designed to address questions of data handling, cache optimization, and workflow structures that are the prerequisites for modern HEP analysis chains to be mapped and optimized to run on the next generation of leadership-class exascale computing facilities. We present the use of a subset of the SciDAC-Data distributions, acquired from analysis of approximately 71,000 HEP workflows run on the Fermilab data center and corresponding to over 9 million individual analysis jobs, as the input to detailed queuing simulations that model the expected data consumption and caching behaviors of the work running in high performance computing (HPC) and high throughput computing (HTC) environments. In particular we describe how the Sequential Access via Metadata (SAM) data-handling system in combination with the dCache/Enstore-based data archive facilities has been used to develop radically different models for analyzing the HEP data. We also show how the simulations may be used to assess the impact of design choices in archive facilities.

97 MATHEMATICS AND COMPUTING↗

Bridging Python to Silicon: The SODA Toolchain

Systems performing scientific computing, data analysis, and machine learning tasks have a growing demand for application-specific accelerators that can provide high computational performance while meeting strict size and power requirements. However, the algorithms and applications that need to be accelerated are evolving at a rate that is incompatible with manual design processes based on hardware description languages. Agile hardware design tools based on compiler techniques can help by quickly producing an application-specific integrated circuit (ASIC) accelerator starting from a high-level algorithmic description. Here, we present the software-defined accelerator (SODA) synthesizer, a modular and open-source hardware compiler that provides automated end-to-end synthesis from high-level software frameworks to ASIC implementation, relying on multilevel representations to progressively lower and optimize the input code. Our approach does not require the application developer to write any register-transfer level code, and it is able to reach up to 364 giga floating point operations per second (GFLOPS)/W efficiency (32-bit precision) on typical convolutional neural network operators.

97 MATHEMATICS AND COMPUTING↗

A Massively Parallel Adaptive Fast Multipole Method on Heterogeneous Architectures

We describe a parallel fast multipole method (FMM) for highly nonuniform distributions of particles. We employ both distributed memory parallelism (via MPI) and shared memory parallelism (via OpenMP and GPU acceleration) to rapidly evaluate two-body nonoscillatory potentials in three dimensions on heterogeneous high performance computing architectures. We have performed scalability tests with up to 30 billion particles on 196,608 cores on the AMD/CRAY-based Jaguar system at ORNL. On a GPU-enabled system (NSF's Keeneland at Georgia Tech/ORNL), we observed 30x speedup over a single core CPU and 7x speedup over a multicore CPU implementation. By combining GPUs with MPI, we achieve less than 10 ns/particle and six digits of accuracy for a run with 48 million nonuniformly distributed particles on 192 GPUs.

99 GENERAL AND MISCELLANEOUS↗

Progress Report on Development of Intermediate Fidelity Full Assembly Analysis Methods

While high fidelity modeling capabilities for various physics phenomena are being pursued under advanced modeling and simulation initiatives under the DOE Office of Nuclear Energy, they generally rely on high-performance computation facilities and are too expensive to be used for parameter-space exploration or design analysis. One-dimensional system codes have been used for a long time and have reached a degree of maturity, but limit their validity to specific applications. Thus, an intermediate fidelity (IF) modeling method is being pursued in this work for a fast-running, modest-fidelity, whole-core transient analyses capability. The new approach is essential for design scoping and engineering analyses and could lead to improvements in the design of the new generations of reactors and to the reduction of uncertainties in safety analysis. This report summarizes the initial effort on the development of the intermediate-fidelity full assembly modeling method. The requirements and the desired merits of the IF approach have been defined. A three-dimensional momentum source model has been developed to model the anisotropic flow in the wire-wrapped rod bundle without the need to resolve the geometric details. It has been confirmed that the momentum source model works well if its affecting region is accurately imposed. The validity of the model is further verified by mesh and parameter sensitivity studies. The developed momentum source model, in principle, can be applied to any wire-wrapped bundle geometries and any flow regimes; while the modeling strategy can be applied to other conditions with complex or distorted geometry, such as flow in blocked channels.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Advanced Simulation Capability for Environmental Management (ASCEM) Phase II Demonstration

In 2009, the National Academies of Science (NAS) reviewed and validated the U.S. Department of Energy Office of Environmental Management (EM) Technology Program in its publication, Advice on the Department of Energy’s Cleanup Technology Roadmap: Gaps and Bridges. The NAS report outlined prioritization needs for the Groundwater and Soil Remediation Roadmap, concluded that contaminant behavior in the subsurface is poorly understood, and recommended further research in this area as a high priority. To address this NAS concern, the EM Office of Site Restoration began supporting the development of the Advanced Simulation Capability for Environmental Management (ASCEM). ASCEM is a state-of-the-art scientific approach that uses an integration of toolsets for understanding and predicting contaminant fate and transport in natural and engineered systems. The ASCEM modeling toolset is modular and open source. It is divided into three thrust areas: Multi-Process High Performance Computing (HPC), Platform and Integrated Toolsets, and Site Applications. The ASCEM toolsets will facilitate integrated approaches to modeling and site characterization that enable robust and standardized assessments of performance and risk for EM cleanup and closure activities.

54 ENVIRONMENTAL SCIENCES↗

Runtime Tracing of The Community Earth System Model: Feasibility and Benefits

Community Earth System Models (CESM) is one of US's leading earth system modeling systems, which has over decades of development history and embraced by large, active user communities. In this paper, we first review the history of CESM software development and layout the general objectives of performance analysis. Then we present an offline global community land model simulation within the CESM framework to demonstrate the procedure of runtime tracing of CESM using the Vampir toolset. Finally, we explain the benefits of runtime tracing to the general earth system modeling community. We hope those considerations can also be beneficial to many other modeling research programs involving legacy high-performance computing applications.

99 GENERAL AND MISCELLANEOUS↗

ESIF 2021

This annual report highlights research done at the Energy Systems Integration Facility (ESIF) in Fiscal Year 2021.

Advanced Research on Integrated Energy Systems↗

Final Report for DOE Award ER25756

The SciDAC-funded Center for Enabling Distributed Petascale Science (CEDPS) was established to address technical challenges that arise due to the frequent geographic distribution of data producers (in particular, supercomputers and scientific instruments) and data consumers (people and computers) within the DOE laboratory system. Its goal is to produce technical innovations that meet DOE end-user needs for (a) rapid and dependable placement of large quantities of data within a distributed high-performance environment, and (b) the convenient construction of scalable science services that provide for the reliable and high-performance processing of computation and data analysis requests from many remote clients. The Center is also addressing (c) the important problem of troubleshooting these and other related ultra-high-performance distributed activities from the perspective of both performance and functionality

97 MATHEMATICS AND COMPUTING↗

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Quantum simulations of excited states with active-space downfolded Hamiltonians

Many-body techniques based on the double unitary coupled cluster ansatz (DUCC) can be used to downfold electronic Hamiltonians into low-dimensional active spaces. It can be shown that the resulting dimensionality reduced Hamiltonians are amenable for quantum computing. Recent studies performed for several benchmark systems using quantum phase estimation (QPE) algorithms demonstrated that these formulations can recover a significant portion of ground-state dynamical correlation effects that stem from the electron excitations outside of the active space. These results have also been confirmed in studies of ground-state potential energy surfaces using quantum simulators. In this letter, we study the effectiveness of the DUCC formalism in describing excited states. We also emphasize the role of the QPE formalism and its stochastic nature in discovering/identifying excited states or excited-state processes in situations when the knowledge about the true configurational structure of a sought after excited state is limited or postulated (due to the specific physics driving excited-state processes of interest). In this context, we can view the QPE algorithm as an engine for verifying various hypotheses for excited-state processes and providing statistically meaningful results that correspond to the electronic state(s) with the largest overlap with a postulated configurational structure. We illustrate these ideas on examples of strongly cor- related molecular systems, characterized by small energy gaps and high density of quasi-degenerate states around the Fermi level.

quantum chemistry, quantum computing, computationa↗

Sensitivity analysis of generic deep geologic repository with focus on spatial heterogeneity induced by stochastic fracture network generation

Geologic Disposal Safety Assessment Framework is a state-of-the-art simulation software toolkit for probabilistic post-closure performance assessment of systems for deep geologic disposal of nuclear waste developed by the United States Department of Energy. This paper presents a generic reference case and shows how it is being used to develop and demonstrate performance assessment methods within the Geologic Disposal Safety Assessment Framework that mitigate some of the challenges posed by high uncertainty and limited computational resources. Variance-based global sensitivity analysis is applied to assess the effects of spatial heterogeneity using graph-based summary measures for scalar and time-varying quantities of interest. Behavior of the system with respect to spatial heterogeneity is further investigated using ratios of water fluxes. This analysis shows that spatial heterogeneity is a dominant uncertainty in predictions of repository performance which can be identified in global sensitivity analysis using proxy variables derived from graph descriptions of discrete fracture networks. New quantities of interest defined using water fluxes proved useful for better understanding overall system behavior.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Energy scaling advantages of resistive memory crossbar based computation and its application to sparse coding

In this study, the exponential increase in data over the last decade presents a significant challenge to analytics efforts that seek to process and interpret such data for various applications. Neural-inspired computing approaches are being developed in order to leverage the computational properties of the analog, low-power data processing observed in biological systems. Analog resistive memory crossbars can perform a parallel read or a vector-matrix multiplication as well as a parallel write or a rank-1 update with high computational efficiency. For an N × N crossbar, these two kernels can be O(N) more energy efficient than a conventional digital memory-based architecture. If the read operation is noise limited, the energy to read a column can be independent of the crossbar size (O(1)). These two kernels form the basis of many neuromorphic algorithms such as image, text, and speech recognition. For instance, these kernels can be applied to a neural sparse coding algorithm to give an O(N) reduction in energy for the entire algorithm when run with finite precision. Sparse coding is a rich problem with a host of applications including computer vision, object tracking, and more generally unsupervised learning.

97 MATHEMATICS AND COMPUTING↗

Xenon Recovery at Room Temperature using Metal-Organic Frameworks

Xenon is known to be a very efficient anesthetic gas but its cost prohibits the wider use in medical industry and other potential applications. It has been shown that Xe recovery and recycle from anesthetic gas mixture can significantly reduce its cost as anesthetic. The current technology uses series of adsorbent columns followed by low temperature distillation to recover Xe, which is expensive to use in medical facilities. Herein, we propose much efficient and simpler system to recover and recycle Xe from simulant exhale anesthetic gas mixture at room temperature using metal organic frameworks. Among the MOFs tested, PCN-12 exhibits unprecedented performance with high Xe capacity, Xe/N2 and Xe/O2 selectivity at room temperature. The in-situ synchrotron measurements suggest the Xe is occupied in the small pockets of PCN-12 compared to unsaturated metal centers (UMCs). Computational modeling of adsorption further supports our experimental observation of Xe binding sites in PCN-12.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗