SEARCH · Engineering Papers

Results for “massive parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

925 records · Page 52

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Expert and operator perspectives on barriers to energy efficiency in data centers

Abstract It was last estimated in 2016 that data centers (DCs) comprise approximately 2% of total US electricity consumption. However, this estimate is currently being updated to account for the massive increase in computing needs due to streaming, cryptocurrency, and artificial intelligence (AI). To prevent energy consumption that tracks with increasing computing needs, it is imperative we identify energy efficiency strategies and investments beyond the low-hanging fruit solutions. In a two-phased research approach, we ask: What non-technical barriers still impede energy efficiency (EE) practices and investments in the data center sector, and what can be done to overcome these barriers? In particular, we are focused on social and organizational barriers to EE. In Phase I, we performed a literature review and found that technical solutions are abundant in the literature, but fail to address the top-down cultural shifts that need to take place in order to adapt new energy efficiency strategies. In Phase II, reported here, we interviewed 16 data center operators/experts to ground-truth our literature findings. Our interview protocols focus on three aspects of DC decision-making: procurement practices, metrics and monitoring, and perceived barriers to energy efficiency. We find that vendors are the key drivers of procurement decisions, advanced efficiency metrics are facility-specific, and there is convergence in the design of advanced facilities due to the heat density of parallelized infrastructure. Our ultimate goals for our research are to design DC decarbonization policies that target organizational structure, empower individual staff, and foster a supportive external market.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗

DOE OSTI2021

Scalable Pattern Matching in Metadata Graphs via Constraint Checking

Pattern matching is a fundamental tool for answering complex graph queries. Unfortunately, existing solutions have limited capabilities: They do not scale to process large graphs and/or support only a restricted set of search templates or usage scenarios. Moreover, the algorithms at the core of the existing techniques are not suitable for today’s graph processing infrastructures relying on horizontal scalability and shared-nothing clusters, as most of these algorithms are inherently sequential and difficult to parallelize. In this article we present an algorithmic pipeline that bases pattern matching on constraint checking. The key intuition is that each vertex and edge participating in a match has to meet a set of constraints implicitly specified by the search template. These constraints can be verified independently and typically are less expensive to compute than searching the full template. The pipeline we propose generates these constraints and iterates over them to eliminate all the vertices and edges that do not participate in any match, thus reducing the background graph to a subgraph that is the union of all template matches—the complete set of all vertices and edges that participate in at least one match. Additional analysis can be performed on this annotated, reduced graph, such as full match enumeration, match counting, or computing vertex/edge centrality. Furthermore, a vertex-centric formulation for constraint checking algorithms exists, and this makes it possible to harness existing high-performance, vertex-centric graph processing frameworks. This technique (i) enables highly scalable pattern matching in metadata (labeled) graphs; (ii) supports arbitrary patterns with 100% precision; (iii) enables tradeoffs between precision and time-to-solution, while always selects all vertices and edges that participate in matches, thus offering 100% recall; and (iv) supports a set of popular data analytics scenarios. We implement our approach on top of HavoqGT, an open-source asynchronous graph processing framework, and demonstrate its advantages through strong and weak scaling experiments on massive scale real-world (up to 257 billion edges) and synthetic (up to 4.4 trillion edges) labeled graphs, respectively, and at scales (1,024 nodes / 36,864 cores), orders of magnitude larger than used in the past for similar problems. This article serves two purposes: First, it synthesises the knowledge accumulated during a long-term project. Second, it presents new system features, usage scenarios, optimizations, and comparisons with related work that strengthen the confidence that pattern matching based on iterative pruning via constraint checking is an effective and scalable approach in practice. The new contributions include the following: (i) We demonstrate the ability of the constraint checking approach to efficiently support two additional search scenarios that often emerge in practice, interactive incremental search and exploratory search. (ii) We empirically compare our solution with two additional state-of-the-art systems, Arabsque and TriAD. (iii) We show the ability of our solution to accommodate a more diverse range of datasets with varying properties, e.g., scale, skewness, label distribution, and match frequency. (iv) We introduce or extend a number of system features (e.g., work aggregation, load balancing, and the ability to cap the generated traffic) and design optimizations and demonstrate their advantages with respect to improving performance and scalability. (v) We present bottleneck analysis and insights into artifacts that influence performance. (vi) We present a theoretical complexity argument that motivates the performance gains we observe.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Predicting Saturated Hydraulic Conductivity over Time for Degrading Saltstone Vault Concrete - 20376

At the Savannah River Site (SRS), low-level liquid tank waste is mixed with cementitious materials to produce a solid, monolithic waste form referred to as saltstone. The liquid saltstone mixture is pumped into massive concrete structures referred to as saltstone disposal units (SDUs) for curing and long-term storage. SDUs are vaults made of high performance concrete forming a barrier between saltstone and the surrounding environment. Predicting the long-term performance of SDU vault concrete, as well as the saltstone material itself, is critical to understanding the potential releases of radionuclides to the surrounding environment as described in the Saltstone Disposal Facility (SDF) performance assessment (PA). The hydraulic conductivity profile for SDU vault concrete was conservatively assumed to degrade linearly from the initial saturated hydraulic conductivity of the intact concrete over a long period of time. The initial hydraulic properties of saturated SDU vault concrete have been measured, and the final hydraulic properties of degraded vault concrete are assumed to be the same as the porous backfill material that will surround the vault after closure. The assumed final condition of the vault concrete is also conservative in that it provides a greater estimate of water penetration through the vault than would generally be expected. Therefore, insights that provide more realistic but conservative estimates as to how degradation processes may change the hydraulic properties of the SDU vault concrete, the time dependent relationship of the vault concrete hydraulic properties to degradation (and thus time), and the final hydraulic properties of the vault concrete provides useful additions to the SDF PA. This paper focuses on the assumption that the saltstone vault concrete saturated hydraulic conductivity would decrease linearly as a function of degradation time; this assumption resulted from a worst-case, weighted (by relative layer thickness), arithmetic average of intact and backfill material hydraulic conductivities representing flow parallel to a layered system. This research indicates that the effective saturated hydraulic conductivity of the degraded SDU vault concrete should be based on the relative thickness-weighted geometric mean of the intact and degraded layers hydraulic conductivities. This alternative, which is supported extensively in the relevant literature and evaluated in this paper, leads to a more realistic and defensible estimate of the effective saturated hydraulic conductivity in degraded vault concrete while remaining conservative. The impact of using the more realistic estimate of the effective saturated hydraulic conductivity for the degraded concrete decreases the effective saturated hydraulic conductivity by up to several orders of magnitude for early times (i.e., when the SDU vault concrete is assumed degraded via sulfate attack and carbonation). This revised estimate of the effective saturated hydraulic conductivity has been implemented in the recently revised SDF PA. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS1997

A 2000 Solar Mass Rotating Molecular Disk Around NGC 6334A

We present millimeter and centimeter wave spectroscopic observations of the H II region NGC 6334A. We have mapped the source in several transitions of CO, CS, and NH3. The molecular emission shows a distinct flattened structure in the east-west direction. This structure is probably a thick molecular disk or torus (2.2 x 0.9 pc) responsible for the bipolarity of the near-infrared (NIR) and radio continuum emission which extends in two "lobes" to the north and south of the shell-like H II region. The molecular disk is rotating from west to east (omega approximately equals 2.4 km/s.pc) about an axis approximately parallel to the radio and NIR emission lobes. By assuming virial equilibrium, we find that the molecular disk contains approximately 2000 solar mass. Single-component gas excitation model calculations show that the molecular gas in the disk is warmer and denser (T(sub k) approximately equals 60 K, n approximately equals 3000/cc) than the gas to the north and south (T(sub k) approximately equals 50 K, n approximately equals 400/cc). High resolution (approximately 5 sec) NH3 (3, 3) images of NGC 6334A reveal several small (approximately 0.1 pc) clumps, one of which lies southwest of the radio continuum shell, and is spatially coincident with a near-infrared source, IRS 20. A second NH3 clump is coincident with an H2O maser and the center of a molecular outflow. The dense gas tracers, CS J = 5 approaches 4 and 7 approaches 6, peak near IRS 20 and the H2O maser, not at NGC 6334A. IRS 20 has a substantial far-infrared (FIR) luminosity L(sub FIR) approximately 10(exp 5) solar luminosity, which indicates the presence of an O 7.5 star but has no detected radio continuum (F(sub 6 cm) < 0.02 Jy). The combination of dense gas, a large FIR luminosity and a lack of radio continuum can best be explained if IRS 20 is a protostar. A third clump of NH3 emission lies to the west of IRS 20 but is not associated with any other molecular or continuum features. The star formation activity in the region has moved west of NGC 6334A to IRS 20 and the H2O maser position. We suggest that NGC 6334A, IRS 20, and the H2O maser spot are part of a "protocluster" of stars which is condensing from the massive molecular disk. The similarity between the structure around NGC 6334A and other large (r approximately 1 pc), massive (M approximately 10(exp 3) solar mass), rotating disks (K3-50A and G10.6-0.4) suggests that this may be a common mechanism by which open clusters form.

Kraemer, Kathleen E.↗

DOE OSTI2023

Bayesian uncertainty quantification of tristructural isotropic particle fuel silver release: Decomposing model inadequacy plus experimental noise and parametric uncertainties

Tristructural isotropic (TRISO) particle fuel is one of the most promising fuel concepts enabling high temperature and high burnup reactor operation. One dominant source of radioactivity released from the TRISO particles is silver (Ag), which is subject to a high release fraction and long decay life compared to other fission products. Previous modeling efforts using the fuel performance code BISON indicated nonnegligible uncertainties in modeling the diffusion process of fission products in TRISO compared to the Advanced Gas Reactor experiments. The overall uncertainties observed when modeling the fission product diffusion can result from uncertainties in model parameters, noisy experimental measurements, and deficiencies in the developed models. The three types of underlying uncertainties have not yet been properly quantified in open literature. Here, this paper presents the Bayesian uncertainty quantification (UQ) using massively parallelizable Markov chain Monte Carlo samplers. The uncertainties due to model parameters, model inadequacy, and experimental measurement noise are quantified, with the σ term used to represent the sum of the model inadequacy and measurement noise uncertainties. It is worth noting that this is the first time the σ term is inferred for nuclear fuel experiments, as compared to using prescribed values for uncertainty quantification in previous work. The parallelizable Markov chain Monte Carlo samplers efficiently infer the model parameters and the σ term, giving insight into physical parameters like diffusion coefficients and the combined model discrepancy and measurement noise. A subsequent forward uncertainty quantification (UQ) is also performed based on the calibration results to generate more accurate predictions of the Ag release. The model inadequacy plus experimental noise is the most dominant source of uncertainty compared to the parametric uncertainty. All the UQ analyses presented in this work are based on the second series of the irradiation experiments in the Advanced Gas Reactor program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2011

Introduction to: Atlantic Meridional Overturning Circulation(AMOC)

A striking conclusion of the Intergovernmental Panel on Climate Change 2007 report is the crucial role that the Atlantic Meridional Overturning Circulation (AMOC) may play in anthropogenic climate change. However, these IPCC coupled climate simulations show a broad range of uncertainty in the magnitude and timing of AMOC transport change ranging from none to nearly complete collapse within the 21st century. The potential consequences of large changes in the characteristics of AMOC have motivated the creation in the United States of an interagency program and implementation plan to develop monitoring and prediction capabilities for the AMOC This program parallels the development of substantial monitoring efforts by European, South American and African countries -- notably the UK Rapid and Rapid-Watch programs. The papers contained in this volume are derived from presentations at the First U.S. Atlantic Meridional Overturning Circulation (AMOC) Meeting held 4 - 6 May, 2009 to review the US implementation plan and its coordination with other monitoring activities. The Atlantic Meridional Overturning Circulation consists of multiple components illustrated in an attached figure. Water enters the South Atlantic at upper and intermediate depths through both western and eastern routes (where eddy transport is especially important) and is transported northward across the equator, where it recirculates within the northern subtropical and subpolar gyres. The northern end is defined by the sinking regions of the Nordic Seas and the Labrador Sea where the waters that eventually form the upper and lower branches of North Atlantic Deep Water are conditioned. High surface salinities, the result of high net evaporation in the tropics and subtropics (including the Mediterranean Sea), and presence of regions of the Arctic Ocean that remain ice-free even in winter allow for the rapid cooling and thus densification of surface water. This dense surface water becomes the source of deep water formation in the sinking regions. In addition to transporting mass, the AMOC transports roughly half of the total amount of heat carried northward through the northern subtropics (down the temperature-gradient) by the ocean. In contrast in the Southern Hemisphere AMOC transports heat up-gradient from the cool Circumpolar Current to the warm tropics. Paleoevidence suggests that AMOC heat transport in the two hemispheres has varied over time in ways intimately tied to millennial changes in the Earth's climate. In one example, the abrupt Younger Dryas spell of cold weather over the North Atlantic, which began 13,000 years ago, has generally been linked to a millennial shutdown of the AMOC as a result of massive freshwater discharge from the North American continent. The current AMOC monitoring array consists of a series of instrumented transects located across key passages (see Cunningham et al., 2010 for a recent review). In the Arctic and sub-Arctic, transects cross Fram Strait, Denmark Strait and the Faroe Channel (connecting Greenland, Iceland, and the United Kingdom), as well as the entrance to the Labrador Sea. Further south and extending outwards from the east coast of North America there are a series of monitoring arrays including arrays of the Canadian Atlantic Zone Monitoring Program, deployments of the Rapid Western Atlantic Variability Experiment (WAVE), Line W at 39 N, as well as the Rapid-MOC moored array. The latter spans the entire Atlantic basin along 26.5 N. At tropical latitudes we have the Meridional Overturning Variability Experiment (MOVE) array at 16 N, while in the Southern Hemisphere a corresponding basin-spanning transect is being established at the latitude of Cape of Good Hope, complemented by arrays at Drake Passage.

Hakkinen, Sirpa↗