SEARCH · Engineering Papers

Results for “distributed data structures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

DOE OSTI2024

Design Methods, Tools, and Data for Ceramic Solar Receivers

This report presents the development of tools and methods for evaluating the reliability and performance of ceramic materials in high temperature solar receivers. As Concentrating Solar Power (CSP) technologies aim for higher operating temperatures to enhance efficiency and meet industrial process heat requirements, current high temperature metallic materials face challenges in maintaining structural integrity. This report explores advanced ceramics as a promising alternative, given their superior high temperature strength and lower thermal expansion, compared to metals. To address the need for effective ceramic receiver design tools, this report integrates statistical failure models of ceramics into the existing srlife tool: an open-source software package designed to estimate the life of high temperature CSP components. These failure models account for the inherent variability and flaw distribution in ceramics, as well as the impact of subcritical crack growth under high temperature cyclic loads. The report also presents experimental data collected for a commercially available ceramic material, SiC, and details the process of estimating reliability model parameters from these data. A comparative design analysis is then performed between ceramic (SiC) and metallic (current nickel-based superalloys A740H and A282) receiver. This comparison demonstrates that SiC receivers can achieve service life exceeding 30 years under high incident heat flux conditions, compared to just a few years for metallic receivers.

14 SOLAR ENERGY↗

DOE OSTI2018

Data-Driver Interpretation of Ultradeep Azimuthal Propagation

We report the interpretation of geological features around the borehole stresses on the search of true earth model parameters. Different from the conventional logging-while-drilling (LWD) technologies, such as wireline induction and propagation resistivity tools, the azimuthal resistivity measurement acquires the ability of directional sensitivity. Within this decade, this type of tools has been greatly enhanced with over hundred feet depth-of-detection (DoD). To resolve the interpretation of geological features within 100 feet from the borehole, the multiple-layer structure must be considered. However, the traditional methods can never handle the highly nonlinear inverse problems especially facing on the complicated earth structure. Meanwhile, no justifiable uncertainty of inverse parameters can be provided. The statistical methods have been adopted to search for the global statistical distribution and uncertainties of earth model parameters. However, the most attempts are still stuck in non-uniqueness of the solutions since the structure of earth model has been predefined, where the number of layers is assumed, which introduces another ambiguity into the model interpretation. This paper develops a general trans-dimensional Bayesian methodology to solve non-linear inverse problem of earth layer resistivity and depth to the layer boundaries, from the interpretation of ultra-deep azimuthal resistivity measurements. The presented work is a data-driven approach to search out the multi-dimensional parameter spaces. Finally, the simulations tell that the algorithm can efficiently solve the earth model interpretation within a hundred feet from borehole, and examine the uncertainty of earth model parameters.

58 GEOSCIENCES↗

DOE OSTI2021

Angular momentum of fission fragments from microscopic theory

During nuclear fission, a heavy nucleus splits into two rotating fragments. The associated angular momentum is large, yet the mechanism of its generation and its dependence on the mass of fragments remain poorly understood. In this Letter, we provide the first microscopic calculations of angular-momentum distributions in fission fragments for a wide range of fragment masses. For the benchmark case of 239 Pu(n th ,f), we find that the angular momentum of the fragments is largely determined by the nuclear shell structure and deformation, and that the heavy fragments therefore typically carry less angular momentum than their light partners. We use the fission model freya to simulate the emission of neutrons and photons from the fragments. The dependence of the angular momenta on fragment mass after the emission of neutrons and statistical photons is linear for the heavy fragments and either constant or weakly linear for the light fragments, consistent with the universal sawtooth pattern suggested by recent experimental data. Finally, we observe that using microscopic angular-momentum distributions modifies the number of emitted photons significantly.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2017

High-energy Gamma Rays from the Milky Way: Three-dimensional Spatial Models for the Cosmic-Ray and Radiation Field Densities in the Interstellar Medium

High-energy γ -rays of interstellar origin are produced by the interaction of cosmic-ray (CR) particles with the diffuse gas and radiation fields in the Galaxy. The main features of this emission are well understood and are reproduced by existing CR propagation models employing 2D galactocentric cylindrically symmetrical geometry. However, the high-quality data from instruments like the Fermi Large Area Telescope reveal significant deviations from the model predictions on few to tens of degrees scales, indicating the need to include the details of the Galactic spiral structure and thus requiring 3D spatial modeling. In this paper, the high-energy interstellar emissions from the Galaxy are calculated using the new release of the GALPROP code employing 3D spatial models for the CR source and interstellar radiation field (ISRF) densities. Three models for the spatial distribution of CR sources are used that are differentiated by their relative proportion of input luminosity attributed to the smooth disk or spiral arms. Two ISRF models are developed based on stellar and dust spatial density distributions taken from the literature that reproduce local near- to far-infrared observations. The interstellar emission models that include arms and bulges for the CR source and ISRF densities provide plausible physical interpretations for features found in the residual maps from high-energy γ -ray data analysis. The 3D models for CR and ISRF densities provide a more realistic basis that can be used for the interpretation of the nonthermal interstellar emissions from the Galaxy.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2016

Gamma emission tomography measurements of fuel assemblies at the Halden reactor

Gamma emission tomography measurements have been performed at the Halden Reactor Project using a dedicated instrument, which utilizes a high-resolution gamma-ray detector allowing for spectroscopic analysis of the measurement data. Measurements have been performed on two fuel assemblies consisting of 9 and 13 rods, respectively, in order to characterize the rod-wise radioactive source distribution (i.e. fission and activation products) within the fuel. The 9-rod fuel assembly consisted of five fuel rods at 50 MWd/kgUO{sub 2} and four fuel rods at 26 MWd/kgUO{sub 2}, where all rods had cooled for approximately 22 years at the time of measurement. The rods in the 13-rod assembly all had a burnup of ∼4.5 MWd/kgUO{sub 2}, and cooled for approximately 1.5 years at the time of measurement. In this paper, the tomographic data was reconstructed using the Filtered Backprojection technique, where no consideration to gamma-ray attenuation in the fuel was given. Due to the varying burnup and cooling times between the assemblies, the spectroscopic data also varied between the respective sets of measurements. The high-resolution detector used in the measurements allowed for tomographic reconstruction of many gamma-ray peaks corresponding to various fission products and activation products present in the fuel and structural materials. For instance the gamma tomography technique has shown rod-wise variation in the contents of fission products between the high-burnup and low-burnup rods. The rod-internal distribution of fission products was also observed where the volatile fission product {sup 137}Cs is observed to have migrated to the outer pellet surface in fuel rods in the 9-rod assembly, and where the gaseous fission product {sup 85}Kr is observed to have a uniform distribution in each fuel rod's gas plenum.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2026

Toward a standardization of cryostructure and cryogenic soil structure terminology for the field description of permafrost‐affected soils

This paper establishes standardized terminology and field documentation protocols for cryostructures and cryogenic soil structures in permafrost‐affected soils and provides brief guidance on descriptions of ground ice morphology and ice volume estimates. We consolidate permafrost terminology from Russian and North American literature, clarify long‐standing ambiguities, and provide explicit guidelines that align with US Department of Agriculture‐Natural Resources Conservation Service soil description standards. Our scheme makes critical distinctions between cryostructure, the distribution of ice within soil, and cryogenic soil structure, the morphological structure of soil resulting from ice formation. The scheme organizes cryostructures into three main categories: non‐segregated ice, visible segregated ice, and ice matrices. We introduce standardized codes and parameters for field descriptions of ice and soil that enable machine‐readable data collection compatible with existing soil information systems. This standardization will significantly enhance the integration of field observations into landscape‐scale assessments of permafrost stability, infrastructure vulnerability, and ecosystem response to permafrost thaw, addressing an urgent need for quantitative data to inform modeling and decision‐making in rapidly changing Arctic and subarctic environments.

Andersen, Megan L. [University of Minnesota, Saint↗

DOE OSTI2021

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Kurte, Kuldeep↗

DOE OSTI2026

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗

DOE OSTI2018

Fractal Dimension Calculation for Big Data Using Box Locality Index

The box-counting approach for fractal dimension calculation is scaled up for big data using a data structure named box locality index (BLI). The BLI is constructed as key-value pair style with the key (an integer array) indexing the location of a “box” (i.e., a gird cell on the multi-dimensional space embedding a given dataset) and the value counting the number of data points inside the box (called “box occupancy”). Compared with the traditionally used E-dim tree, the BLI avoids complex hierarchical structure and encodes only necessary information required by box-counting approach for fractal dimension calculation. Moreover, the key-value pair nature of BLI, together with the fact that the box occupancy is aggregatable, grants box-counting approach the needed scalability for fractal dimension calculation of big data using distributed computing techniques (e.g., MapReduce and Spark). Taking the advantage of the BLI, MapReduce and Spark methods for fractal dimension calculation of big data are developed, which conduct box-counting for each grid level as a cascade of MapReduce/Spark jobs in a bottom-up fashion. In an empirical validation, the MapReduce and Spark methods demonstrated good effectiveness and efficiency in fractal calculation of a big synthetic dataset. In summary, this work provides an efficient solution for the estimation of intrinsic dimension of big data that is essential for many machine learning methods and data analytics.

Fractal dimension, Intrinsic dimension, Box-counti↗

DOE OSTI2019

Multiscale Based Characterization and Classification of Urban Land-Use

Machine learning and deep learning provide a means for generating urban land-use maps with relatively little human effort compared to manually digitizing images. This is especially important for supporting global and regional initiatives focused on sustainability, planning, health, pro-poor policy, infrastructure, and population distribution estimates. Many of these initiatives work in areas where geospatial data is scarce, such as the global south, and often use land-use maps to help achieve their goals. In this study, we develop a typology for automated labeling of urban land-use data that captures the variation in structural patterns within cities. A comparison of classification accuracy between convolutional neural networks (CNNs) and support vector machines (SVMs) coupled with handcrafted features is conducted. Through experimental validation on two highly dense cities in Africa, we report on new insights and the potential benefits offered by both multiscale handcrafted features and multiscale-CNNs even with limited training data.

Arndt, Jacob↗

DOE OSTI2024

Resolved photons in S HERPA

We present the first complete simulation framework, in the SHERPA event generator, for resolved photon interactions at next-to leading order accuracy. It includes photon spectra obtained through the equivalent-photon approximation, parton distribution functions to parametrize the hadronic structure of quasi-real photons, the matching of the parton shower to next-to leading order QCD calculations for resolved photon cross sections, and the modelling of multiple-parton interactions. We validate our framework against a wide range of photo-production data from LEP and HERPA experiments, observing good overall agreement. We identify important future steps relevant for high-quality simulations at the planned Electron–Ion Collider.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2016

Towards a Scalable and Adaptive Application Support Platform for Large-Scale Distributed E-Sciences in High-Performance Network Environments

The advent of large-scale collaborative scientific applications has demonstrated the potential for broad scientific communities to pool globally distributed resources to produce unprecedented data acquisition, movement, and analysis. System resources including supercomputers, data repositories, computing facilities, network infrastructures, storage systems, and display devices have been increasingly deployed at national laboratories and academic institutes. These resources are typically shared by large communities of users over Internet or dedicated networks and hence exhibit an inherent dynamic nature in their availability, accessibility, capacity, and stability. Scientific applications using either experimental facilities or computation-based simulations with various physical, chemical, climatic, and biological models feature diverse scientific workflows as simple as linear pipelines or as complex as a directed acyclic graphs, which must be executed and supported over wide-area networks with massively distributed resources. Application users oftentimes need to manually configure their computing tasks over networks in an ad hoc manner, hence significantly limiting the productivity of scientists and constraining the utilization of resources. The success of these large-scale distributed applications requires a highly adaptive and massively scalable workflow platform that provides automated and optimized computing and networking services. This project is to design and develop a generic Scientific Workflow Automation and Management Platform (SWAMP), which contains a web-based user interface specially tailored for a target application, a set of user libraries, and several easy-to-use computing and networking toolkits for application scientists to conveniently assemble, execute, monitor, and control complex computing workflows in heterogeneous high-performance network environments. SWAMP will enable the automation and management of the entire process of scientific workflows with the convenience of a few mouse clicks while hiding the implementation and technical details from end users. Particularly, we will consider two types of applications with distinct performance requirements: data-centric and service-centric applications. For data-centric applications, the main workflow task involves large-volume data generation, catalog, storage, and movement typically from supercomputers or experimental facilities to a team of geographically distributed users; while for service-centric applications, the main focus of workflow is on data archiving, preprocessing, filtering, synthesis, visualization, and other application-specific analysis. We will conduct a comprehensive comparison of existing workflow systems and choose the best suited one with open-source code, a flexible system structure, and a large user base as the starting point for our development. Based on the chosen system, we will develop and integrate new components including a black box design of computing modules, performance monitoring and prediction, and workflow optimization and reconfiguration, which are missing from existing workflow systems. A modular design for separating specification, execution, and monitoring aspects will be adopted to establish a common generic infrastructure suited for a wide spectrum of science applications. We will further design and develop efficient workflow mapping and scheduling algorithms to optimize the workflow performance in terms of minimum end-to-end delay, maximum frame rate, and highest reliability. We will develop and demonstrate the SWAMP system in a local environment, the grid network, and the 100Gpbs Advanced Network Initiative (ANI) testbed. The demonstration will target scientific applications in climate modeling and high energy physics and the functions to be demonstrated include workflow deployment, execution, steering, and reconfiguration. Throughout the project period, we will work closely with the science communities in the fields of climate modeling and high energy physics including Spallation Neutron Source (SNS) and Large Hadron Collider (LHC) projects to mature the system for production use.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

DEM Modeling and Validation of Pebble Bed Packing Using Chrono::GPU

Accurate prediction of pebble packing structure is important for pebble bed reactors because the spatial distribution of void fraction directly affects coolant flow, pressure drop, heat transfer, and neutronic behavior. However, experimentally validated DEM studies that directly evaluate local void-fraction structure in reactor-relevant pebble beds remain limited. In this work, the pebble bed experiment conducted at Missouri University of Science and Technology is simulated using the graphics processing unit (GPU)-based discrete element method (DEM) code Chrono::GPU. The study focuses on evaluating the ability of Chrono::GPU to reproduce the packing arrangement and void-fraction distribution of a randomly packed spherical pebble bed. The DEM results are first verified against established radial void-fraction correlations, including the Mueller and Vortmeyer-Schuster models, to assess the predicted bulk porosity, near-wall behavior, and oscillatory packing structure. The simulation is then verified against reference DEM data and validated against gamma-ray computed tomography (CT) experimental data at three axial locations. The Chrono::GPU results reproduce the main features of the experimental packing, including the high void fraction near the wall, the first near-wall trough, and the damped oscillatory radial profile caused by wall-induced ordering. Quantitative comparison with DEM data and the CT-based radial profiles shows good agreement, with mean absolute errors on the order of 0.07 and root-mean-square errors below 0.09 for the averaged profiles. These results demonstrate that Chrono::GPU can accurately capture the void-fraction structure of spherical pebble beds and provides a reliable DEM framework for future pebble bed reactor packing, recycling, and thermal-hydraulic studies.

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Crystal and magnetic structures of Cr{sub 1∕3}NbSe{sub 2} from neutron diffraction

Neutron diffraction measurements of the Cr intercalated niobium diselenide Cr{sub 1∕3}NbSe{sub 2} together with magnetization measurements have revealed that this compound exhibits ferromagnetic ordering below T{sub C} = 96 K unlike a chiral helimagnetic order observed in the sulfide compound Cr{sub 1∕3}NbS{sub 2}. As derived from neutron diffraction data, the Cr magnetic moments μ{sub Cr} = 2.83 ± 0.03 μ{sub B} in Cr{sub 1∕3}NbSe{sub 2} are aligned within basal plane. The discrepancy in the magnetic states of Cr{sub 1∕3}NbS{sub 2} and Cr{sub 1∕3}NbSe{sub 2} is ascribed to the difference in the preferential site occupation of Cr ions in crystal lattices. In Cr{sub 1∕3}NbSe{sub 2}, the Cr ions are predominantly distributed over 2b Wyckoff site, which determines a centrosymmetric character of the crystal structure unlike Cr{sub 1∕3}NbS{sub 2}, where the Cr ions are mainly located in 2c position and the crystal structure is non-centrosymmetric.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2018

Duality-Free Decomposition Based Data-Driven Stochastic Security-Constrained Unit Commitment

To incorporate the superiority of both stochastic and robust approaches, a data-driven stochastic optimization is employed to solve the security-constrained unit commitment model. This approach makes the most use of the historical data to generate a set of possible probability distributions for wind power outputs and then it optimizes the unit commitment under the worst-case probability distribution. However, this model suffers from huge computational burden, as a large number of scenarios are considered. To tackle this issue, a duality-free decomposition method is proposed in this paper. This approach does not require doing duality, which can save a large set of dual variables and constraints, and therefore reduces the computational burden. In addition, the inner max-min problem has a special mathematical structure, where the scenarios have the similar constraint. Thus, the max-min problem can be decomposed into independent sub-problems to be solved in parallel, which further improves the computational efficiency. A numerical study on an IEEE 118-bus system with practical data of a wind power system has demonstrated the effectiveness of the proposal.

42 ENGINEERING↗

DOE OSTI2018

Structure of a Deformed Inhomogeneous Material on the Data of Acoustic Emission and X-Ray Computer Microtomography

Accumulation of defects at various stages of the deformation of a structurally inhomogeneous material (granite) has been studied using two nondestructive methods: acoustic emission (AE) and X-ray computer microtomorgaphy (CT). The quasi-static testing of cylindrical samples of a Westerly granite was carried out under uniaxial compression. The control of the defect formation was realized using the real-time monitoring of acoustic emission. For each sample under study, several steps of the loading and tomographic imaging have been performed. We have found that an exponential or power-law function of the energy distribution of the AE signals makes it possible to select a sample region, in which the system of defects has transited into a self-organized criticality state and large cracks have been formed. This result coincides with the data of the X-ray tomography Computer Microtomography.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

Postglacial migration shaped the genomic diversity and global distribution of the wild ancestor of lager-brewing hybrids

The wild, cold-adapted parent of hybrid lager-brewing yeasts, Saccharomyces eubayanus, has a complex and understudied natural history. The exploration of this diversity can be used both to develop new brewing applications and to enlighten our understanding of the dynamics of yeast evolution in the wild. Here, we integrate whole genome sequence and phenotypic data of 200 S. eubayanus strains, the largest collection known to date. S. eubayanus has a multilayered population structure, consisting of two major populations that are further structured into six subpopulations. Four of these subpopulations are found exclusively in the Patagonian region of South America; one is found predominantly in Patagonia and sparsely in Oceania and North America; and one is specific to the Holarctic ecozone. Plant host associations differed between subpopulations and between S. eubayanus and its sister species, Saccharomyces uvarum. S. eubayanus is most abundant and genetically diverse in northern Patagonia, where some locations harbor more genetic diversity than is found outside of South America, suggesting that northern Patagonia east of the Andes was a glacial refugium for this species. All but one subpopulation shows isolation-by-distance, and gene flow between subpopulations is low. However, there are strong signals of ancient and recent outcrossing, including two admixed lineages, one that is sympatric with and one that is mostly isolated from its parental populations. Using our extensive biogeographical data, we build a robust model that predicts all known and a handful of additional regions of the globe that are climatically suitable for S. eubayanus, including Europe where host accessibility and competitive exclusion by other Saccharomyces species may explain its continued elusiveness. We conclude that this industrially relevant species has rich natural diversity with many factors contributing to its complex distribution and natural history.

59 BASIC BIOLOGICAL SCIENCES↗