Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed data structures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Learning Global Proliferation Expertise Evolution Using AI-Driven Analytics and Public Information

Detecting and anticipating global proliferation expertise and capability evolution from unstructured, noisy, and incomplete public data streams is a highly desired, but extremely challenging task. Here, in this article, we present our pioneering data-driven approach to support the non-proliferation mission to detect and explain the evolution of proliferation expertise and capability development globally from terabytes of publicly available information (PAI), focusing on our knowledge extraction pipeline and descriptive analytics. We first discuss how we fuse nine open-source data streams, including multilingual data, to convert 4 TB of unstructured data to structured knowledge and encode dynamically evolving proliferation expertise representations—content and context graphs. For this, we rely on natural language processing (NLP) and deep learning (DL) models to perform information extraction, topic modeling, and distributed text representation (aka embedding) learning. We then present interactive, usable, and explainable descriptive analytics to refine domain knowledge and present it in a human-understandable form. Finally, we introduce future work avenues that will leverage our dynamic knowledge representations and descriptive analytics to enable predictive and prescriptive inferences to achieve real-time domain understanding and contextual reasoning about global proliferation expertise and capability evolution.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2022

A deep learning approach for semantic segmentation of unbalanced data in electron tomography of catalytic materials

In computed TEM tomography, image segmentation represents one of the most basic tasks with implications not only for 3D volume visualization, but more importantly for quantitative 3D analysis. In case of large and complex 3D data sets, segmentation can be an extremely difficult and laborious task, and thus has been one of the biggest hurdles for comprehensive 3D analysis. Heterogeneous catalysts have complex surface and bulk structures, and often sparse distribution of catalytic particles with relatively poor intrinsic contrast, which possess a unique challenge for image segmentation, including the current state-of-the-art deep learning methods. To tackle this problem, we apply a deep learning-based approach for the multi-class semantic segmentation of a γ-Alumina/Pt catalytic material in a class imbalance situation. Specifically, we used the weighted focal loss as a loss function and attached it to the U-Net’s fully convolutional network architecture. We assessed the accuracy of our results using Dice similarity coefficient (DSC), recall, precision, and Hausdorff distance (HD) metrics on the overlap between the ground-truth and predicted segmentations. Our adopted U-Net model with the weighted focal loss function achieved an average DSC score of 0.96 ± 0.003 in the γ-Alumina support material and 0.84 ± 0.03 in the Pt NPs segmentation tasks. We report an average boundary-overlap error of less than 2 nm at the 90th percentile of HD for γ-Alumina and Pt NPs segmentations. The complex surface morphology of γ-Alumina and its relation to the Pt NPs were visualized in 3D by the deep learning-assisted automatic segmentation of a large data set of high-angle annular dark-field (HAADF) scanning transmission electron microscopy (STEM) tomography reconstructions.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Nuclear Physics Exascale Requirements Review: An Office of Science Review sponsored jointly by Advanced Scientific Computing Research and Nuclear Physics, June 15 - 17, 2016, Gaithersburg, Maryland

Imagine being able to predict — with unprecedented accuracy and precision — the structure of the proton and neutron, and the forces between them, directly from the dynamics of quarks and gluons, and then using this information in calculations of the structure and reactions of atomic nuclei and of the properties of dense neutron stars (NSs). Also imagine discovering new and exotic states of matter, and new laws of nature, by being able to collect more experimental data than we dream possible today, analyzing it in real time to feed back into an experiment, and curating the data with full tracking capabilities and with fully distributed data mining capabilities. Making this vision a reality would improve basic scientific understanding, enabling us to precisely calculate, for example, the spectrum of gravity waves emitted during NS coalescence, and would have important societal applications in nuclear energy research, stockpile stewardship, and other areas. This review presents the components and characteristics of the exascale computing ecosystems necessary to realize this vision.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Predicting the propensity for thermally activated β events in metallic glasses via interpretable machine learning

Abstract The elementary excitations in metallic glasses (MGs), i.e., β processes that involve hopping between nearby sub-basins, underlie many unusual properties of the amorphous alloys. A high-efficacy prediction of the propensity for those activated processes from solely the atomic positions, however, has remained a daunting challenge. Recently, employing well-designed site environment descriptors and machine learning (ML), notable progress has been made in predicting the propensity for stress-activated β processes (i.e., shear transformations) from the static structure. However, the complex tensorial stress field and direction-dependent activation could induce non-trivial noises in the data, limiting the accuracy of the structure-property mapping learned. Here, we focus on the thermally activated elementary excitations and generate high-quality data in several Cu-Zr MGs, allowing quantitative mapping of the potential energy landscape. After fingerprinting the atomic environment with short- and medium-range interstice distribution, ML can identify the atoms with strong resistance or high compliance to thermal activation, at a high accuracy over ML models for stress-driven activation events. Interestingly, a quantitative “between-task” transferring test reveals that our learnt model can also generalize to predict the propensity of shear transformation. Our dataset is potentially useful for benchmarking future ML models on structure-property relationships in MGs.

36 MATERIALS SCIENCE↗
DOE OSTI2016

The unrelaxed dynamical structure of the galaxy cluster Abell 85

For the first time, we explore the dynamics of the central region of a galaxy cluster within r {sub 500} ∼ 600 h{sup −1} kpc from its center by combining optical and X-ray spectroscopy. We use (1) the caustic technique, which identifies the cluster substructures and their galaxy members with optical spectroscopic data, and (2) the X-ray redshift fitting procedure, which estimates the redshift distribution of the intracluster medium (ICM). We use the spatial and redshift distributions of the galaxies and of the X-ray-emitting gas to associate the optical substructures to the X-ray regions. When we apply this approach to Abell 85 (A85), a complex dynamic structure of A85 emerges from our analysis: a galaxy group, with redshift z = 0.0509 ± 0.0021 is passing through the cluster center along the line of sight dragging part of the ICM present in the cluster core; two additional groups, at redshift z = 0.0547 ± 0.0022 and z = 0.0570 ± 0.0020, are going through the cluster in opposite directions, almost perpendicularly to the line of sight, and have substantially perturbed the dynamics of the ICM. An additional group in the outskirts of A85, at redshift z = 0.0561 ± 0.0023, is associated with a secondary peak of X-ray emission, at redshift z=0.0583{sub −0.0047}{sup +0.0039}. Although our analysis and results on A85 need to be confirmed by high-resolution spectroscopy, they demonstrate how our new approach can be a powerful tool to constrain the formation history of galaxy clusters by unveiling their central and surrounding structures.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Probing cellulose structures with vibrational spectroscopy

This paper reviews principles, data interpretations, and applications of vibrational spectroscopic methods used for analysis of cellulose in the isolated state and in plant cell walls or lignocellulose biomass. The paper begins with reviewing the crystalline structures of crystalline cellulose polymorphs and the principles of three different vibrational spectroscopy methods—infrared (IR), Raman, and sum frequency generation (SFG)—complemented with density functional theory calculations. Then, it discusses the vibrational modes of crystalline celluloses, how the chain orientation in crystalline domain is analyzed in each method, and how the concentration and spatial distribution of crystalline cellulose domains interspersed in amorphous matrices are manifested or analyzed differently in these three methods. Finally, the paper discusses examples of analyzing crystalline cellulose in plant cell walls or lignocellulose biomass with IR, Raman, and SFG including spectroscopic imaging. One review cannot cover all vibrational spectroscopy literatures on cellulose; this review aims at providing tutorial information, using selected literatures and experimental data, needed to interpret nano-, meso-, and micro-scale structures of cellulose in plant cell walls and lignocellulose biomass.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Integrated Framework of Multisource Data Fusion for Outage Location in Looped Distribution Systems

Accurate outage location is essential for expediting post-outage power restoration, minimizing outage duration, and enhancing the resilience of distribution networks. With the advent of advanced metering infrastructure, data-driven outage location methods have significantly advanced beyond traditional approaches that rely on manual inspections. However, existing methods still face critical challenges, like reliance on single-source data, limited ability to handle partially observable systems or difficulties with loop networks. To the best of our knowledge, no single approach has comprehensively addressed all of these challenges at once. To this end, this paper proposes a comprehensive multisource data fusion framework for outage locations via probabilistic graph networks. The framework consists of three key phases. First, a novel method for reconstituting distribution networks with loops is developed, transforming looped networks into multiple radial subnetworks that retain all outage causalities of the original network. Second, Bayesian network (BN) models are established for each subnetwork, integrating multiple data sources and network structures. Finally, a joint Gibbs sampling mechanism, featuring forward and backward information flow, is designed to merge data from separate BN models and maximize the utilization of limited evidence, ensuring accurate outage location identification. In conclusion, the framework was validated on two modified public test systems, and comparative studies confirmed its effectiveness.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

How good are polarizable and flexible models for water: Insights from a many-body perspective

We present a systematic analysis of state-of-the-art polarizable and flexible water models from a many-body perspective, with a specific focus on their ability to represent the Born–Oppenheimer potential energy surface of water from the gas to the liquid phase. Using coupled cluster data in the completed basis set limit as a reference, we examine the accuracy of the polarizable models in reproducing individual many-body contributions to interaction energies and harmonic frequencies of water clusters and compare their performance with that of MB-pol, an explicit many-body model that has been shown to correctly predict the properties of water across the entire phase diagram. Based on these comparisons, we use MB-pol as a reference to analyze the ability of the polarizable models to reproduce the energy landscape of liquid water under ambient conditions. We find that, while correctly reproducing the energetics of minimum-energy structures, the polarizable models examined in this study suffer from inadequate representations of many-body effects for distorted configurations. To investigate the role played by geometry-dependent representations of 1-body charge distributions in reproducing coupled cluster data for both interaction and many-body energies, we introduce a simplified version of MB-pol that adopts fixed atomic charges and demonstrate that the new model retains the same accuracy as the original MB-pol model. Based on the analyses presented in this study, we believe that future developments of both polarizable and explicit many-body models should continue in parallel and would benefit from synergistic efforts aimed at integrating the best aspects of the two theoretical/computational frameworks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Bayesian operator inference for data-driven reduced-order modeling

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian inverse problem with Gaussian prior and likelihood. The resulting posterior distribution characterizes the operators defining the reduced-order model, hence the predictions subsequently issued by the reduced-order model are endowed with uncertainty. The statistical moments of these predictions are estimated via a Monte Carlo sampling of the posterior distribution. Since the reduced models are fast to solve, this sampling is computationally efficient. Furthermore, the proposed Bayesian framework provides a statistical interpretation of the regularization term that is present in the deterministic operator inference problem, and the empirical Bayes approach of maximum marginal likelihood suggests a selection algorithm for the regularization hyperparameters. The proposed method is demonstrated on two examples: the compressible Euler equations with noise-corrupted observations, and a single-injector combustion process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A parallel and performance portable implementation of a full-field crystal plasticity model

We have developed a parallel implementation of an Elasto-Viscoplastic Fast Fourier Transform-based (EVPFFT) micromechanical solver to enable computationally efficient crystal plasticity modeling for polycrystalline materials. Our primary focus lies in achieving performance portability, allowing a single EVPFFT implementation to run optimally on various homogeneous architectures, including multi-core Central Processing Units (CPUs), as well as on heterogeneous computer architectures comprising multi-core CPUs and Graphics Processing Units (GPUs) from different vendors. To accomplish this goal, we have leveraged MATAR, a C++ software library that simplifies the creation and utilization of multidimensional dense or sparse matrix and array data structures. These data structures are designed to be portable across diverse architectures through the use of Kokkos, a performance-portable library. Additionally, we have employed the Message Passing Interface (MPI) to efficiently distribute the computational workload among processors. The heFFTe (Highly Efficient FFT for Exascale) library is used to facilitate the performance portability of the fast Fourier transforms (FFTs) computation. The computational performance of EVPFFT is evaluated and presented in terms of parallel scalability and simulation runtime on different high-performance computing (HPC) architectures. As a result, the utility of the developed framework to efficiently simulate the micro-mechanical fields in polycrystalline microstructures in engineering applications is discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Subduction, Underplating, and Return Flow Recorded in the Cycladic Blueschist Unit Exposed on Syros, Greece

Exhumed high-pressure/low-temperature (HP/LT) metamorphic rocks provide insights into deep (~20–70 km) subduction interface dynamics. On Syros Island (Cyclades, Greece), the Cycladic Blueschist Unit preserves blueschist-to-eclogite facies oceanic- and continental-affinity rocks that record the structural and thermal evolution linked to Eocene subduction. Despite decades of research, the metamorphic and deformation history (P-T-D) and timing of subduction and exhumation are matters of ongoing discussion. We suggest that Syros comprises three coherent tectonic slices and that each slice underwent subduction, underplating, and syn-subduction return flow along similar P-T trajectories, but at progressively younger times. Subduction and exhumation are distinguished by lineations and ductile fold axis orientations, and are kinematically consistent with previous studies that document top-to-the-S-SW shear (prograde-to-peak subduction), top-to-the-NE shear (blueschist facies exhumation), and then E-W coaxial stretching (greenschist facies exhumation). Amphibole zonations record cooling during decompression, indicating return flow above a cold slab. Multi-mineral Rb-Sr isochrons and compiled metamorphic geochronology show that the three slices record distinct stages of peak subduction (53–52, ~50, and 45 Ma) that young with structural depth. Retrograde blueschist and greenschist facies fabrics span ~50–40 and ~43–20 Ma, respectively, and also young with structural depth. Synthesized data sets support a revised tectonic framework for Syros, involving subduction of structurally distinct coherent slices and simultaneous return flow of previously accreted tectonic slices in the subduction channel shear zone. Distributed, ductile, dominantly coaxial return flow in an Eocene-Oligocene subduction channel proceeded at rates of ~1.5–5 mm/yr and accommodated ~80% of the total exhumation of this HP/LT complex.

58 GEOSCIENCES↗
DOE OSTI2017

Fast automated analysis of strong gravitational lenses with convolutional neural networks

Quantifying image distortions caused by strong gravitational lensing—the formation of multiple images of distant sources due to the deflection of their light by the gravity of intervening structures—and estimating the corresponding matter distribution of these structures (the ‘gravitational lens’) has primarily been performed using maximum likelihood modelling of observations. Our procedure is typically time- and resource-consuming, requiring sophisticated lensing codes, several data preparation steps, and finding the maximum likelihood model parameters in a computationally expensive process with downhill optimizers. Accurate analysis of a single gravitational lens can take up to a few weeks and requires expert knowledge of the physical processes and methods involved. Tens of thousands of new lenses are expected to be discovered with the upcoming generation of ground and space surveys. We report the use of deep convolutional neural networks to estimate lensing parameters in an extremely fast and automated way, circumventing the difficulties that are faced by maximum likelihood methods. We also show that the removal of lens light can be made fast and automated using independent component analysis of multi-filter imaging data. Our networks can recover the parameters of the ‘singular isothermal ellipsoid’ density profile, which is commonly used to model strong lensing systems, with an accuracy comparable to the uncertainties of sophisticated models but about ten million times faster: 100 systems in approximately one second on a single graphics processing unit. These networks can provide a way for non-experts to obtain estimates of lensing parameters for large samples of data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Comprehensive characterization of the structure of Zr-based metallic glasses

Structure of metallic glasses fascinates as the generic amorphous structural template for ubiquitous systems. Its specification necessitates determination of the complete hierarchical structure, starting from short-range-order (SRO) → medium-range-order (MRO) → bulk structure and free volume (FV) distribution. This link has largely remained elusive since previous investigations adopted one-technique-at-a-time approach, focusing on limited aspects of any one domain. Reconstruction of structure from experimental data inversion is non-unique for many of these techniques. As a result, complete and precise structural understanding of glass has not emerged yet. In this work, we demonstrate the first experimental pathway for reconstruction of the integrated structure, for and glasses. Our strategy engages diverse (×7) multi-scale techniques [XAFS, 3D-APT, ABED/NBED, FEM, XRD, PAS, FHREM] on the same glass. This strategy complemented mutual limitations of techniques and corroborated common parameters to generate complete, self-consistent and precise parameters. Further, MRO domain size and inter-void separation were correlated to identify the presence of FV at MRO boundaries. This enabled the first experimental reconstruction of hierarchical subset: SRO → MRO → FV → bulk structure. The first ever image of intermediate region between MRO domains emerged from this link. We clarify that determination of all subsets is not our objective; the essence and novelty of this work lies in directing the pathway towards finite solution, in the most logical and unambiguous way.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Observation of Kolmogorov turbulence due to multiscale vortices in dusty plasma experiments

We report the experimental observation of fully developed Kolmogorov turbulence originating from self-excited vortex flows in a three-dimensional (3D) dust cloud. The characteristic -5/3 scaling of 3D Kolmogorov turbulence is consistent in both the spatial and temporal energy spectra within a statistical variation of experimental data. Additionally, the 2/3 scaling in the second-order structure function further supports the presence of Kolmogorov turbulence. We also identified a slight deviation in the tails of the probability distribution functions for velocity gradients, a reflection of intermittency. The experiment showed the formation of a dust cloud in the diffused plasma region away from the electrodes. The dust rotation was observed in multiple experimental campaigns under different discharge conditions at different spatial locations and background plasma environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Clusterdv: a simple density-based clustering method that is robust, general and automatic

Abstract Motivation How to partition a dataset into a set of distinct clusters is a ubiquitous and challenging problem. The fact that data vary widely in features such as cluster shape, cluster number, density distribution, background noise, outliers and degree of overlap, makes it difficult to find a single algorithm that can be broadly applied. One recent method, clusterdp, based on search of density peaks, can be applied successfully to cluster many kinds of data, but it is not fully automatic, and fails on some simple data distributions. Results We propose an alternative approach, clusterdv, which estimates density dips between points, and allows robust determination of cluster number and distribution across a wide range of data, without any manual parameter adjustment. We show that this method is able to solve a range of synthetic and experimental datasets, where the underlying structure is known, and identifies consistent and meaningful clusters in new behavioral data. Availability and implementation The clusterdv is implemented in Matlab. Its source code, together with example datasets are available on: https://github.com/jcbmarques/clusterdv. Supplementary information Supplementary data are available at Bioinformatics online.

Marques, João C.↗
DOE OSTI2021

NP-MRD: the Natural Products Magnetic Resonance Database

The Natural Products Magnetic Resonance Database (NP-MRD) is a comprehensive, freely available electronic resource for the deposition, distribution, searching and retrieval of nuclear magnetic resonance (NMR) data on natural products, metabolites and other biologically derived chemicals. NMR spectroscopy has long been viewed as the ‘gold standard’ for the structure determination of novel natural products and novel metabolites. NMR is also widely used in natural product dereplication and the characterization of biofluid mixtures (metabolomics). All of these NMR applications require large collections of high quality, well-annotated, referential NMR spectra of pure compounds. Unfortunately, referential NMR spectral collections for natural products are quite limited. It is because of the critical need for dedicated, open access natural product NMR resources that the NP-MRD was funded by the National Institute of Health (NIH). Since its launch in 2020, the NP-MRD has grown quickly to become the world's largest repository for NMR data on natural products and other biological substances. It currently contains both structural and NMR data for nearly 41,000 natural product compounds from >7400 different living species. All structural, spectroscopic and descriptive data in the NP-MRD is interactively viewable, searchable and fully downloadable in multiple formats. Extensive hyperlinks to other databases of relevance are also provided. The NP-MRD also supports community deposition of NMR assignments and NMR spectra (1D and 2D) of natural products and related meta-data. The deposition system performs extensive data enrichment, automated data format conversion and spectral/assignment evaluation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Angular power spectrum of the diffuse gamma-ray emission as measured by the Fermi Large Area Telescope and constraints on its dark matter interpretation

The isotropic gamma-ray background arises from the contribution of unresolved sources, including members of confirmed source classes and proposed gamma-ray emitters such as the radiation induced by dark matter annihilation and decay. Clues about the properties of the contributing sources are imprinted in the anisotropy characteristics of the gamma-ray background. We use 81 months of Pass 7 Reprocessed data from the Fermi Large Area Telescope to perform a measurement of the anisotropy angular power spectrum of the gamma-ray background. Here, we analyze energies between 0.5 and 500 GeV, extending the range considered in the previous measurement based on 22 months of data. We also compute, for the first time, the cross-correlation angular power spectrum between different energy bins. The derived angular spectra are compatible with being Poissonian, i.e. constant in multipole. Furthermore, the energy dependence of the anisotropy suggests that the signal is due to two populations of sources, contributing, respectively, below and above ~ 2 GeV . Finally, using data from state-of-the-art numerical simulations to model the dark matter distribution, we constrain the contribution from dark matter annihilation and decay in Galactic and extra-Galactic structures to the measured anisotropy. These constraints are competitive with those that can be derived from the average intensity of the isotropic gamma-ray background.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A Surface Exposed, Two-Domain Lipoprotein Cargo of a Type XI Secretion System Promotes Colonization of Host Intestinal Epithelia Expressing Glycans

The only known required component of the newly described Type XI secretion system (TXISS) is an outer membrane protein (OMP) of the DUF560 family. TXISS OMPs are broadly distributed across proteobacteria, but properties of the cargo proteins they secrete are largely unexplored. We report biophysical, histochemical, and phenotypic evidence that Xenorhabdus nematophila NilC is surface exposed. Biophysical data and structure predictions indicate that NilC is a two-domain protein with a C-terminal, 8-stranded β-barrel. This structure has been noted as a common feature of TXISS effectors and may be important for interactions with the TXISS OMP . The NilC N-terminal domain is more enigmatic, but our results indicate it is ordered and forms a β-sheet structure, and bioinformatics suggest structural similarities to carbohydrate-binding proteins. X. nematophila NilC and its presumptive TXISS OMP partner NilB are required for colonizing the anterior intestine of Steinernema carpocapsae nematodes: the receptacle of free-living, infective juveniles and the anterior intestinal cecum (AIC) in juveniles and adults. We show that, in adult nematodes, the AIC expresses a Wheat Germ Agglutinin (WGA)-reactive material, indicating the presence of N-acetylglucosamine or N-acetylneuraminic acid sugars on the AIC surface. A role for this material in colonization is supported by the fact that exogenous addition of WGA can inhibit AIC colonization by X. nematophila. Conversely, the addition of exogenous purified NilC increases the frequency with which X. nematophila is observed at the AIC, demonstrating that abundant extracellular NilC can enhance colonization. NilC may facilitate X. nematophila adherence to the nematode intestinal surface by binding to host glycans, it might support X. nematophila nutrition by cleaving sugars from the host surface, or it might help protect X. nematophila from nematode host immunity. Proteomic and metabolomic analyses of wild type X. nematophila compared to those lacking nilB and nilC revealed differences in cell wall and secreted polysaccharide metabolic pathways. Additionally, purified NilC is capable of binding peptidoglycan, suggesting that periplasmic NilC may interact with the bacterial cell wall. Overall, these findings support a model that NilB-regulated surface exposure of NilC mediates interactions between X. nematophila and host surface glycans during colonization. This is a previously unknown function for a TXISS.

59 BASIC BIOLOGICAL SCIENCES↗