Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Air Quality Monitoring Case Study Using Mobile Low-cost Sensors mounted on Trash-Trucks: Methods Development and Lessons Learned

Air quality monitoring (AQM) is crucial for cities to develop management plans supporting population health. However, there is a dearth of measurements due to the high cost of standard reference instruments. Mobile AQM using low-cost sensors deployed on routine fleets of vehicles can enable the continuous detection of fine-scale pollutant variations in cities at a lower cost. New methods need to be developed to interpret these measurements. This paper presents three such methods. First, we propose a technique to identify aerosol hotspots. Second, we employ techniques published previously to assess the generalizable map of fine and coarse particle number concentrations, to understand qualitatively the contribution of local and regional sources across the region sampled. By using the raw number concentration of differently sized particles from the Optical Particle Counters (OPCs) instead of the noisier mass concentrations, we obtain more robust results. Third, in order to evaluate source signatures in cities, we propose another technique, in which we cluster the entire range of aerosol size-distribution measurements acquired. The properties of each cluster provide insight into the aerosol source characteristics in the sampling environment. We test these methods using a dataset we collected by mounting OPCs on two trash-trucks in Cambridge, Massachusetts.

Drive-by sensing↗
DOE OSTI2023

Development of fracture diagnostic methods for fluid distribution based on quantitative interpretation of distributed acoustic sensing and distributed temperature sensing

Multistage hydraulic fracturing design on horizontal wells has significantly evolved with larger fluid volume, more fracturing stages, and tighter perforation cluster spacing to efficiently stimulate unconventional reservoirs. From the published field observations, the recent fracturing design results in complex fracture networks or swarm of fractures. Fracture treatment evaluation is extremely challenging in such a case because of the large amount of variables in well completion and stimulation design. Combined measurements from different technologies can help in fracture diagnosis. Fluid distribution, either during fracture injection or during production, directly relates to the stimulation efficiency at the cluster level and at the stage level. Because it is unlikely in the real world to distribute the injected fluid uniformly among all the clusters, we need diagnostic techniques to generate the flow profile along a lateral. Fiber-optic measurements, such as distributed acoustic sensing (DAS) and distributed temperature sensing (DTS), are currently used to diagnose downhole flow conditions. This technology allows us to qualitatively confirm the fluid flow profile and other issues occurring downhole during fracturing such as leakage through plugs. For optimizing a fracturing design, we also need to understand how the design parameters are correlated with the stimulation efficiency. In this study, we combine two sets of models of DAS and DTS data interpretation for injected fluid volume distribution. The DAS is interpreted based on an empirical correlation between fluid flow rates and frequency band energy from the acoustic signals. The DTS is interpreted by performing temperature history match-based thermal energy conservation. Because of the completely different physics behind the interpretations, the confirmation of two interpretations provides confidence in fluid distribution.

Geochemistry & Geophysics↗
DOE OSTI2020

The Architecture of Metabolism Maximizes Biosynthetic Diversity in the Largest Class of Fungi

Abstract Ecological diversity in fungi is largely defined by metabolic traits, including the ability to produce secondary or “specialized” metabolites (SMs) that mediate interactions with other organisms. Fungal SM pathways are frequently encoded in biosynthetic gene clusters (BGCs), which facilitate the identification and characterization of metabolic pathways. Variation in BGC composition reflects the diversity of their SM products. Recent studies have documented surprising diversity of BGC repertoires among isolates of the same fungal species, yet little is known about how this population-level variation is inherited across macroevolutionary timescales. Here, we applied a novel linkage-based algorithm to reveal previously unexplored dimensions of diversity in BGC composition, distribution, and repertoire across 101 species of Dothideomycetes, which are considered the most phylogenetically diverse class of fungi and known to produce many SMs. We predicted both complementary and overlapping sets of clustered genes compared with existing methods and identified novel gene pairs that associate with known secondary metabolite genes. We found that variation among sets of BGCs in individual genomes is due to nonoverlapping BGC combinations and that several BGCs have biased ecological distributions, consistent with niche-specific selection. We observed that total BGC diversity scales linearly with increasing repertoire size, suggesting that secondary metabolites have little structural redundancy in individual fungi. We project that there is substantial unsampled BGC diversity across specific families of Dothideomycetes, which will provide a roadmap for future sampling efforts. Our approach and findings lend new insight into how BGC diversity is generated and maintained across an entire fungal taxonomic class.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

A parallel, distributed memory implementation of the adaptive sampling configuration interaction method

The many-body simulation of quantum systems is an active field of research that involves several different methods targeting various computing platforms. Many methods commonly employed, particularly coupled cluster methods, have been adapted to leverage the latest advances in modern high-performance computing. Selected configuration interaction (sCI) methods have seen extensive usage and development in recent years. However, the development of sCI methods targeting massively parallel resources has been explored only in a few research works. Here, we present a parallel, distributed memory implementation of the adaptive sampling configuration interaction approach (ASCI) for sCI. In particular, we will address the key concerns pertaining to the parallelization of the determinant search and selection, Hamiltonian formation, and the variational eigenvalue calculation for the ASCI method. Load balancing in the search step is achieved through the application of memory-efficient determinant constraints originally developed for the ASCI-PT2 method. The presented benchmarks demonstrate near optimal speedup for ASCI calculations of Cr 2 (24e, 30o) with 10 6 , 10 7 , and 3 × 10 8 variational determinants on up to 16 384 CPUs. Importantly, to the best of the authors’ knowledge, this is the largest variational ASCI calculation to date.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Structural Properties of Nanometer‐Sized Gold Nanoparticles on a Silicon Substrate

Properties of gold nanoparticles (Au NPs) supported on Si substrates, which have been the focus of recent attention, depend sensitively on the size, structure, and coordination of Au NPs as well as on the processes of interdiffusion and chemical bonding at the Au–Si interface. There is a great need, therefore, for developing structural techniques capable of imaging such nanosystems in atomic detail. Here, it is discussed how the atomic structure of nanometer‐sized Au NPs deposited on a silicon surface can be determined by using high‐energy X‐ray diffraction measurements in combination with an analysis based on atomic‐pair‐distribution functions and advanced reverse Monte Carlo methods. This approach delivers simple and incisive pictures of the structure of Au clusters on Si and reveals direct structural evidence for the emergence of a Au‐silicide interface following room temperature deposition of Au NPs on Si. This study will contribute to designing Au/Si nanostructures with desirable properties.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Differentiating supported platinum single atoms, clusters and nanoparticles by styrene hydrogenation

Supported metal catalysts often consist of metal sites ranging from nanoparticles to subnanometer clusters and single atoms. It remains a necessity to differentiate these sites to guide design of optimal catalysts. Here we report a simple method to assess the distribution of metal active sites in catalyst samples. The method takes the advantage of the structure sensitivity of styrene hydrogenation over titania supported platinum (Pt) catalysts with Pt aggregates varied from single atom to ~1.40 nm nanoparticles. The physicochemical properties were characterized by STEM, XPS, XANES, H2-TPR and CO-chemisorption measurements. The reactivity of Pt sites was quantified by styrene hydrogenation at ambient conditions. The nanometer-sized Pt clusters have significantly higher activity than Pt nanoparticles, sub-nanometer clusters or isolated single atoms. Additionally, the relationship between activity and structural/electronic properties of Pt sites influenced by particle sizes was discussed. Similar relationship was found in the carbon supported Pt catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

On the Efficient Evaluation of the Exchange Correlation Potential on Graphics Processing Unit Clusters

The predominance of Kohn–Sham density functional theory (KS-DFT) for the theoretical treatment of large experimentally relevant systems in molecular chemistry and materials science relies primarily on the existence of efficient software implementations which are capable of leveraging the latest advances in modern high-performance computing (HPC). With recent trends in HPC leading toward increasing reliance on heterogeneous accelerator-based architectures such as graphics processing units (GPU), existing code bases must embrace these architectural advances to maintain the high levels of performance that have come to be expected for these methods. In this work, we purpose a three-level parallelism scheme for the distributed numerical integration of the exchange-correlation (XC) potential in the Gaussian basis set discretization of the Kohn–Sham equations on large computing clusters consisting of multiple GPUs per compute node. In addition, we purpose and demonstrate the efficacy of the use of batched kernels, including batched level-3 BLAS operations, in achieving high levels of performance on the GPU. We demonstrate the performance and scalability of the implementation of the purposed method in the NWChemEx software package by comparing to the existing scalable CPU XC integration in NWChem.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

Recovering the real density field of galaxies from redshift space

This paper proposes a number of methods for recovering the true, real-space large-scale density distributions from redshift data sets. On the largest scales, the effects of peculiar velocities is to compress the galaxy clustering along the line of sight and consequently the density gradient in the radial direction is enhanced in comparison with the density gradient perpendicular to the line of sight. We calculate the relation between the density gradients in real and redshift space in the linear regime and show that it is a simple function of the density parameter, Omega. By considering the anisotropy of density gradients in redshift space it is possible, in principle, to obtain information about the value of Omega. Using N-body simulations we examine different methods for correcting the effects of large-scale velocities to obtain the true density distributions. We derive the peculiar velocity field from the redshift data and iterate to place each galaxy at a distance consistent with its measured redshift and its derived velocity. Linear theory, as well as second-order solutions for the peculiar velocity field are tested. The density distributions in low-density regions predicted by both linear theory and second-order theory are similar, and in good agreement with the true density field in the simulation. The use of the second-order corrections improves the prediction of the density field in high-density regions.

Gramann, Mirt↗
DOE OSTI2020

A New Configuration of Paralleled Modular ANPC Multilevel Converter Controlled by an Improved Modulation Method for 1 MHz, 1 MW EV Charger

In this work, a new configuration of the modular multilevel converter (MLC) based on the parallel connection of three-level active-neutral-point-clamped (3L-ANPC) cells as well as its improved modulation method is proposed for 1 MHz, 1 MW electric vehicle (EV) megacharger. In the proposed paralleled modular ANPC-MLC, only six high-frequency silicon carbide (SiC) power switches operating at 333 kHz are required to generate 1 MHz switching frequency spectrum. Moreover, the operating voltage of all power devices is halved, the magnitude of the first switching frequency harmonic cluster is decreased by the factor of five, and the load current is equally distributed between the 3L-ANPC legs by employing the proposed improved modulation method. Hence, the modularity, efficiency, and power density of the proposed converter are notably increased, whereas the value of passive components and the overall switching loss are remarkably decreased. In addition, an optimized design of the one 3L-ANPC cell of the proposed paralleled modular ANPC-MLC for 1 MHz, 1MW EV megacharger using Ansys SIwave, Icepak, and Q3D finite element method platforms is presented and analyzed in detail. The provided experimental results of the down-scaled setup verify the feasibility and viability of the proposed configuration as well as its improved switching pattern.

42 ENGINEERING↗
NASA NTRS2017

Structure in the 3D Galaxy Distribution. III. Fourier Transforming the Universe: Phase and Power Spectra

We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform of finely binned galaxy positions. In both cases, deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. The complex Fourier transform characterizes spatial distributional properties beyond the power spectrum in a manner different from (and we argue is more easily interpreted than) the conventional multipoint hierarchy. We identify some threads of modern large-scale inference methodology that will presumably yield detections in new wider and deeper surveys.

Galaxies↗
DOE OSTI2021

Quantum circuit cutting with maximum-likelihood tomography

Abstract We introduce maximum-likelihood fragment tomography (MLFT) as an improved circuit cutting technique for running clustered quantum circuits on quantum devices with a limited number of qubits. In addition to minimizing the classical computing overhead of circuit cutting methods, MLFT finds the most likely probability distribution for the output of a quantum circuit, given the measurement data obtained from the circuit’s fragments. We demonstrate the benefits of MLFT for accurately estimating the output of a fragmented quantum circuit with numerical experiments on random unitary circuits. Finally, we show that circuit cutting can estimate the output of a clustered circuit with higher fidelity than full circuit execution, thereby motivating the use of circuit cutting as a standard tool for running clustered circuits on quantum hardware.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Geostatistical interpolation of streambed hydrologic attributes with addition of left censored data and anisotropy

Spatial geostatistical interpolation of point measurements of streambed attributes in the hyporheic zone may be constrained by the streambed anisotropy, and data density and spatial distribution may significantly impact the results. Spatial clustering and low spatial data density can be caused by bedrock outcropping at the streambed limiting installation of in-stream piezometers. This study examines parameter error variability of the geostatistical interpolation using anisotropic interpolation methods and increasing the data density by adding left censored values (i.e., data below measurement limit) to locations where measurements were limited by exposed bedrock lining the streambed. The reduction in relative standard error of the interpolation was determined for the spatial distributions of streambed attributes including hydraulic conductivity, seepage flux, and mercury solute flux measured in two different years along a study reach in East Fork Poplar Creek, Tennessee, USA. Here, two methods to impute the left censored values were compared including the conventional half the detection limit substitution method, and the Stochastic Approximation of Expectation-Maximization (SAEM) algorithm, which both had comparable results. Imputing left censored data increased the data density to recommended ranges, reduced data clustering, increased the spatial dependence for some attributes, and reduced the standard error for each of the three attributes. For the reach considered herein, addition of the left censored values resulted in a larger error reduction than the consideration of anisotropy within the interpolation, which confirms the benefit of data addition to increase data density within data-limited river corridors.

58 GEOSCIENCES↗
DOE OSTI2021

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1993

Using x ray images to detect substructure in a sample of 40 Abell clusters

Using a method for constraining the dynamical state of a galaxy cluster by examining the moments of its x-ray surface brightness distribution, we determine the statistics of cluster substructure for a sample of 40 Abell clusters. Using x-ray observations from the Einstein Observatory Imaging Proportional Counter (IPC), we measure the first moment M1(r), the ellipsoidal orientation angle theta2(r), and the axial ratio eta(r) at several different radii in the cluster. We determine the effects of systematics such as x-ray point source emission, telescope vignetting, Poisson noise, and characteristics of the IPC by measuring the same parameters on an ensemble of simulated cluster images. Due to the small band-pass of the IPC, the ICM emissivity is nearly independent of temperature so the intensity at each point in the IPC images is simply proportional to the emission measure calculated along the line of sight through the cluster (e.g. Fabricant et al. 1980). Therefore, barring a change superposition of two x-ray emitting clusters, a significant variation in the image centroid M1(r) as a function of radius indicates that the center of mass of the intra-cluster medium (ICM) varies with radius. We argue that such a configuration (essentially an m = 1 component in the ICM density distribution) is a non-equilibrium component; it results from an off-center subclump or a recent merger in the ICM.

Mohr, J. J.↗
NASA NTRS1999

SAGE: The Self-Adaptive Grid Code

The multi-dimensional self-adaptive grid code, SAGE, is an important tool in the field of computational fluid dynamics (CFD). It provides an efficient method to improve the accuracy of flow solutions while simultaneously reducing computer processing time. Briefly, SAGE enhances an initial computational grid by redistributing the mesh points into more appropriate locations. The movement of these points is driven by an equal-error-distribution algorithm that utilizes the relationship between high flow gradients and excessive solution errors. The method also provides a balance between clustering points in the high gradient regions and maintaining the smoothness and continuity of the adapted grid, The latest version, Version 3, includes the ability to change the boundaries of a given grid to more efficiently enclose flow structures and provides alternative redistribution algorithms.

Davies, Carol B.↗
NASA NTRS2015

Scattering Properties of Heterogeneous Mineral Particles with Absorbing Inclusions

We analyze the results of numerically exact computer modeling of scattering and absorption properties of randomly oriented poly-disperse heterogeneous particles obtained by placing microscopic absorbing grains randomly on the surfaces of much larger spherical mineral hosts or by imbedding them randomly inside the hosts. These computations are paralleled by those for heterogeneous particles obtained by fully encapsulating fractal-like absorbing clusters in the mineral hosts. All computations are performed using the superposition T-matrix method. In the case of randomly distributed inclusions, the results are compared with the outcome of Lorenz-Mie computations for an external mixture of the mineral hosts and absorbing grains. We conclude that internal aggregation can affect strongly both the integral radiometric and differential scattering characteristics of the heterogeneous particle mixtures.

minerals↗
NASA NTRS1994

X-ray clusters from a high-resolution hydrodynamic PPM simulation of the cold dark matter universe

A new three-dimensional hydrodynamic code based on the piecewise parabolic method (PPM) is utilized to compute the distribution of hot gas in the standard Cosmic Background Explorer (COBE)-normalized cold dark matter (CDM) universe. Utilizing periodic boundary conditions, a box with size 85 h(exp-1) Mpc, having cell size 0.31 h(exp-1) Mpc, is followed in a simulation with 270(exp 3)=10(exp 7.3) cells. Adopting standard parameters determined from COBE and light-element nucleosynthesis, Sigma(sub 8)=1.05, Omega(sub b)=0.06, we find the X-ray-emitting clusters, compute the luminosity function at several wavelengths, the temperature distribution, and estimated sizes, as well as the evolution of these quantities with redshift. The results, which are compared with those obtained in the preceding paper (Kang et al. 1994a), may be used in conjuction with ROSAT and other observational data sets. Overall, the results of the two computations are qualitatively very similar with regard to the trends of cluster properties, i.e., how the number density, radius, and temeprature depend on luminosity and redshift. The total luminosity from clusters is approximately a factor of 2 higher using the PPM code (as compared to the 'total variation diminishing' (TVD) code used in the previous paper) with the number of bright clusters higher by a similar factor. The primary conclusions of the prior paper, with regard to the power spectrum of the primeval density perturbations, are strengthened: the standard CDM model, normalized to the COBE microwave detection, predicts too many bright X-ray emitting clusters, by a factor probably in excess of 5. The comparison between observations and theoretical predictions for the evolution of cluster properties, luminosity functions, and size and temperature distributions should provide an important discriminator among competing scenarios for the development of structure in the universe.

Bryan, Greg L.↗
DOE OSTI2025

Cosmological Constraints from Full-Scale Clustering and Galaxy-Galaxy Lensing with DESI DR1

We present constraints on cosmic structure growth from the analysis of galaxy clustering and galaxy-galaxy lensing with galaxies from the Dark Energy Spectroscopic Instrument (DESI) Data Release 1. We analyze four samples drawn from the Bright Galaxy Survey (BGS) and the Luminous Red Galaxy (LRG) target classes. Projected galaxy clustering measurements from DESI are supplemented with lensing measurements from the Dark Energy Survey (DES), the Kilo-Degree Survey (KiDS), and the Hyper Suprime-Cam (HSC) survey around the same targets. Our method relies on a simulation-based modeling framework using the AbacusSummit simulations and a complex halo occupation distribution model that incorporates assembly bias. We analyze scales down to $0.4 \, h^{-1} \, \mathrm{Mpc}$ for clustering and $2.5 \, h^{-1} \, \mathrm{Mpc}$ for lensing, leading to stringent constraints on $S_8 = σ_8 \sqrt{Ω_\mathrm{m} / 0.3}$ and $Ω_\mathrm{m}$ when fixing other cosmological parameters to those preferred by the CMB. We find $S_8 = 0.794 \pm 0.023$ and $Ω_\mathrm{m} = 0.295 \pm 0.012$ when using lensing measurements from DES and KiDS. Similarly, for HSC, we find $S_8 = 0.793 \pm 0.017$ and $Ω_\mathrm{m} = 0.303 \pm 0.010$ when assuming the best-fit photometric redshift offset suggested by the HSC collaboration. Overall, our results are in good agreement with other results in the literature while continuing to highlight the constraining power of non-linear scales.

Lange, Johannes U. [American U.] (ORCID:0000000224↗