Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Imaging systematics induced by galaxy subsample fluctuation: New systematics at second order

Imaging systematics refers to the inhomogeneous distribution of a galaxy sample caused by varying observing conditions and astrophysical foregrounds. Current mitigation methods correct the galaxy density fluctuations $n$ gal /$\bar{n}$ gal caused by imaging systematics assuming that all galaxies in a sample have the same $n$ gal /$\bar{n}$ gal . Under this assumption, the corrected sample cannot perfectly recover the true correlation function. Here, we name this effect subsample systematics. For a galaxy sample, even if its overall sample statistics [redshift distribution 𝑛⁡(𝑧), galaxy bias 𝑏⁡(𝑧)], are accurately measured, 𝑛⁡(𝑧), 𝑏⁡(𝑧) can still vary across the observed footprint. It makes the correlation function amplitude of galaxy clustering higher, while correlation functions for galaxy-galaxy lensing and cosmic shear do not have noticeable change. Such a combination could potentially degenerate with physical signals on small angular scales, such as the amplitude of galaxy clustering, the impact of neutrino mass on the matter power spectrum, etc. subsample systematics cannot be corrected using imaging systematics mitigation approaches that rely on the cross-correlation signal between imaging systematics maps and the observed galaxy density field. In this paper, we derive formulated expressions of subsample systematics, demonstrating its fundamental difference with other imaging systematics. We also provide several toy models to visualize this effect. Finally, we discuss a potential method to estimate and mitigate subsample systematics by forward modeling its behavior using synthetic source injection.

Kong, Hui [The Barcelona Institute of Science and ↗
DOE OSTI2022

Brightest cluster galaxies trace weak lensing mass bias and halo triaxiality in the three hundred project

Galaxy clusters have a triaxial matter distribution. The weak-lensing signal, an important part in cosmological studies, measures the projected mass of all matter along the line of sight, and therefore changes with the orientation of the cluster. Studies suggest that the shape of the brightest cluster galaxy (BCG) in the centre of the cluster traces the underlying halo shape, enabling a method to account for projection effects. We use 324 simulated clusters at four redshifts between 0.1 and 0.6 from ‘The Three Hundred Project’ to quantify correlations between the orientation and shape of the BCG and the halo. We find that haloes and their embedded BCGs are aligned, with an average ~20 degree angle between their major axes. The bias in weak lensing cluster mass estimates correlates with the orientation of both the halo and the BCG. Mimicking observations, we compute the projected shape of the BCG, as a measure of the BCG orientation, and find that it is most strongly correlated to the weak-lensing mass for relaxed clusters. We also test a 2D cluster relaxation proxy measured from BCG mass isocontours. The concentration of stellar mass in the projected BCG core compared to the total stellar mass provides an alternative proxy for the BCG orientation. We find that the concentration does not correlate to the weak-lensing mass bias, but does correlate with the true halo mass. Here, these results indicate that the BCG shape and orientation for large samples of relaxed clusters can provide information to improve weak-lensing mass estimates.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1973

A study to explore the use of orbital remote sensing to determine native arid plant distribution

The author has identified the following significant results. Ground truth spectral signature data for various types of scenes, including ground with and without annuals, and various shrubs, were collected. When these signature data are plotted with infrared (MSS band 6 or 7) reflectivity on one axis and red (MSS band 5) reflectivity on the other axis, clusters of data from the various types of scenes are distinct. This method of expressing spectral signature data appears to be more useful for distinguishing types of scenes than a simple infrared to red reflectivity ration. Large areas of varnished desert pavement are visible and mappable on ERTS-1 and high altitude aircraft imagery. A large scale vegetation pattern was found to be correlated with the presence of the desert pavement. The large scale correlation was used in mapping the vegetation of the area. It was found that a distinctive soil type was associated with the presence of the varnished desert pavement. The high salinity and exchangeable sodium percentage of this soil type provide a basis for the explanation of both the large scale and small scale vegetation pattern.

Mcginnies, W. G.↗
DOE OSTI2021

The Attraction Indian Buffet Distribution

We propose the attraction Indian buffet distribution (AIBD), a distribution for binary feature matrices influenced by pairwise similarity information. Binary feature matrices are used in Bayesian models to uncover latent variables (i.e., features) that explain observed data. The Indian buffet process (IBP) is a popular exchangeable prior distribution for latent feature matrices. In the presence of additional information, however, the exchangeability assumption is not reasonable or desirable. The AIBD can incorporate pairwise similarity information, yet it preserves many properties of the IBP, including the distribution of the total number of features. Thus, much of the interpretation and intuition that one has for the IBP directly carries over to the AIBD. A temperature parameter controls the degree to which the similarity information affects feature-sharing between observations. Unlike other nonexchangeable distributions for feature allocations, the probability mass function of the AIBD has a tractable normalizing constant, making posterior inference on hyperparameters straight-forward using standard MCMC methods. A novel posterior sampling algorithm is proposed for the IBP and the AIBD. We demonstrate the feasibility of the AIBD as a prior distribution in feature allocation models and compare the performance of competing methods in simulations and an application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with i<24.5 and analyze it in four redshift bins covering 0.15≲z≲1.5. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales k max = 1Mpc –1 , including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a ~3σ detection of lensing magnification in the HSC data. Our results are stable to variations in σ 8 and Ω c and we find constraints that agree well with measurements from Planck and low-redshift probes. Lastly, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

TURBOMOLE: Modular program suite for ab initio quantum-chemical and condensed-matter simulations

TURBOMOLE is a collaborative, multi-national software development project aiming to provide highly efficient and stable computational tools for quantum chemical simulations of molecules, clusters, periodic systems, and solutions. The TURBOMOLE software suite is optimized for widely available, inexpensive, and resource-efficient hardware such as multi-core workstations and small computer clusters. TURBOMOLE specializes in electronic structure methods with outstanding accuracy–cost ratio, such as density functional theory including local hybrids and the random phase approximation (RPA), GW-Bethe–Salpeter methods, second-order Møller–Plesset theory, and explicitly correlated coupled-cluster methods. TURBOMOLE is based on Gaussian basis sets and has been pivotal for the development of many fast and low-scaling algorithms in the past three decades, such as integral-direct methods, fast multipole methods, the resolution-of-the-identity approximation, imaginary frequency integration, Laplace transform, and pair natural orbital methods. This review focuses on recent additions to TURBOMOLE’s functionality, including excited-state methods, RPA and Green’s function methods, relativistic approaches, high-order molecular properties, solvation effects, and periodic systems. A variety of illustrative applications along with accuracy and timing data are discussed. Moreover, available interfaces to users as well as other software are summarized. TURBOMOLE’s current licensing, distribution, and support model are discussed, and an overview of TURBOMOLE’s development workflow is provided. Challenges such as communication and outreach, software infrastructure, and funding are highlighted.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Non-Gaussian estimates of tensions in cosmological parameters

We discuss how to efficiently and reliably estimate the level of agreement and disagreement on parameter determinations from different experiments, fully taking into account non-Gaussianities in the parameter posteriors. We develop two families of scalable algorithms that allow us to perform this type of calculations in increasing number of dimensions and for different levels of tensions. One family of algorithms rely on kernel density estimates of posterior distributions while the other relies on machine learning modeling of the posterior distribution with normalizing flows. We showcase their effectiveness and accuracy with a set of benchmark examples and find both methods agree with each other and the true tension within 0.5σ in difficult cases and generally to 0.2σ or better. This allows us to study the level of internal agreement between different measurements of the clustering of cosmological structures from the Dark Energy Survey and their agreement with measurements of the Cosmic Microwave Background from the Planck satellite.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Drugsniffer: An Open Source Workflow for Virtually Screening Billions of Molecules for Binding Affinity to Protein Targets

The SARS-CoV2 pandemic has highlighted the importance of efficient and effective methods for identification of therapeutic drugs, and in particular has laid bare the need for methods that allow exploration of the full diversity of synthesizable small molecules. While classical high-throughput screening methods may consider up to millions of molecules, virtual screening methods hold the promise of enabling appraisal of billions of candidate molecules, thus expanding the search space while concurrently reducing costs and speeding discovery. Here, we describe a new screening pipeline, called drugsniffer, that is capable of rapidly exploring drug candidates from a library of billions of molecules, and is designed to support distributed computation on cluster and cloud resources. As an example of performance, our pipeline required ~40,000 total compute hours to screen for potential drugs targeting three SARS-CoV2 proteins among a library of ~3.7 billion candidate molecules.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1985

Does nucleation theory apply to the formation of refractory circumstellar grains?

It is pointed out that kinetic factors inherent in cosmic systems will prevent the attainment of an approximate equilibrium precondensation cluster distribution, and that therefore such systems will violate one of the most fundamental assumptions of nucleation theory. More importantly, it is shown that of the 11 refractory metal/metal oxide systems which have been studied experimentally none are consistent with the predictions of either classical nucleation theory or the Lothe-Pound modification. Since no valid method is known by which these deficiencies can be circumvented, it is concluded that nucleation theory cannot be made to work in expanding circumstellar shells. However, a stochastic, kinetic treatment which makes use of experimental and theoretical data for specific refractory systems does appear to be feasible.

Donn, B.↗
DOE OSTI2025

Impact of solvation on the electronic resonances in uracil

Interactions of low-energy electrons with the DNA and RNA nucleobases are known to form metastable states, known as electronic resonances. In this work, we study electron attachment to solvated uracil, an RNA nucleobase, using the orbital stabilization method at the Equation of Motion-Coupled Cluster for Electron Affinities with Singles and Doubles (EOM-EA-CCSD) level of theory with the Effective Fragment Potential (EFP) solvation method. We benchmarked the approach using multireference methods, as well as by comparing EFP and full quantum calculations. The impact of solvation on the first one particle (1p) shape resonance, formed by electron attachment to the π* LUMO orbital, as well as the first two particle one hole (2p1h) resonance, formed by electron attachment to neutral uracil's π–π* excited state, was investigated. We used molecular dynamics simulations for solvent configurations and applied charge stabilization technique-based biased sampling to procure configurations adequate to cover the entire range of the electron attachment energy distribution. The electron attachment energy in solution is found to be distributed over a wide range of energies, between 4.6 eV to 6.8 eV for the 2p1h resonance, and between −0.1 eV to 2 eV for the 1p resonance. The solvent effects were similar for the two resonances, indicating that the exact electron density of the state is not as important as the solvent configurations. Multireference calculations extended the findings showing that solvation effects are similar for the lowest four resonances, further indicating that the specific solute electron density is not as important, but rather the water configurations play the most important role in solvation effects. Lastly, by comparing bulk solvation to clusters of uracil with a few water molecules around it, we find that the impact of microsolvation is very different from that of bulk solvation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Toward Accurate Modeling of Galaxy Clustering on Small Scales: Constraining the Galaxy-halo Connection with Optimal Statistics

Applying halo models to analyze the small-scale clustering of galaxies is a proven method for characterizing the connection between galaxies and their host halos. Such works are often plagued by systematic errors or limited to clustering statistics that can be predicted analytically. In this work, we employ a numerical mock-based modeling procedure to examine the clustering of Sloan Digital Sky Survey DR7 galaxies. We apply a standard halo occupation distribution (HOD) model to dark matter only simulations with a ΛCDM cosmology. To constrain the theoreStical models, we utilize a combination of galaxy number density and selected scales of the projected correlation function, redshift-space correlation function, group multiplicity function, average group velocity dispersion, mark correlation function, and counts-in-cells statistics. We design an algorithm to choose an optimal combination of measurements that yields tight and accurate constraints on our model parameters. Compared to previous work using fewer clustering statistics, we find a significant improvement in the constraints on all parameters of our halo model for two different luminosity-threshold galaxy samples. Most interestingly, we obtain unprecedented high-precision constraints on the scatter in the relationship between galaxy luminosity and halo mass. However, our best-fit model results in significant tension (>4σ) for both samples, indicating the need to add second-order features to the standard HOD model. To guarantee the robustness of these results, we perform an extensive analysis of the systematic and statistical errors in our modeling procedure, including a first of its kind study of the sensitivity of our constraints to changes in the halo mass function due to baryonic physics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Mapping the effects of physical and chemical reduction parameters on local atomic distributions within bimetallic nanoparticles

Bimetallic nanoparticles prove advantageous over their monometallic counterparts due to the tunable, hybrid properties that result from combining different atomic species in a controlled way. The favorable optical and catalytic properties resulting from AgAu nanoparticle formation have been widely attributed to the existence of Ag–Au bonds, the maximization of which assumes the formation of a homogeneous alloy. Despite the importance of atomic scale structure in these systems, synthetic studies are typically not paired with structural characterization at the atomic scale. Herein, a comprehensive synthetic exploration of physical and chemical reduction parameters of resulting nanoparticle products is complemented with thorough X-ray characterization to probe how these parameters affect atomic scale alloy distributions within AgAu nanoparticles. Presented evidence shows Ag is substantially underincorporated into nanoparticle constructs compared with solution Ag : Au ratios regardless of precursor :reductant ratio or volume of reductant added. Both Ag and Au exhibit significant local clustering, with Ag distributed preferentially towards the nanoparticle surface. Most significantly, the results of this investigation suggest that reduction parameters alone can affect the local alloy distributions and homogeneity within bimetallic nanoparticles, even when the ratio of metallic precursors remains constant. Overall, this investigation presents the ability to control alloy distributions using kinetics and provides new considerations for optimizing synthetic methods to produce functional bimetallic nanoparticles.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2026

Inference of the linear matter power spectrum at z = 0 using DESI DR1 Full-Shape data

Measurements of galaxy distributions at large cosmic distances capture clustering from the past. In this study, we use a cosmological model to translate these observations into the present-day galaxy distribution. Specifically, we reconstruct the 3D linear matter power spectrum at redshift z = 0 using Dark Energy Spectroscopic Instrument (DESI) Year 1 (DR1) galaxy clustering data and Cosmic Microwave Background (CMB) observations, assuming the ΛCDM model, and compare it to the result assuming the w 0 w a CDM model. Building on previous state-of-the-art methods, we apply Effective Field Theory (EFT) modelling of the galaxy power spectrum to account for small-scale effects in the 2-point statistics of galaxy data. Implementation of the EFT approach improves the modelling of the galaxy power spectrum, providing a more robust consistency test of the assumed cosmological model. By casting both CMB and galaxy clustering observations, spanning distinct redshift regimes, into k-space, we can identify discrepancies between the datasets of different redshifts, which would indicate potential inaccuracies in the assumed expansion history. While previous studies have shown consistency with ΛCDM, this work extends the analysis with higher-quality data to further test the expansion histories of both ΛCDM and w 0 w a CDM. Our findings show that both ΛCDM and w 0 w a CDM provide consistent fits to the linear matter power spectrum recovered from DESI DR1 data.

cosmological parameters from LSS↗
DOE OSTI2020

Charge conservation and higher moments of charge fluctuations

Higher moments of distributions of net charge and baryon number in heavy-ion collisions have been proposed as signals of fundamental QCD phase transitions. In order to better understand background processes for these observables, models are presented which enable one to gauge the effects of local charge conservation, decays of resonances and clusters, Bose symmetrization, and volume fluctuations. Monte Carlo methods for generating samplings of particles consistent with local charge conservation are presented and are followed by a review of simple analytic models involving a single type of charge with a constant experimental efficiency. The main model consists of thermal emission superimposed onto a simple parametrization of collective flow, known as a blast wave, with emission being consistent with individual canonical ensembles. The spatial extent of local charge conservation is parameterized by the size and extent over which charge is conserved. Here, the sensitivity of third- and fourth-order moments, skewness and kurtosis, to these parameters, and to beam energy and baryon density is explored. Comparisons with STAR data show that a significant part of the observed non-Poissonian fluctuations in net-proton fluctuations are explained by charge and baryon-number conservation, but that measurements of the STAR collaboration for fluctuations of net electric charge significantly differ from expectations of the models presented here.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1995

Ensuring correct rollback recovery in distributed shared memory systems

Distributed shared memory (DSM) implemented on a cluster of workstations is an increasingly attractive platform for executing parallel scientific applications. Checkpointing and rollback techniques can be used in such a system to allow the computation to progress in spite of the temporary failure of one or more processing nodes. This paper presents the design of an independent checkpointing method for DSM that takes advantage of DSM's specific properties to reduce error-free and rollback overhead. The scheme reduces the dependencies that need to be considered for correct rollback to those resulting from transfers of pages. Furthermore, in-transit messages can be recovered without the use of logging. We extend the scheme to a DSM implementation using lazy release consistency, where the frequency of dependencies is further reduced.

Janssens, Bob↗
DOE OSTI2022

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Coherency-Aware Learning Control of Inverter-Dominated Grids: A Distributed Risk-Constrained Approach

Here, this letter investigates the importance of integrating the coherency knowledge for designing controllers to dampen sustained oscillations in wide-area power networks with significant penetration of inverter-interfaced resources. Coherency is a fundamental property of power systems, where time-scale separation in frequency dynamics leads to clustered behavior among generators of different groups. Large-scale penetration of inverter-driven low inertia resources replacing conventional synchronous generators (SGs) can lead to perturbation in the coherent partitioning; hence, integrating such information is of utmost importance for oscillation control designs. We present the coherency-aware design of a distributed output feedback-based reinforcement learning method that additionally incorporates risk constraints to capture the uncertainties related to net-load fluctuations. The use of domain-aware coherency information has produced improved training and oscillation performance than the coherency-agnostic control design, hence proving to be effective in controller design. Finally, we validated the proposed method with numerical experiments on the benchmark IEEE 68-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗