SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

NASA NTRS1994

Cold dark matter. 2: Spatial and velocity statistics

We examine high-resolution gravitational N-body simulations of the omega = 1 cold dark matter (CDM) model in order to determine whether there is any normalization of the initial density fluctuation spectrum that yields acceptable results for galaxy clustering and velocities. Dense dark matter halos in the evolved mass distribution are identified with luminous galaxies; the most massive halos are also considered as sites for galaxy groups, with a range of possibilities explored for the group mass-to-light ratios. We verify the earlier conclusions of White et al. (1987) for the low-amplitude (high-bias) CDM model-the galaxy correlation function is marginally acceptable but that there are too many galaxies. We also show that the peak biasing method does not accurately reproduce the results obtained using dense halos identified in the simulations themselves. The Cosmic Background Explorer (COBE) anisotropy implies a higher normalization, resulting in problems with excessive pairwise galaxy velocity dispersion unless a strong velocity bias is present. Although we confirm the strong velocity bias of halos reported by Couchman & Carlberg (1992), we show that the galaxy motions are still too large on small scales. We find no amplitude for which the CDM model can reconcile simultaneously and galaxy correlation function, the low pairwise velocity dispersion, and the richness distribution of groups and clusters. With the normalization implied by COBE, the CDM spectrum has too much power on small scales if omega = 1.

Gelb, James M.↗

NASA NTRS1980

Carbon Fibers Conductivity Studies

In an attempt to understand the process of electrical conduction in polyacrylonitrile (PAN)-based carbon fibers, calculations were carried out on cluster models of the fiber consisting of carbon, nitrogen, and hydrogen atoms using the modified intermediate neglect of differential overlap (MINDO) molecular orbital (MO) method. The models were developed based on the assumption that PAN carbon fibers obtained with heat treatment temperatures (HTT) below 1000 C retain nitrogen in a graphite-like lattice. For clusters modeling an edge nitrogen site, analysis of the occupied MO's indicated an electron distribution similar to that of graphite. A similar analysis for the somewhat less stable interior nitrogen site revealed a partially localized II electron distribution around the nitrogen atom. The differences in bonding trends and structural stability between edge and interior nitrogen clusters led to a two-step process proposed for nitrogen evolution with increasing HTT.

Yang, C. Y.↗

NASA NTRS2024

XLSSC 122 Caught in the Act of Growing Up: Spatially Resolved SZ Observations of a z=1.98 Galaxy Cluster

Context. How protoclusters evolved from sparse galaxy overdensities to mature galaxy clusters is still not well understood. In this context, detecting and characterizing the hot intracluster medium (ICM) at high redshifts (z ∼ 2) is key to understanding how the continuous accretion from the filamentary large-scale structure and the mergers along it impact the first phases of cluster formation. Aims. We study the dynamical state and morphology of the z = 1:98 galaxy cluster XLSSC 122 with high-resolution observations (≈5″) of the ICM through the Sunyaev–Zeldovich (SZ) effect. XLSSC 122 is the highest redshift optically confirmed galaxy cluster found in an unbiased, widefield survey. Methods. Via Bayesian forward modeling, we mapped the ICM on scales from the virial radius down to the core of the cluster. To constrain such a broad range of spatial scales, we employed a new technique that jointly forward-models parametric descriptions of the pressure distribution to interferometric ACA and ALMA observations and multiband imaging data from ACT. Results. We detect the SZ effect with 11σ significance in the ALMA+ACA observations and find a flattened inner pressure profile that is consistent with a noncool core classification with a significance of ≥3σ. In contrast to the previous works, we find better agreement between the SZ effect signal and the X-ray emission as well as the cluster member distribution. Further, XLSSC 122 exhibits an excess of SZ flux in the south of the cluster where no X-ray emission is detected. By reconstructing the interferometric observations and modeling in the uv-plane, we obtain a tentative detection of an infalling group or filamentary-like structure in the southeast that is believed to boost and heat up the ICM while the density of the gas is still low. In addition to characterizing the dynamical state of the cluster, we provide an improved SZ mass estimate M500,c = 1.66−0.20+0.23 × 1014 M⊙ . Conclusions. Altogether, the observations indicate that we see XLSSC 122 in a dynamic phase of cluster formation while a large reservoir of gas is already thermalized.

large-scale structure of Universe↗

DOE OSTI2020

Big Data and AI at DoE's Legacy Sites - 20546

More than 30 years have passed since DOE started the decommissioning of nuclear weapon complexes and the clean-up of soil and groundwater. All the sites have been collecting and archiving soil and groundwater monitoring datasets; particularly contaminant concentration time-series. These datasets provide unparalleled opportunities to understand the system behavior (including more fundamental hydrological and geochemical processes, the response to various perturbations, the long-term trend and environmental decay rate towards the regulatory limit). This understanding is critical for providing multiple lines of evidences that can support site closure. In this study, we explore the machine learning (ML) and artificial intelligence (AI) applications to the long-term soil and groundwater management at DoE's legacy sites. ML can improve our understanding of the subsurface systems, which is critical for long-term monitoring and management of the sites, while AI can automate or support some of decision-making processes (e.g., anomaly detection, monitoring well placements). The particular focuses are to develop general algorithms to: (1) to identify distinct spatiotemporal patterns and to identify several groups that have similar temporal behaviors, using unsupervised clustering methods, (2) identify the different temporal scales of hydrological responses to climate perturbations by time-series analysis, and (3) reduce the number of monitoring wells by identifying the minimum sufficient number of wells to capture the heterogeneity of the groundwater contaminant plume and concentration distribution, using the Gaussian Process model. We demonstrate our methodology at the Savannah River Site F-Area. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2025

SEAFORML (Smart Exploration and Analysis For Optimal and Robust Machine Learning)

The poster discusses data analysis of the WAVgraph database and applied machine learning methods for it. The database is a long-term project that seeks to be a comprehensive repository of information on cyber threats and is updated regularly. It was previously unanalyzed and unexplored. The goal was to learn more about it and its contents in order to have a better understanding and enable better use. The data analysis and discovery enabled further exploration through natural language processing, similarity, and clustering methods. The poster shows some of the insights from the analysis and explains the methods used for the machine learning applications.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Synchronization and Rebound Effects in Residential Loads

Increasing fuel prices and capacity investment deferral place an increasing demand for peak reduction from distribution level systems. Residential and commercial devices, such as HVAC systems and water heaters, are increasingly involved in load control programs, and their use may generate synchronization and rebound effects, such as artificial peaks caused by device optimization. While there have been concerns over device synchronization, few studies quantify the extent of this effect with numerical values. In this study, we attempt to investigate whether control efforts result in device synchronization or rebound effects. We focus on three clustering methods – Ward’s clustering, Euclidean K-means, and Density-based spatial clustering of applications with noise – to evaluate the extent of synchronization of a fleet of water heaters and HVAC systems in Atlanta, Georgia. Our findings show that synchronization and rebound effects are present in the neighborhood’s water heaters, but none were found in the HVAC systems. Further, high usage water heaters are more susceptible to synchronization and rebound effects.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1998

Parallel Implicit Algorithms for CFD

The main goal of this project was efficient distributed parallel and workstation cluster implementations of Newton-Krylov-Schwarz (NKS) solvers for implicit Computational Fluid Dynamics (CFD.) "Newton" refers to a quadratically convergent nonlinear iteration using gradient information based on the true residual, "Krylov" to an inner linear iteration that accesses the Jacobian matrix only through highly parallelizable sparse matrix-vector products, and "Schwarz" to a domain decomposition form of preconditioning the inner Krylov iterations with primarily neighbor-only exchange of data between the processors. Prior experience has established that Newton-Krylov methods are competitive solvers in the CFD context and that Krylov-Schwarz methods port well to distributed memory computers. The combination of the techniques into Newton-Krylov-Schwarz was implemented on 2D and 3D unstructured Euler codes on the parallel testbeds that used to be at LaRC and on several other parallel computers operated by other agencies or made available by the vendors. Early implementations were made directly in Massively Parallel Integration (MPI) with parallel solvers we adapted from legacy NASA codes and enhanced for full NKS functionality. Later implementations were made in the framework of the PETSC library from Argonne National Laboratory, which now includes pseudo-transient continuation Newton-Krylov-Schwarz solver capability (as a result of demands we made upon PETSC during our early porting experiences). A secondary project pursued with funding from this contract was parallel implicit solvers in acoustics, specifically in the Helmholtz formulation. A 2D acoustic inverse problem has been solved in parallel within the PETSC framework.

Keyes, David E.↗

NASA NTRS2016

The XXL Survey I. Scientific Motivations - Xmm-Newton Observing Plan - Follow-up Observations and Simulation Programme

The quest for the cosmological parameters that describe our universe continues to motivate the scientific community to undertake very large survey initiatives across the electromagnetic spectrum. Over the past two decades, the Chandra and XMM-Newton observatories have supported numerous studies of X-ray-selected clusters of galaxies, active galactic nuclei (AGNs), and the X-ray background. The present paper is the first in a series reporting results of the XXL-XMM survey; it comes at a time when the Planck mission results are being finalized. Aims. We present the XXL Survey, the largest XMM programme totaling some 6.9 Ms to date and involving an international consortium of roughly 100 members. The XXL Survey covers two extragalactic areas of 25 deg2 each at a point-source sensitivity of approx. 5 x 10(exp 15) erg/s/sq cm in the [0.5-2] keV band (completeness limit). The surveys main goals are to provide constraints on the dark energy equation of state from the space-time-distribution of clusters of galaxies and to serve as a pathfinder for future, wide-area X-ray missions. We review science objectives, including cluster studies, AGN evolution, and large-scale structure, that are being conducted with the support of approximately 30 follow-up programs. Methods. We describe the 542 XMM observations along with the associated multi- and numerical simulation programmes. We give a detailed account of the X-ray processing steps and describe innovative tools being developed for the cosmological analysis. Results. The paper provides a thorough evaluation of the X-ray data, including quality controls, photon statistics, exposure and background maps, and sky coverage. Source catalogue construction and multi-associations are briefly described. This material will be the basis for the calculation of the cluster and AGN selection functions, critical elements of the cosmological and science analyses. Conclusions. The XXL multi- data set will have a unique lasting legacy value for cosmological and extragalactic studies and will serve asa calibration resource for future dark energy studies with clusters and other X-ray selected sources. With the present article, we release the XMM XXL photon and smoothed images along with the corresponding exposure maps.

X-rays: general â€“ large-scale structure of Unive↗

NASA NTRS1995

The coupling of fluids, dynamics, and controls on advanced architecture computers

This grant provided for the demonstration of coupled controls, body dynamics, and fluids computations in a workstation cluster environment; and an investigation of the impact of peer-peer communication on flow solver performance and robustness. The findings of these investigations were documented in the conference articles.The attached publication, 'Towards Distributed Fluids/Controls Simulations', documents the solution and scaling of the coupled Navier-Stokes, Euler rigid-body dynamics, and state feedback control equations for a two-dimensional canard-wing. The poor scaling shown was due to serialized grid connectivity computation and Ethernet bandwidth limits. The scaling of a peer-to-peer communication flow code on an IBM SP-2 was also shown. The scaling of the code on the switched fabric-linked nodes was good, with a 2.4 percent loss due to communication of intergrid boundary point information. The code performance on 30 worker nodes was 1.7 (mu)s/point/iteration, or a factor of three over a Cray C-90 head. The attached paper, 'Nonlinear Fluid Computations in a Distributed Environment', documents the effect of several computational rate enhancing methods on convergence. For the cases shown, the highest throughput was achieved using boundary updates at each step, with the manager process performing communication tasks only. Constrained domain decomposition of the implicit fluid equations did not degrade the convergence rate or final solution. The scaling of a coupled body/fluid dynamics problem on an Ethernet-linked cluster was also shown.

Atwood, Christopher↗

NASA NTRS2017

Structure in the 3D Galaxy Distribution: III. Fourier Transforming the Universe: Phase and Power Spectra

We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform (FFT) of finely binned galaxy positions. In both cases deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. The complex Fourier transform characterizes spatial distributional properties beyond the power spectrum in a manner different from (and we argue is more easily interpreted than) the conventional multi-point hierarchy. We identify some threads of modern large scale inference methodology that will presumably yield detections in new wider and deeper surveys.

Galactic clusters↗

DOE OSTI2021

Nucleon clustering at kinetic freezeout of heavy-ion collisions via path-integral Monte Carlo

Clustering of the four-nucleon system at kinetic freezeout conditions is studied using path-integral Monte Carlo techniques. This method seeks to improve upon previous calculations which relied on approximate semiclassical methods or few-body quantum mechanics. Estimates are given for the decay probabilities of the 4N system into various light nuclei decay channels and the strength of spatial correlations is characterized. Additionally, a simple model is presented to describe the impact of this clustering on nucleon multiplicity distributions. Additionally, the effects of a possible modification of the inter-nucleon interaction due to the close critical line (and hypothetical QCD critical point) on the clustering are also studied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Scale-up Unlearnable Examples Learning with High-performance Computing

Recent advancements in AI models, like ChatGPT, are structured to retain user interactions, which could inadvertently include sensitive healthcare data. In the healthcare field, particularly when radiologists use AI-driven diagnostic tools hosted on online platforms, there is a risk that medical imaging data may be repurposed for future AI training without explicit consent, spotlighting critical privacy and intellectual property concerns around healthcare data usage. Addressing these privacy challenges, a novel approach known as Unlearnable Examples (UEs) has been introduced, aiming to make data unlearnable to deep learning models. A prominent method within this area, called Unlearnable Clustering (UC), has shown improved UE performance with larger batch sizes but was previously limited by computational resources (e.g., a single workstation). To push the boundaries of UE performance with theoretically unlimited resources, we scaled up UC learning across various datasets using Distributed Data Parallel (DDP) training on the Summit supercomputer. Our goal was to examine UE efficacy at high-performance computing (HPC) levels to prevent unauthorized learning and enhance data security, particularly exploring the impact of batch size on UE’s unlearnability. Utilizing the robust computational capabilities of the Summit, extensive experiments were conducted on diverse datasets such as Pets, MedMNist, Flowers, and Flowers102. Our findings reveal that both overly large and overly small batch sizes can lead to performance instability and affect accuracy. However, the relationship between batch size and unlearnability varied across datasets, highlighting the necessity for tailored batch size strategies to achieve optimal data protection. The use of Summit’s high-performance GPUs, along with the efficiency of the DDP framework, facilitated rapid updates of model parameters and consistent training across nodes. Our results underscore the critical role of selecting appropriate batch sizes based on the specific characteristics of each dataset to prevent learning and ensure data security in deep learning applications. The source code is publicly available at https: // github. com/ hrlblab/ UE_ HPC .

Zhu, Yanfan [Vanderbilt University, Nashville, TN,↗

DOE OSTI2022

A Deep Reinforcement Learning-based Reserve Optimization in Active Distribution Systems for Tertiary Frequency Regulation

Federal Energy Regulatory Commission (FERC)Orders 841 and 2222 have recommended that distributed energy resources (DERs) should participate in energy and reserve markets; therefore, a mechanism needs to be developed to facilitate DERs’ participation at the distribution level. Although the available reserve from a single distribution system may not be sufficient for tertiary frequency regulation, stacked and coordinated contributions from several distribution systems can enable them participate in tertiary frequency regulation at scale. This paper proposes a deep reinforcement learning (DRL)-based approach for optimization of requested aggregated reserves by system operators among the clusters of DERs. The co-optimization of cost of reserve, distribution network loss, and voltage regulation of the feeders are considered while optimizing the reserves among participating DERs. The proposed framework adopts deep deterministic policy gradient (DDPG), which is an algorithm based on an actor-critic method. The effectiveness of the proposed method for allocating reserves among DERs is demonstrated through case studies on a modified IEEE 34-node distribution system.

deep reinforcement learning, distributed energy re↗

NASA NTRS1974

ERTS-1 imagery and native plant distributions

A method is developed for using ERTS spectral signature data to determine plant community distribution and phenology without resolving individual plants. An Exotech ERTS radiometer was used near ground level to obtain spectral signatures for a desert plant community, including two shrub species, ground covered with live annuals in April and dead ones in June, and bare ground. It is shown that comparisons of scene types can be made when spectral signatures are expressed as a ratio of red reflectivity to IR reflectivity or when they are plotted as red reflectivity vs. IR reflectivity, in which case the signature clusters of each component are more distinct. A method for correcting and converting the ERTS radiance values to reflectivity values for comparison with ground truth data is appended.

Musick, H. B.↗

NASA NTRS1985

Non-equilibrium phase distribution in an Al-SiC composite

The phase distribution in an Al-SiC composite has been investigated using high resolution analytical electron microscopy. Particular attention was focused on Al-SiC interfaces, matrix boundaries and impurity phases which would impede the easy glide of dislocations. Small crystallites of MgO were distributed singly and in clusters along Al-SiC interfaces in all specimens. Interfacial segregation and precipitation involving alloy species apparently affected precipitation in the matrix, where the distribution of phases was found to be very heterogeneous. Matrix phases also included unusually large constituent particles and dispersoids, a consequence of the composite processing methods. The relationship between the observed microstructure and the composite mechanical behavior reported by others is discussed. The heterogeneous distribution of matrix phases is expected to result in a wide variaiton in local yield stress and local work-hardening rate within the composite.

Nutt, S. R.↗

NASA NTRS1985

The missing bulge globular clusters in M31 - New optical candidates

A new method to attack the question of the 'missing' globular clusters in the bulge of M31 is used. Image-processing techniques were used on 13 videocamera fields to obtain an accurate photometric census of stellar objects in M31's bulge down to a limiting B magnitude of 21. This luminosity distribution is compared with the Bahcall-Soneira model of galactic foreground stars. A statistically significant excess of bright images in the luminosity range of globular clusters at M31's distance is found. If the optical candidates considered prove to be globular clusters, they would double the number of known globular clusters in the surveyed region. The colors of a subsample of the candidates are the same as those of the known globular clusters. It is concluded that the previously observed flattening away from a de Vaucouleurs law in the radial distribution of M31 may be an observational selection effect. As an offshoot of this analysis, no evidence is found for very luminous stars in the inner bulge of M31. The lack of such stars indicates that there has not been active star formation (with a normal IMF) in the recent past. Coupled with the existence of many planetary nebulae in the bulge, this may strengthen the case for a galactic wind in M31's bulge.

Wirth, A.↗

NASA NTRS1991

Unstructured and adaptive mesh generation for high Reynolds number viscous flows

A method for generating and adaptively refining a highly stretched unstructured mesh suitable for the computation of high-Reynolds-number viscous flows about arbitrary two-dimensional geometries was developed. The method is based on the Delaunay triangulation of a predetermined set of points and employs a local mapping in order to achieve the high stretching rates required in the boundary-layer and wake regions. The initial mesh-point distribution is determined in a geometry-adaptive manner which clusters points in regions of high curvature and sharp corners. Adaptive mesh refinement is achieved by adding new points in regions of large flow gradients, and locally retriangulating; thus, obviating the need for global mesh regeneration. Initial and adapted meshes about complex multi-element airfoil geometries are shown and compressible flow solutions are computed on these meshes.

Mavriplis, Dimitri J.↗

NASA NTRS1991

Unstructured and adaptive mesh generation for high Reynolds number viscous flows

Mavriplis, D. J.↗