Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Normalizing flows for domain adaptation when identifying Λ hyperon events

Here this study focuses on the application of a normalizing flow as a method of domain adaptation when classifying physics data. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a novel method of transforming latent representations of physics data to a normal distribution and then to a physics distribution again. The final distribution models a simulated distribution. After being transformed, the data can be classified by a neural network trained on labeled simulation data. The present study succeeds in training two normalizing flows that can transform between data (or simulation) and a Gaussian distribution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Data–Driven Velocity Model Evaluation Using K–Means Clustering

In this work, we develop a data-driven clustering method to evaluate a velocity model using surface wave velocity dispersion. This is done by first computing theoretical dispersion curves for 1-D velocity profiles of all the grid locations and then splitting the resulting dispersion curves into a certain number of groups via the K-means clustering. The observed dispersion curves are also clustered following the same procedure and the velocity model is assessed by comparing the spatial patterns obtained for the observed and synthetic data sets. The method is applied to evaluate two community velocity models in southern California, CVM-S4.26 and CVM-H15.1, using phase velocity maps derived for 3–16 s Rayleigh waves. We found a good correlation in the spatial distribution of clusters between the result of CVM-S4.26 and that of the observed data, suggesting that the CVM-S4.26 fits the observed dispersion maps better than the CVM-H15.1 in terms of features extracted from the clustering analysis.

58 GEOSCIENCES↗
DOE OSTI2024

The SRG/eROSITA All-Sky Survey: Dark Energy Survey year 3 weak gravitational lensing by eRASS1 selected galaxy clusters

Context. Number counts of galaxy clusters across redshift are a powerful cosmological probe if a precise and accurate reconstruction of the underlying mass distribution is performed – a challenge called mass calibration. With the advent of wide and deep photometric surveys, weak gravitational lensing (WL) by clusters has become the method of choice for this measurement. Aims. We measured and validated the WL signature in the shape of galaxies observed in the first three years of the Dark Energy Survey (DES Y3) caused by galaxy clusters and groups selected in the first all-sky survey performed by SRG (Spectrum Roentgen Gamma)/eROSITA (eRASS1). These data were then used to determine the scaling between the X-ray photon count rate of the clusters and their halo mass and redshift. Methods. We empirically determined the degree of cluster member contamination in our background source sample. The individual cluster shear profiles were then analyzed with a Bayesian population model that self-consistently accounts for the lens sample selection and contamination and includes marginalization over a host of instrumental and astrophysical systematics. To quantify the accuracy of the mass extraction of that model, we performed mass measurements on mock cluster catalogs with realistic synthetic shear profiles. This allowed us to establish that hydrodynamical modeling uncertainties at low lens redshifts (z < 0.6) are the dominant systematic limitation. At high lens redshift, the uncertainties of the sources’ photometric redshift calibration dominate. Results. With regard to the X-ray count rate to halo mass relation, we determined its amplitude, its mass trend, the redshift evolution of the mass trend, the deviation from self-similar redshift evolution, and the intrinsic scatter around this relation. Conclusions. The mass calibration analysis performed here sets the stage for a joint analysis with the number counts of eRASS1 clusters to constrain a host of cosmological parameters. We demonstrate that WL mass calibration of galaxy clusters can be performed successfully with source galaxies whose calibration was performed primarily for cosmic shear experiments, opening the way for the cluster cosmological exploitation of future optical and NIR surveys like Euclid and LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Lowest-energy broad 𝛼-cluster resonances in 19 F

There is strong astrophysical interest in the structure of 19 F states near the α-decay threshold, as their properties are important for understanding the development of α clustering in the 20 Ne region. The emergence of clustered states, and more generally of states that couple strongly to reaction channels near their decay thresholds, is also a topic of current interest in theoretical nuclear physics. In this work, we determine the parameters of broad low-spin states in 19 F near the α-decay threshold and present a theoretical study of these states. The analysis is restricted to ℓ = 0 and 1 resonances in the α + 15 N system close to the α threshold in 19 F. Excitation functions for 15 N(α,α) elastic scattering were measured using the Thick Target Inverse Kinematics (TTIK) method, and these new data, together with older high–energy-resolution measurements, were analyzed within the R-matrix framework. The nuclear structure of 19 F was calculated using configuration-interaction methods with a recently developed effective interaction Hamiltonian. As a result, we identify a sequence of α-cluster resonances in 19 F and map the distribution of clustering strength, which is relevant for astrophysical reaction modeling and for the theoretical understanding of many-body dynamics and the emergence of clustering in loosely bound or unstable nuclei. Furthermore, the work advances theoretical insight into the origins of clustering and highlights open questions for future theoretical and experimental studies.

19F↗
NASA NTRS1989

NASA-UVA light aerospace alloy and structures technology program

The report on progress achieved in accomplishing of the NASA-UVA Light Aerospace Alloy and Structures Technology Program is presented. The objective is to conduct interdisciplinary graduate student research on the performance of next generation, light weight aerospace alloys and associated thermal gradient structures in close collaboration with researchers. The efforts will produce basic understanding of material behavior, new monolithic and composite alloys, processing methods, solid and fluid mechanics analyses, measurement advances, and a pool of educated graduate students. The presented accomplishments include: research on corrosion fatigue of Al-Li-Cu alloy 2090; research on the strengthening effect of small In additions to Al-Li-Cu alloys; research on localized corrosion of Al-Li alloys; research on stress corrosion cracking of Al-Li-Cu alloys; research on fiber-matrix reaction studies (Ti-1100 and Ti-15-3 matrices containing SCS-6, SCS-9, and SCS-10 fibers); and research on methods for quantifying non-random particle distribution in materials that has led to generation of a set of computer programs that can detect and characterize clusters in particles.

Gangloff, Richard P.↗
NASA NTRS2016

Spaceborne Remote Sensing of Aerosol Type: Global Distribution, Model Evaluation and Translation into Chemical Speciation

It is essential to evaluate and refine aerosol classification methods applied to passive satellite remote sensing. We have developed an aerosol classification algorithm (called Specified Clustering and Mahalanobis Classification, SCMC) that assigns an aerosol type to multi-parameter retrievals by spaceborne, airborne or ground-based passive remote sensing instruments [1]. The aerosol types identified by our scheme are pure dust, polluted dust, urban-industrialdeveloped economy, urban-industrialdeveloping economy, dark biomass smoke, light biomass smoke and pure marine. We apply the SCMC method to inversions from the ground-based AErosol RObotic NETwork (AERONET [2]) and retrievals from the space-borne Polarization and Directionality of Earths Reflectances instrument (POLDER, [3]). The POLDER retrievals that we use differ from the standard POLDER retrievals [4] as they make full use of multi-angle, multispectral polarimetric data [5]. We analyze agreement in the aerosol types inferred from both AERONET and POLDER and evaluate GEOS-Chem [6] simulations over the globe. Finally, we use in-situ observations from the SEAC4RS airborne field experiment to bridge the gap between remote sensing-inferred qualitative SCMC aerosol types and their corresponding quantitative chemical speciation. We apply the SCMC method to airborne in-situ observations from the NASA Langley Aerosol Research Group Experiment (LARGE, [7]) and the Differential Aerosol Sizing and Hygroscopicity Spectrometer Probe (DASH-SP, [8]) instruments; we then relate each coarsely defined SCMC type to a sum of percentage of individual aerosol species, using in-situ observations from the Particle Analysis by Laser Mass Spectrometry (PALMS, [9]), the Soluble Acidic Gases and Aerosol (SAGA, [10]), and the High - Resolution Time - of - Flight Aerosol Mass Spectrometer (HR ToF AMS, [11]).

airborne↗
DOE OSTI2020

A machine learning study on spinodal clumping in heavy ion collisions

Possible observables of baryon number clustering due to the instabilities occurring at a first order QCD phase transition are discussed. The dynamical formation of baryon clusters at a QCD phase transition can be described by numerical fluid dynamics, augmented with a gradient term and an equation of state with a mechanically unstable region. It is shown that the dynamical description of this phase transition, in nuclear collisions, will lead to the formation of dense baryon clusters at the phase boundary. State-of-the-art machine learning methods find that the coordinate space clumping leaves characteristic imprints on the spatial net density distribution in almost every event. On the other hand the momentum distributions do not show any clear event-by-event features. Lastly, it is shown that the 'third order' cumulant, the skewness, shows a peak at the beam energy where the system, created in the heavy ion collision, reaches the deconfinement phase transition.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2011

NASA Instrument Cost/Schedule Model

NASA's Office of Independent Program and Cost Evaluation (IPCE) has established a number of initiatives to improve its cost and schedule estimating capabilities. 12One of these initiatives has resulted in the JPL developed NASA Instrument Cost Model. NICM is a cost and schedule estimator that contains: A system level cost estimation tool; a subsystem level cost estimation tool; a database of cost and technical parameters of over 140 previously flown remote sensing and in-situ instruments; a schedule estimator; a set of rules to estimate cost and schedule by life cycle phases (B/C/D); and a novel tool for developing joint probability distributions for cost and schedule risk (Joint Confidence Level (JCL)). This paper describes the development and use of NICM, including the data normalization processes, data mining methods (cluster analysis, principal components analysis, regression analysis and bootstrap cross validation), the estimating equations themselves and a demonstration of the NICM tool suite.

JCL↗
DOE OSTI2020

TeraChem Cloud: A High-Performance Computing Service for Scalable Distributed GPU-Accelerated Electronic Structure Calculations

The encapsulation and commoditization of electronic structure arise naturally as interoperability, and the use of nontraditional compute resources (e.g., new hardware accelerators, cloud computing) remains important for the computational chemistry community. Here, we present TERACHEM CLOUD, a high-performance computing service (HPCS) that offers on-demand electronic structure calculations on both traditional HPC clusters and cloud-based hardware. The framework is designed using off-the-shelf web technologies and containerization to be extremely scalable and portable. Within the HPCS model, users can quickly develop new methods and algorithms in an interactive environment on their laptop while allowing TERACHEM CLOUD to distribute ab initio calculations across all available resources. This approach greatly increases the accessibility of hardware accelerators such as graphics processing units (GPUs) and flexibility for the development of new methods as additional electronic structure packages are integrated into the framework as alternative backends. Cost-performance analysis indicates that traditional nodes are the most cost-effective long-term solution, but commercial cloud providers offer cutting-edge hardware with competitive rates for short-term large-scale calculations. We demonstrate the power of the TERACHEM CLOUD framework by carrying out several showcase calculations, including the generation of 300,000 density functional theory energy and gradient evaluations on medium-sized organic molecules and reproducing 300 fs of nonadiabatic dynamics on the B800-B850 antenna complex in LH2, with the latter demonstration using over 50 Tesla V100 GPUs in a commercial cloud environment in 8 h for approximately $1250.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Efficient Network Partitioning: Application for Decentralized State Estimation in Power Distribution Grids

Increase in the proliferation of distributed energy resources require real-time situational awareness for efficient grid operations. State estimation plays an important role for the real-time control and management of the power grid. As the sensing infrastructure grows, aggregating and handling high volumes of data at a centralized location is extremely difficult. To address this challenge, this paper first proposes a novel and efficient hier-archical spectral clustering-based network partitioning algorithm followed by a decentralized compressive sensing (DCS)-based state estimation. The applicability of the proposed network partitioning algorithm is tested on an IEEE 123-bus network, an IEEE 8,500-node system, and a 6,000+ node distribution network. The results shows that the proposed approach efficiently divides the network into multiple sub-networks with the minimum number of edge connections among the neighbors. Then, we perform DCS-based state estimation on the 6,000+ node distribution network after dividing the network into 18 optimal partitions. Simulation results show that the DCS-based state estimation recovers the system states with high accuracy and low complexity.

alternating direction method of multipliers↗
DOE OSTI2020

Bus Clustering for Distribution Grid Topology Identification

Recovering the distribution grid topology is essential to perform several distribution system operator functions. Many algorithms that address the topology recovery problem have already been proposed in the literature. Most are based on a priori information regarding which buses are fed by which substation; however, this information might not be available because frequent grid reconfigurations change the distribution grid portion connected to each substation. This paper addresses the problem of assigning every substation the set of buses that it is feeding, given field data. First, the aforementioned task is cast as a nonconvex optimization problem. Second, a relaxed version of the optimization problem is solved via the alternating direction method of multipliers. Finally, the performance of our approach is validated through numerical simulations of realistic scenarios using a standard IEEE benchmark feeder.

bus clustering↗
DOE OSTI2022

The eROSITA Final Equatorial-Depth Survey (eFEDS)

In 2019, the eROSITA telescope on board the Russian-German satellite Spectrum-Roentgen-Gamma (SRG) began to perform a deep all-sky X-ray survey with the aim of identifying ~100 000 clusters and groups over the course of four years. As part of its performance verification phase, a ~140 deg 2 survey, called eROSITA Final Equatorial-Depth Survey (eFEDS), was performed. With a depth typical of the all-sky survey after four years, it allows tests of tools and methods as well as improved predictions for the all-sky survey. As part of this effort, a catalog of 542 X-ray selected galaxy group and cluster candidates was compiled. Here, in this paper, we present the optical follow-up, with the aim of providing redshifts and cluster confirmation for the full sample. Furthermore, we aim to provide additional information on the dynamical state, richness, and optical center of the clusters. Finally, we aim to evaluate the impact of optical cluster confirmation on the purity and completeness of the X-ray selected sample. We used optical imaging data from the Hyper Suprime-Cam Subaru Strategic Program and from the Legacy Survey to identify optical counterparts to the X-ray detected cluster candidates. We make use of the multi-component matched filter cluster confirmation tool (MCMF), as well as of the optical cluster finder CAMIRA to derive cluster redshifts and richnesses. MCMF provided the probabilities with which an optical structure would be a chance superposition with the X-ray candidate. These probabilities were used to identify the best optical counterpart as well as to confirm an X-ray candidate as a cluster. The impact of this confirmation process on catalog purity and completeness was estimated using optical to X-ray scaling relations as well as simulations. The resulting catalog was furthermore matched with public group and cluster catalogs. Optical estimators of the cluster dynamical state were constructed based on density maps of the red-sequence galaxies at the cluster redshift. By providing redshift estimates for all 542 candidates, we construct an optically confirmed sample of 477 clusters and groups with a residual contamination of 6%. Of these, 470 (98.5%) are confirmed using MCMF, and 7 systems are added through cross-matching with spectroscopic group catalogs. Using observable-to-observable scaling and the applied confirmation threshold, we predict that 8 ± 2 real systems have been excluded with the MCMF cut required to build this low-contamination sample. This number agrees well with the 7 systems found through cross-matching that were not confirmed with MCMF. The predicted redshift and mass distribution of this catalog agree well with simulations. Thus, we expect that these 477 systems include >99% of all true clusters in the candidate list. Using an MCMF-independent method, we confirm that the catalog contamination of the confirmed subsample is 6 ± 3%. Application of the same method to the full candidate list yields 17 ± 3%, consistent with estimates coming from the fraction of confirmed systems of ~17% and with expectations from simulations of ~20%. We also present a sample of merging cluster candidates based on the derived estimators of the cluster dynamical state.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Utah FORGE Project 3-2417: DAS Microseismic Event Catalog from the 16A/16B Circulation Test, 2023

This preliminary data archive includes the relocated microseismic event catalog, 1D velocity model, and methods report from DAS acquisition conducted during the Well 16A and 16B circulation test (July 19th and 20th, 2023) at Utah FORGE. The methods report describes all processing steps, including real-time event detection, hierarchical clustering, joint velocity/hypocenter inversion, and relocation. The resulting work is accepted and will be presented at IMAGE 2024. This dataset was acquired by the FOGMORE R&D project (Fiber Optic MOnitoring for Reservoir Evolution), Utah FORGE R&D Project 3-2417.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative data sets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student t process regression. We apply Student t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via colouring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics and classic machine learning clustering algorithms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

The persistence of large scale structures. Part I. Primordial non-Gaussianity

Abstract We develop an analysis pipeline for characterizing the topology of large scale structure and extracting cosmological constraints based on persistent homology . Persistent homology is a technique from topological data analysis that quantifies the multiscale topology of a data set, in our context unifying the contributions of clusters, filament loops, and cosmic voids to cosmological constraints. We describe how this method captures the imprint of primordial local non-Gaussianity on the late-time distribution of dark matter halos, using a set of N-body simulations as a proxy for real data analysis. For our best single statistic, running the pipeline on several cubic volumes of size 40 (Gpc/h) 3 , we detect f NL loc =10 at 97.5% confidence on ~ 85% of the volumes. Additionally wetest our ability to resolve degeneracies betweenthe topological signature of f NL loc and variation of σ 8 and argue that correctly identifying nonzero f NL loc in this case is possible via an optimal template method. Our method relies on information living at $\mathcal{O}$(10) Mpc/h, a complementary scale with respect to commonly used methods such as the scale-dependent bias in the halo/galaxy power spectrum. Therefore, while still requiring a large volume, our method does not require sampling long-wavelength modes to constrain primordial non-Gaussianity. Moreover, our statistics are interpretable: we are able to reproduce previous results in certain limits and we make new predictions for unexplored observables, such as filament loops formed by dark matter halos in a simulation box.

Astronomy & Astrophysics↗
DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1979

A cosmological redshift-distance square law

This paper directly examines the claims of Segal (1976) that the (m,z) Hubble diagram is fitted best by a square law z = Kr-squared rather than by the traditional Hubble law z = Hr in the low-redshift range, z no more than about 0.01, corresponding to galaxies brighter than 14th mag. Segal attempts to fit a distance relation to the (m,z) scatter diagram in which each individual galaxy is plotted. The exact relation between the mean redshift for all galaxies in a small magnitude interval and the apparent magnitude is calculated. This relation is independent of luminosity function and peculiar velocity distribution about the general expansion, and is not affected by sample incompleteness as a function of apparent magnitude or the clustering of galaxies in the sample. Segal's method is affected by all of these and requires a highly sophisticated statistical analysis to deal with the non-Gaussian pointwise scatter. The present analysis favors the Hubble law and conclusively rules out the square law for the small redshift region.

Soneira, R. M.↗
NASA NTRS1992

Would a Galactic bar destroy the globular cluster system?

Five different dynamical Galaxy models are presented for the Galactic potential which satisfy the observed rotation curve but contain a central bar so that the 3-kpc nonintersecting streamlines have a radial velocity of 50 km/s when viewed at 45 deg to the bar axis. The effect of the central bars on the destruction rates of globular clusters in the Galaxy is investigated. The method of Aguilar et al. (1988) is applied to these barred Galaxy models. The unknown tangential velocity components of each observed cluster are drawn randomly from an assumed distribution function. The cluster's orbit is integrated, and the bulge shocking rate is calculated. The median destruction rate of the cluster is computed by sampling a large number of such orbits. The addition of the rotating bar does not strongly affect the destruction rates of globular clusters. There is a small increase in the destruction rate for those clusters within about 2.5 kpc. Thus it is not possible to rule out the existence of a rotating bar on these grounds.

Long, Kevin↗