Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

The Interannual Stability of Cumulative Frequency Distributions for Convective System Size and Intensity

The characteristics of convective system populations in West Africa and the western Pacific tropical cyclone basin were analyzed to investigate whether interannual variability in convective activity in tropical continental and oceanic environments is driven by variations in the number of events during the wet season or by favoring large and/or intense convective systems. Convective systems were defined from TRMM data as a cluster of pixels with an 85 GHz polarization-corrected brightness temperature below 255 K and with an area at least 64 km 2. The study database consisted of convective systems in West Africa from May Sep for 1998-2007 and in the western Pacific from May Nov 1998-2007. Annual cumulative frequency distributions for system minimum brightness temperature and system area were constructed for both regions. For both regions, there were no statistically significant differences among the annual curves for system minimum brightness temperature. There were two groups of system area curves, split by the TRMM altitude boost in 2001. Within each set, there was no statistically significant interannual variability. Sub-setting the database revealed some sensitivity in distribution shape to the size of the sampling area, length of sample period, and climate zone. From a regional perspective, the stability of the cumulative frequency distributions implied that the probability that a convective system would attain a particular size or intensity does not change interannually. Variability in the number of convective events appeared to be more important in determining whether a year is wetter or drier than normal.

Mohr, Karen I.↗
DOE OSTI2020

Reconstruction and uncertainty quantification of lattice Hamiltonian model parameters from observations of microscopic degrees of freedom

The emergence of scanning probe and electron beam imaging techniques has allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors, in turn, can be associated with local symmetry breaking phenomena, representing the stochastic manifestation of the underpinning generative physical model. In this work, we explore the reconstruction of exchange integrals in the Hamiltonian for a lattice model with two competing interactions from observations of microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. In contrast to other approaches, we specifically specify a loss function inherent to thermodynamic systems and utilize it to estimate uncertainty in simulated realizations of different models. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, and quantum systems once the local descriptors linked to the relevant physical behaviors are known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Scalable, In-situ Data Clustering Data Analysis for Extreme Scale Scientific Computing (Final Report)

The objective of this project is to address challenges in the design and development of scalable in-situ data clustering and analytics algorithms and software. Our goal is to develop parallel software consisting of a set of spatio-temporal data clustering and anomaly detection functions, both of which are very important for large-scale analysis and have wide applicability for in-situ runs as well as post-processing analysis. Our design principles for in-situ analysis consider the following: (1) identify parts of the computation can be done close to the data within the nodes, while it is still in memory; (2) extract analysis components can (and should) be performed in remote staging and analysis nodes; (3) develop error-bound approximation methods for applications tolerable for small errors; (4) identify the type of derived distributions and statistics, for spatio-temporal data, that can be kept locally in order to both accelerate computations and meet energy constraints in subsequent iterations and phases; (5) use a self-describing data format so that data can be consistent and understood among local storage (memory and SSDs) and at staging and analysis nodes, thereby providing portability and flexibility; (6) develop service-oriented functions that can schedule in-situ and post-hoc analysis tasks based on the dynamic requirements of applications. Our development focus is to produce the parallel data analysis software/library that will be scalable, reusable, extensible, and generic for applications in different disciplines. The software will be able to run in-situ with the simulations as well as post-hoc analysis. This approach will satisfy many synergistic requirements for data intensive applications executed on data coming from instruments and experiments. In particular, the proposed multilevel approach is directly applicable to perform design tradeoffs for running part of the algorithms near the instruments and the rest on remote (analysis) systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

ELG spectroscopic systematics analysis of the DESI Data Release 1

Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate (f goodz ) is the relative fraction of secure redshifts among all measurements. It depends on observing conditions, thus introduces non-cosmological variations to the LSS. We, therefore, develop the redshift failure weight (w zfail ) and a per-fibre correction (η zfail ) to mitigate these dependences. They have minor influences on the galaxy clustering. For ELGs with a secure redshift, there are two subtypes of systematics: 1) catastrophics (large) that only occur in a few samples; 2) redshift uncertainty (small) that exists for all samples. The catastrophics represent 0.26% of the total DR1 ELGs, composed of the confusion between [O ii] and sky residuals, double objects, total catastrophics and others. We simulate the realistic 0.26% catastrophics of DR1 ELGs, the hypothetical 1% catastrophics, and the truncation of the contaminated 1.31 < z < 1.33 in the A BACUS S UMMIT ELG mocks. Their P ℓ show non-negligible bias from the uncontaminated mocks. But their influences on the redshift space distortions (RSD) parameters are smaller than 0.2σ. The redshift uncertainty of DR1 ELGs is 8.5km s -1 with a Lorentzian profile. The code for implementing the catastrophics and redshift uncertainty on mocks can be found in https://github.com/Jiaxi-Yu/modelling_spectro_sys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Linear systematics mitigation in galaxy clustering in the Dark Energy Survey Year 1 Data

ABSTRACT We implement a linear model for mitigating the effect of observing conditions and other sources of contamination in galaxy clustering analyses. Our treatment improves upon the fiducial systematics treatment of the Dark Energy Survey (DES) Year 1 (Y1) cosmology analysis in four crucial ways. Specifically, our treatment (1) does not require decisions as to which observable systematics are significant and which are not, allowing for the possibility of multiple maps adding coherently to give rise to significant bias even if no single map leads to a significant bias by itself, (2) characterizes both the statistical and systematic uncertainty in our mitigation procedure, allowing us to propagate said uncertainties into the reported cosmological constraints, (3) explicitly exploits the full spatial structure of the galaxy density field to differentiate between cosmology-sourced and systematics-sourced fluctuations within the galaxy density field, and (4) is fully automated, and can therefore be trivially applied to any data set. The updated correlation function for the DES Y1 redMaGiC catalogue minimally impacts the cosmological posteriors from that analysis. Encouragingly, our analysis does improve the goodness-of-fit statistic of the DES Y1 3 × 2pt data set (Δχ2 = −6.5 with no additional parameters). This improvement is due in nearly equal parts to both the change in the correlation function and the added statistical and systematic uncertainties associated with our method. We expect the difference in mitigation techniques to become more important in future work as the size of cosmological data sets grows.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Perturbation theory models for LSST-era galaxy clustering: Tests with subpercent mock catalog measurements in Fourier and configuration space

Here, we analyze the clustering of galaxies using the z = 1.006 snapshot of the CosmoDC2 simulation, a high-fidelity synthetic galaxy catalog designed to validate analysis methods for the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). We present sub-percent measurements of the galaxy auto-correlation and galaxy-dark matter cross correlations in Fourier space and configuration space for a magnitude-limited galaxy sample. At these levels of precision, the statistical errors of the measurement are comparable to the systematic effects present in the simulation and measurement procedure; nevertheless, using a hybrid-PT model, we are able to model non-linear galaxy bias with 0.5% precision up to scales of k max = 0.5 h/Mpc and r min = 4 Mpc/h. While the linear bias parameter is measured with 0.01% precision, other bias parameters are determined with considerably weaker constraints and sometimes bimodal posterior distributions. We compare our fiducial model with lower dimensional models where the higher-order bias parameters are fixed at their co-evolution values and find that leaving these parameters free provides significant improvements in our ability to model small scale information. We also compare bias parameters for galaxy samples defined using different magnitude bands and find agreement between samples containing equal numbers of galaxies. Finally, we compare bias parameters between Fourier space and configuration space and find moderate to significant tension between the two approaches. Although our model is often unable to fit the CosmoDC2 galaxy samples within the 0.1% precision of our measurements, our results suggest that the hybrid-PT model used in this analysis is capable of modeling non-linear galaxy bias within the percent level precision needed for upcoming galaxy surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2009

The Interannual Stability of Cumulative Frequency Distributions for Convective System Size and Intensity

The characteristics of convective system populations in West Africa and the western Pacific tropical cyclone basin were analyzed to investigate whether interannual variability in convective activity in tropical continental and oceanic environments is driven by variations in the number of events during the wet season or by favoring large and/or intense convective systems. Convective systems were defined from Tropical Rainfall Measuring Mission (TRMM) data as a cluster of pixels with an 85-GHz polarization-corrected brightness temperature below 255 K and with an area of at least 64 square kilometers. The study database consisted of convective systems in West Africa from May to September 1998-2007, and in the western Pacific from May to November 1998-2007. Annual cumulative frequency distributions for system minimum brightness temperature and system area were constructed for both regions. For both regions, there were no statistically significant differences between the annual curves for system minimum brightness temperature. There were two groups of system area curves, split by the TRMM altitude boost in 2001. Within each set, there was no statistically significant interannual variability. Subsetting the database revealed some sensitivity in distribution shape to the size of the sampling area, the length of the sample period, and the climate zone. From a regional perspective, the stability of the cumulative frequency distributions implied that the probability that a convective system would attain a particular size or intensity does not change interannually. Variability in the number of convective events appeared to be more important in determining whether a year is either wetter or drier than normal.

Mohr, Karen I.↗
DOE OSTI2020

Fast Proton Transfer and Hydrogen Evolution Reactivity Mediated by [Co 13 C 2 (CO) 24 ] 4–

A common approach to speeding up proton transfer (PT) by molecular catalysts is manipulation of the secondary coordina-tion sphere with proton relays and these enhance overall reaction rates by orders of magnitude. In contrast, heterogenous electrocatalysts have band structures that promote facile PT concerted with electron transfer (ET), known as the Volmer mechanism. Here in this paper, we show that [Co 13 C 2 (CO) 24 ] 4– , containing multiple Co-Co bonds to statistically enhance observed rates of PT, promotes PT on the order of 2.3 × 10 9 M -1 s -1 which suggests a diffusion-limited rate. The fast ET and PT chemistry is at-tributed to the delocalized electronic structure of [Co 13 C 2 (CO) 24 ] 4– . Electrochemical characterization of [Co 13 C 2 (CO) 24 ] 4– in the presence and absence of protons reveals ET kinetics and diffusion behavior similar to other small clusters such as nano-materials and fullerenes.

08 HYDROGEN↗
DOE OSTI2020

CODEX clusters

Context: Large area catalogs of galaxy clusters constructed from ROSAT All-Sky Survey provide the basis for our knowledge of the population of clusters thanks to long-term multiwavelength efforts to follow up observations of these clusters. Aims: The advent of large area photometric surveys superseding previous, in-depth all-sky data allows us to revisit the construction of X-ray cluster catalogs, extending the study to lower cluster masses and higher redshifts and providing modeling of the selection function. Methods: We performed a wavelet detection of X-ray sources and made extensive simulations of the detection of clusters in the RASS data. We assigned an optical richness to each of the 24 788 detected X-ray sources in the 10 382 square degrees of the Baryon Oscillation Spectroscopic Survey area using red sequence cluster finder redMaPPer version 5.2 run on Sloan Digital Sky Survey photometry. We named this survey COnstrain Dark Energy with X-ray (CODEX) clusters. Results: We show that there is no obvious separation of sources on galaxy clusters and active galactic nuclei (AGN) based on the distribution of systems on their richness. This is a combination of an increasing number of galaxy groups and their selection via the identification of X-ray sources either by chance or by groups hosting an AGN. To clean the sample, we use a cut on the optical richness at the level corresponding to the 10% completeness of the survey and include it in the modeling of the cluster selection function. We present the X-ray catalog extending to a redshift of 0.6. Conclusions: The CODEX suvey is the first large area X-ray selected catalog of northern clusters reaching fluxes of 10 –13 ergs s –1 cm –2 . We provide modeling of the sample selection and discuss the redshift evolution of the high end of the X-ray luminosity function (XLF). Our results on z < 0.3 XLF agree with previous studies, while we provide new constraints on the 0.3 < z < 0.6 XLF. We find a lack of strong redshift evolution of the XLF, provide exact modeling of the effect of low number statistics and AGN contamination, and present the resulting constraints on the flat ΛCDM.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1987

Spectral characteristics and the extent of paleosols of the Palouse formation

Thematic mapping data was analyzed and verified by comparison to previously gathered transect samples and to aerial photographs. A bare-soil field with exposed paleosols characterized by slight enrichment of iron was investigated. Spectral relationships were first investigated statistically by creating a data set with DN values spatially matched as nearly as possible to field sample points. Chemical data for each point included organic carbon, free iron oxide, and amorphous iron content. The chemical data, DN values, and various band ratios were examined with the program package Statistix in order to find the combinations of reflectance data most likely to show a relationship which would dependably separate the exposed paleosols from the other soils. Cluster analysis and Fastclas classification procedures were applied to the most promising of the band ratio combinations.

Frazier, B. E.↗
DOE OSTI2025

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗
DOE OSTI2025

Delineating the Effects of Counterions on the Structural and Vibrational Properties of U(IV) Lindqvist Polyoxometalate Complexes

Herein we conducted a full investigation into the fundamental structural and vibrational properties of uranium(IV) Peacock−Weakley-type lacunary Lindqvist (W 10 ) polyoxometalate (POM) complexes. We recently demonstrated the importance of the secondary lattice elements in tuning the distortion of the D 4d symmetry in W 10 POM complexes, and here, we synthesized eight UW 10 complexes with different alkali metal counterions and evaluated how the composition and packing of counterion species affected complex structural and vibrational properties. Single-crystal X-ray diffraction analysis on complexes 1−8 revealed changes in structural distortion parameters as a function of differences in counterion configurations, while far-infrared and Raman spectra for 1−8 also demonstrated that vibrational mode frequencies were sensitive to changes in counterion composition and packing. To more effectively compare different counterion configurations, we developed counterion effective ionic radius (eIR) as a new structural parameter, and comparisons between structural distortion parameters and eIR values strongly suggested that modulation by the secondary lattice elements can affect structural and vibrational manifolds within POM complexes. Partial least squares (PLS) analysis was used to quantitatively evaluate correlations observed within this investigation, and PLS statistical models showed a strong correlation between counterion eIR and both structural distortion parameters and vibrational mode frequencies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Nonperturbatively renormalized nucleon gluon momentum fraction in the continuum limit of N f = 2 + 1 + 1 lattice QCD

We present the nonperturbatively renormalized nucleon gluon momentum fraction using ensembles with 2+1+1 flavors of highly improved staggered quarks (HISQ), generated by the MILC Collaboration. The calculation is done using clover fermions for the valence action with three pion masses, 220, 310, and 690 MeV, and three lattice spacings, 0.09, 0.12, and 0.15 fm. The renormalization is done using RI/MOM nonperturbative renormalization and using cluster-decomposition error reduction (CDER) to enhance the signal-to-noise ratio of the renormalization constant. We find the CDER technique is particularly important to improve the signal at the finer lattice ensembles where the lattice volume is larger. We extrapolate the gluon momentum fraction to the continuum-physical limit and obtain $\langle{x}\rangle$ g = 0.502⁢(53) stat+NPR ⁢(50) mixing in the $\overline{MS}$ scheme at 2 GeV, where first error includes the statistical error and uncertainties in nonperturbative renormalization, while the latter systematic error accounts for ignoring quark mixing. Our gluon momentum fraction is consistent with other recent lattice-QCD results at physical pion mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1994

Automatic generation of efficient orderings of events for scheduling applications

In scheduling a set of tasks, it is often not known with certainty how long a given event will take. We call this duration uncertainty. Duration uncertainty is a primary obstacle to the successful completion of a schedule. If a duration of one task is longer than expected, the remaining tasks are delayed. The delay may result in the abandonment of the schedule itself, a phenomenon known as schedule breakage. One response to schedule breakage is on-line, dynamic rescheduling. A more recent alternative is called proactive rescheduling. This method uses statistical data about the durations of events in order to anticipate the locations in the schedule where breakage is likely prior to the execution of the schedule. It generates alternative schedules at such sensitive points, which can be then applied by the scheduler at execution time, without the delay incurred by dynamic rescheduling. This paper proposes a technique for making proactive error management more effective. The technique is based on applying a similarity-based method of clustering to the problem of identifying similar events in a set of events.

Morris, Robert A.↗
NASA NTRS2006

Chandra Observation of NGC 6822

Chandra observed the nearby dwarf galaxy NGC 6822. There are 70 sources in the Chandra field, two of which are fairly extended and likely background clusters of galaxies. A third source was resolved by Chandra and has the same size and position as a known supernova remnant. The suspected variability detected from this source in previous missions is shown to be in error. The majority of the remaining 67 sources are consistent with background sources. Of the 61 sources detected above a completeness limit of 10 events we estimate that 9+/-4+/-8 are associated with the galaxy including both systematic and statistical errors. We compare the X-ray positions of all sources with various catalogs and HST data'and offer tentative identifications for several. Based on the mass and star formation rate of NGC 6822 we only expect about 10 sources mostly high mass systems.

Tennant, Allyn F.↗
DOE OSTI2022

Symmetry-specific orientational order parameters for complex structures

A comprehensive framework of characterizing complex self-assembled structures with a set of orientational order parameters is presented. It is especially relevant in the context of using anisotropic building blocks with various symmetries. Two classes of tensor order parameters are associated with polyhedral nematic and bond orientational order. For the latter, a variation of classical bond order parameters (BOPs) is introduced, which takes advantage of the symmetry of constituent particles and/or expected crystalline phases. These symmetrized BOPs can be averaged over an entire system or assigned locally to an individual bond. By combining that with the bond percolation procedure, one is able to identify coherent domains within a self-assembled structure. As a demonstration of the proposed framework, we apply it to a simulated hybrid system that combines isotropic and patchy particles with octahedral symmetry. In conclusion, not only does the methodology allow one to identify individual crystalline domains but also it detects coherent clusters of a peculiar compact amorphous structure that is not space-filling and lacks any long-range order.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Measuring cosmological distances using cluster edges as a standard ruler

ABSTRACT The line-of-sight velocity dispersion profile of galaxy clusters exhibits a ‘kink’ corresponding to the spatial extent of orbiting galaxies. Because the spatial extent of a cluster is correlated with the amplitude of the velocity dispersion profile, we can utilize this feature as a gravity-calibrated standard ruler. Specifically, the amplitude of the velocity dispersion data allows us to infer the physical cluster size. Consequently, observations of the angular scale of the ‘kink’ in the profile can be translated into a distance measurement to the cluster. Assuming the relation between cluster radius and cluster velocity dispersion can be calibrated from simulations, we forecast that with existing data from the Sloan Digital Sky Survey we will be able to measure the Hubble constant with 3.0 per cent precision. Implementing our method with data from the Dark Energy Spectroscopic Instrument (DESI) will result in a 1.3 per cent measurement of the Hubble constant. Adding cosmological supernova data improves the uncertainty of the DESI measurement to 0.7 per cent. While these error estimates are statistical only, they provide strong motivation for pursuing the necessary simulation program required to characterize and calibrate the systematic uncertainties impacting our proposed measurement. Whether or not our proposed measurement can in fact result in competitive H0 constraints will depend on what the eventual systematics floor for this method is.

79 ASTRONOMY AND ASTROPHYSICS↗