SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Stringent σ8 constraints from small-scale galaxy clustering using a hybrid MCMC + emulator framework

ABSTRACT We present a novel simulation-based hybrid emulator approach that maximally derives cosmological and Halo Occupation Distribution (HOD) information from non-linear galaxy clustering, with sufficient precision for DESI Year 1 (Y1) analysis. Our hybrid approach first samples the HOD space on a fixed cosmological simulation grid to constrain the high-likelihood region of cosmology + HOD parameter space, and then constructs the emulator within this constrained region. This approach significantly reduces the parameter volume emulated over, thus achieving much smaller emulator errors with fixed number of training points. We demonstrate that this combined with state-of-the-art simulations result in tight emulator errors comparable to expected DESI Y1 LRG sample variance. We leverage the new abacussummit simulations and apply our hybrid approach to CMASS non-linear galaxy clustering data. We infer constraints on σ8 = 0.762 ± 0.024 and fσ8(zeff = 0.52) = 0.444 ± 0.016, the tightest among contemporary galaxy clustering studies. We also demonstrate that our fσ8 constraint is robust against secondary biases and other HOD model choices, a critical first step towards showcasing the robust cosmology information accessible in non-linear scales. We speculate that the additional statistical power of DESI Y1 should tighten the growth rate constraints by at least another 50–60 ${{\ \rm per\ cent}}$, significantly elucidating any potential tension with Planck. We also address the ‘lensing is low’ tension, which we find to be in the same direction as a potential tension in fσ8. We show that the combined effect of a lower fσ8 and environment-based bias accounts for approximately $50{{\ \rm per\ cent}}$ of the discrepancy.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1987

Evaluation of several classification schemes for mapping forest cover types in Michigan

Landsat MSS data were evaluated for mapping forest cover types in the northern Lower Peninsula of Michigan. The study examined seasonal variations, interpretation procedures and vegetation composition/distribution and their effect on overall classification accuracy and ability to identify individual pine species. Photographic images were used for visual interpretations while digital analysis was performed using a common (ERDAS) microcomputer image processing system. The classification schemes were evaluated using contingency tables and were ranked using the KAPPA statistic. The various classification schemes were ranked differentially according to study site location. Visual interpretation procedures ranked best, or least accurate, depending on the spatial distribution and complexity of the forest cover. Supervised classification techniques were more accurate than unsupervised clustering over all sites and seasons. Maximum likelihood classification of June data was superior to any digital classification technique of February data. The study indicates that classification accuracy is more dependent on the composition and distribution of forests in the northern lower Peninsula of Michigan than on the selection of a particular classification scheme.

Hudson, W. D.↗

NASA NTRS1989

Comment on 'Distribution of whistler mode bursts at Venus' by F.L. Scarf, K.F. Jordan, and C.T. Russell

Consideration is given to the study of the 100-Hz electric field noise observed from the Pioneer Venus Orbiter (PVO) by Scarf et al. (1987). It is suggested that the study incorrectly interprets the results as evidence for lightning and volcanism at Venus. Statistical evidence is presented, suggesting that the distribution of the noise is essentially random, within the zone of occurrence of ion troughs, and decreases at the lowest PVO altitudes, closest to the neutral atmosphere. It is found that the topographic clustering reported by Scarf et al. is an artifact of the variable spatial distribution of troughs and associated noise.

Taylor, Harry A., Jr.↗

DOE OSTI2020

Machine Learning Approaches for Nuclear Material Accounting Data from Irradiation and Reprocessing

We are currently exploring data analysis methods for their ability to strengthen the synthesis and evaluation of information generated within domestic and international safeguard regimes. Safeguard data typically includes rich heterogenous datasets amenable to advanced data analytics methods, such as machine learning. We have converted transactional data containing both numerical and categorical attributes from a domestic nuclear material control and accountability (NMC&A) system into a low-dimensional numerical structure via linear principal component analysis. This data representation allows for global structure discovery via cluster analysis, which can characterize the typical behavior of each of the primary types of transaction events. Furthermore, the structure of the top principal components captures the “typical behavior” of the data and is thus amenable to anomaly detection through statistical hypothesis testing. We explored this capability by generating erroneous permutations of the data and computing the Q-residual quantity increase associated with the information loss when these data are projected into the low-dimensional principal component analysis space representative of typical transactions.Future work will focus on identifying data transformations (e.g., graph networks) that more closely align with the inherent structure of these transactions to explain more salient information and disambiguate the underlying nuclear process—in this case, irradiation and reprocessing—from artifacts of NMC&A system transactional record keeping data.

Drescher, Adam↗

DOE OSTI2025

A statistical and simulation-informed model for estimating permeability from pore size distribution in saturated geomaterials

Accurate permeability estimation is essential across subsurface engineering applications but remains challenging due to the complex pore structures of natural geomaterials. Traditional empirical methods and simplified theoretical models often inadequately capture the role of pore size distribution and connectivity. Here, this study develops a statistical and simulation-informed permeability model that collapses pore-scale complexity into a compact scaling of the form k = αϕμ d 2 , where ϕ is porosity, μ d is mean pore size, and α is a weakly varying coefficient. By combining pore network simulations with statistical analysis of unimodal and bimodal pore size distributions, we identify three key findings: (i) permeability is much more sensitive to mean pore size than to porosity; (ii) across extensive datasets, the ratio σ d /μ d (standard deviation to mean) clusters around a characteristic value ∼0.4, allowing the effects of the full pore size distribution to be represented by μ d and a narrowly varying α ≈ 0.05; and (iii) for bimodal systems, there exists a critical fraction of small pores ∼0.78 above which flow becomes small-pore dominated, enabling the definition of an effective flow-controlling pore population and facilitating simplified permeability estimation for such systems. The resulting model, which requires only porosity and a representative mean pore size as inputs, is validated against comprehensive experimental datasets (>1700 samples) spanning diverse soils and rocks and achieves good predictive accuracy. Overall, this work provides a physically grounded yet practically simple permeability estimator suitable for subsurface engineering, environmental protection, and resource management applications.

Permeability↗

DOE OSTI2021

Galaxy–galaxy lensing with the DES-CMASS catalogue: measurement and constraints on the galaxy-matter cross-correlation

ABSTRACT The DMASS sample is a photometric sample from the DES Year 1 data set designed to replicate the properties of the CMASS sample from BOSS, in support of a joint analysis of DES and BOSS beyond the small overlapping area. In this paper, we present the measurement of galaxy–galaxy lensing using the DMASS sample as gravitational lenses in the DES Y1 imaging data. We test a number of potential systematics that can bias the galaxy–galaxy lensing signal, including those from shear estimation, photometric redshifts, and observing conditions. After careful systematic tests, we obtain a highly significant detection of the galaxy–galaxy lensing signal, with total S/N = 25.7. With the measured signal, we assess the feasibility of using DMASS as gravitational lenses equivalent to CMASS, by estimating the galaxy-matter cross-correlation coefficient rcc. By jointly fitting the galaxy–galaxy lensing measurement with the galaxy clustering measurement from CMASS, we obtain $r_{\rm cc}=1.09^{+0.12}_{-0.11}$ for the scale cut of $4 \, h^{-1}{\rm \,\,Mpc}$ and $r_{\rm cc}=1.06^{+0.13}_{-0.12}$ for $12 \, h^{-1}{\rm \,\,Mpc}$ in fixed cosmology. By adding the angular galaxy clustering of DMASS, we obtain rcc = 1.06 ± 0.10 for the scale cut of $4 \, h^{-1}{\rm \,\,Mpc}$ and rcc = 1.03 ± 0.11 for $12 \, h^{-1}{\rm \,\,Mpc}$. The resulting values of rcc indicate that the lensing signal of DMASS is statistically consistent with the one that would have been measured if CMASS had populated the DES region within the given statistical uncertainty. The measurement of galaxy–galaxy lensing presented in this paper will serve as part of the data vector for the forthcoming cosmology analysis in preparation.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Dark Energy Survey Year 3 results: Measurement of the baryon acoustic oscillations with three-dimensional clustering

The three-dimensional correlation function offers an effective way to summarize the correlation of the large-scale structure even for imaging galaxy surveys. We have applied the projected three-dimensional correlation function, ξ p to measure the baryonic acoustic oscillations (BAO) scale on the first-three years Dark Energy Survey data. The sample consists of about 7 million galaxies in the redshift range 0.6< z p < 1.1 over a footprint of 4108 deg 2 . Our theory modeling includes the impact of realistic true redshift distributions beyond Gaussian photo-z approximation. ξ p is obtained by projecting the three-dimensional correlation to the transverse direction. To increase the signal-to-noise of the measurements, we have considered a Gaussian stacking window function in place of the commonly used top-hat. ξ p is sensitive to D M (z eff )/r s , the ratio between the comoving angular diameter distance and the sound horizon. Using the full sample, D M (z eff )/r s is constrained to be19.00 ± 0.67 (top-hat) and 19.15 ± 0.58 (Gaussian) at z eff = 0.835. The constraint is weaker than the angular correlation w constraint 18.84 ± 0.50), and we trace this to the fact that the BAO signals are heterogeneous across redshift. While ξ p responds to the heterogeneous signals by enlarging the error bar, w can still give a tight bound on D M s in this case. When a homogeneous BAO-signal subsample in the range 0.7 < z p <1.0 (z eff = 0.845) is considered, ξp yields 19.80 ± 0.67 (top-hat) and 19.84 ± 0.53 (Gaussian). The latter is mildly stronger than the w constraint (19.86 ± 0.55). We find that the ξ p results are more sensitive to photo-z because ξ p keeps the three-dimensional clustering information causing it to be more prone to photo-z noise. The Gaussian window gives more robust results than the top-hat as the former is designed to suppress the low signal modes. ξ p and the angular statistics such as w have their own pros and cons, and they serve an important crosscheck with each other.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1980

Numerical trials of HISSE

The mathematical description and implementation of the statistical estimation procedure known as the Houston integrated spatial/spectral estimator (HISSE) is discussed. HISSE is based on a normal mixture model and is designed to take advantage of spectral and spatial information of LANDSAT data pixels, utilizing the initial classification and clustering information provided by the AMOEBA algorithm. The HISSE calculates parametric estimates of class proportions which reduce the error inherent in estimates derived from typical classify and count procedures common to nonparametric clustering algorithms. It also singles out spatial groupings of pixels which are most suitable for labeling classes. These calculations are designed to aid the analyst/interpreter in labeling patches with a crop class label. Finally, HISSE's initial performance on an actual LANDSAT agricultural ground truth data set is reported.

Peters, C.↗

NASA NTRS1980

Analysis of SETI data collected in the parasitic mode

A system for performing SETI observations continuously as part of non-SETI observations at a radio observatory is presented, and the analysis of results obtained by the parasitic system is discussed. The system, designated SERENDIP, is a real-time microprocessor-controlled spectrum analyzer with algorithms for performing statistical operations and recording those spectra with characteristics presumed to be typical of intelligent rather than astrophysical origin. Programs also exist for the post-acquisition analysis of signal autocorrelation, power spectra, time behavior and positional coordinates, and for a generalized cluster analysis to detect clusters of signal detections. In a recent run of 35 days, the SERENDIP system detected 4000 narrowband spectra exceeding a preset threshold, of which 98% were determined to be of instrumental origin. The remaining class of detections is also believed to be instrumental, although not as well organized as the first signals, and means are currently being sought for eliminating them.

Bowyer, S.↗

NASA NTRSDate not supplied

ASCoT 3: Nonlinear Principal Components Analysis and Uncertainty Quantification in Early Concept Spacecraft Flight Software Cost Estimation

For mission planners and evaluators alike, value in cost models comes from a mean or median prediction, an understanding of the uncertainty on that prediction, and an understanding of model performance. Here we apply advanced statistical and machine learning methods to spacecraft flight software cost, effort, and SLOC estimation, and present the results in the latest version of the Analogy Software Cost Tool (ASCoT). We present in- and out-of-sample performance metrics for our models, each of which incorporate some amount of epistemic uncertainty. ASCoT, hosted on the One NASA Cost Engineering (ONCE) database via the Online NASA Space Estimation Tool (ONSET), was first showcased in 2016 as a number of analogy-based models and methods (kNN and Clustering) to support early project formulation. This ASCoT update improves upon the previous analogic methods by incorporating uncertainty in the data transformations. In particular, we use a Nonlinear Principal Components Analysis (NLPCA) to deal with ordinal data.

Robotic Spacecraft↗

DOE OSTI2023

Microstructure modeling of nuclear structural materials: Recent progress and future directions

Modeling and simulation of microstructures are essential to understand the complex responses and behaviors of nuclear materials in extreme environments. The needs to assess the extended life operation as well as the growing interest in accelerating nuclear materials development and qualification have stimulated the use of high-fidelity multiscale models aided by empirical and ab initio data. This paper reviews the role of various models across different length and time scales in investigating irradiation effects on microstructure evolution and degradation, in particular the embrittlement caused by radiation induced or enhanced formation of nanoscale chemical heterogeneities. The strength and limitations of these models, including classical rate theories, cluster dynamics, phase-field methods, and atomistic models informed by ab initio energies, are discussed with seminal examples. Challenges regarding the lack of thermo-kinetic data and theoretical treatments considering chemical complexities and magnetic excitations, as well as the stabilizing effect by excess point defects in nuclear structural materials are presented, along with potential solutions based on ab initio informed surrogate energy models and statistical sampling by Monte Carlo simulations. Further, the review then highlights the opportunities to leverage the advantages of different methods by establishing hybrid models by shared variables or coupled codes and applications. Finally, the review concludes with forward-looking remarks on how the use of physics-based models can aid the improvement of machine-learning models of property degradation and vice versa.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Covariance Shaping Over Riemannian Manifolds for Massive MIMO Communication

Acquiring accurate instantaneous channel state information (CSI) is a challenging aspect of massive multi-input multi-output (MIMO) communication. Utilizing statistical information, such as channel covariance matrix, to design statistical beamforming vectors is robust when compared to instantaneous CSI. In this paper, we propose a novel MIMO covariance shaping scheme over Riemannian manifolds. It serves as an effective statistical beamforming solution to a number of close proximity user equipment (UE) that are undergoing substantial channel correlation. Proposed algorithm exploits the Hermitian positive definite nature of covariance matrices lying over Riemannian manifold. We introduce Wasserstein distance function as a Riemannian metric to measure distances between channel covariance matrices. Furthermore, K-means clustering technique is utilized to effectively identify the optimal shape of effective optimal covariance matrices. Our findings suggest that maximizing the geodesic distance between covariance matrices ultimately leads to a corresponding increase in the network throughput, as determined by the beamforming vector used to shape the covariance matrices. Simulation results validate that the proposed solution converges faster than Euclidean-based state-of-the-art, while maintaining the same computational complexity. Finally, the sum rate performance asymptotically achieves full capacity for two-UE case and more than 96% of the upper bound exhaustive search benchmark for multi-UE scenario.

42 ENGINEERING↗

DOE OSTI2020

Structure of chalcogen overlayers on Au(111): Density functional theory and lattice-gas modeling

Ordering of different chalcogens, S, Se, and Te, on Au(111) exhibit broad similarities but also some distinct features, which must reflect subtle differences in relative values of the long-range pair and many-body lateral interactions between adatoms. We develop lattice-gas (LG) models within a cluster expansion framework, which includes about 50 interaction parameters. These LG models are developed based on density functional theory (DFT) analysis of the energetics of key adlayer configurations in combination with the Monte Carlo (MC) simulation of the LG models to identify statistically relevant adlayer motifs, i.e., model development is based entirely on theoretical considerations. The MC simulation guides additional DFT analysis and iterative model refinement. Given their complexity, development of optimal models is also aided by strategies from supervised machine learning. The model for S successfully captures ordering motifs over a broader range of coverage than achieved by previous models, and models for Se and Te capture the features of ordering, which are distinct from those for S. More specifically, the modeling for all three chalcogens successfully explains the linear adatom rows (also subtle differences between them) observed at low coverages of ~0.1 monolayer. The model for S also leads to a new possible explanation for the experimentally observed phase with a (5 × 5)-type low energy electron diffraction (LEED) pattern at 0.28 ML and to predictions for LEED patterns that would be observed with Se and Te at this coverage.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Insights into the origin of halo mass profiles from machine learning

ABSTRACT The mass distribution of dark matter haloes is the result of the hierarchical growth of initial density perturbations through mass accretion and mergers. We use an interpretable machine-learning framework to provide physical insights into the origin of the spherically-averaged mass profile of dark matter haloes. We train a gradient-boosted-trees algorithm to predict the final mass profiles of cluster-sized haloes, and measure the importance of the different inputs provided to the algorithm. We find two primary scales in the initial conditions (ICs) that impact the final mass profile: the density at approximately the scale of the haloes’ Lagrangian patch RL ($R\sim 0.7\, R_L$) and that in the large-scale environment (R ∼ 1.7 RL). The model also identifies three primary time-scales in the halo assembly history that affect the final profile: (i) the formation time of the virialized, collapsed material inside the halo, (ii) the dynamical time, which captures the dynamically unrelaxed, infalling component of the halo over its first orbit, (iii) a third, most recent time-scale, which captures the impact on the outer profile of recent massive merger events. While the inner profile retains memory of the ICs, this information alone is insufficient to yield accurate predictions for the outer profile. As we add information about the haloes’ mass accretion history, we find a significant improvement in the predicted profiles at all radii. Our machine-learning framework provides novel insights into the role of the ICs and the mass assembly history in determining the final mass profile of cluster-sized haloes.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1995

Experimental studies of the properties of 'simulated' upstream turbulence using a statistical multipoint method

In this report we present a different approach to the multipoint measurement of magnetic fields and plasma. This is called the multi-spacecraft ensemble technique (MET), essentially free of process restrictions, such as linearity and stationarity. We comprehensively discuss the other conditions and limitations intrinsic to this statistical method. We also show the results of the application of the ensemble method to the synthetic data obtained from a hybrid simulation in the region upstream of a quasi-parallel shock. The important implications of the above approach for the CLUSTER mission are discussed.

Orlowski, D. S.↗

NASA NTRS2000

Sunyaev-Zeldovich Effect-Derived Distances to the High-Redshift Clusters

We determine the distances to the z approximately equals 0.55 galaxy clusters MS 0451.6 - 0305 and Cl 0016 + 16 from a maximum-likelihood joint fit to interferometric Sunyaev-Zeldovich effect (SZE) and X-ray observations. We model the intracluster medium (ICM) using a spherical isothermal beta model. We quantify the statistical and systematic uncertainties inherent to these direct distance measurements, and we determine constraints on the Hubble parameter for three different cosmologies. For an Omega(sub M) = 0.3, Omega(sub lambda) = 0.7 cosmology, these distances imply a Hubble constant of 63(sup +12) (sub -9) (sup + 21) (sub -21) km/s Mp/c, where the uncertainties correspond to statistical followed by systematic at 68% confidence. The best-fit H(sub 0) is 57 km/s Mp/c for an open (Omega(sub M) = 0.3) universe and 52 km/s Mp/c for a flat (Omega(sub M) = 1) universe.

Reese, Erik D.↗

NASA NTRS1997

Formation and Combustion of Unconfined Drop Clusters in Microgravity

Single-drop and droplet array studies have become common methods to isolate and investigate the effects of any of the complexities that enter into the drop combustion process. Microgravity environments are required to allow larger drops to be studied while minimizing or eliminating the confounding effects of buoyancy. Based on the results from current isolated drop, drop array, and spray studies funded through the Microgravity Science and Applications Division, it has become clear that even with the effects of buoyancy removed, the extrapolation of results from droplet array studies to spray flames is difficult. The problem occurs because even the simplest spray systems introduce complexities of multi-disperse drop sizes and drop-drop interactions, coupled with more complicated fluid dynamics. Not only do these features make the interpretation of experimental data difficult, they also make the problem very difficult to analyze computationally. Group combustion models, in which the interaction between droplets is treated on a statistical manner, have become a popular method to investigate the behavior of large numbers of interacting droplets, particularly through the work of Ryan et al. and Bellan and co-workers. While these models idealize the actual spray systems to a point where they can be treated computationally, the experimental analogy to these models is difficult to achieve because it requires the formation and Combustion of drop clusters without the effects of buoyancy. Therefore, even though these models have provided useful and insightful information, the verification of the results by direct comparison with experimental data is still lacking.

Liu, S.↗

DOE OSTI2020

The Dynamics of Interstellar Asteroids and Comets within the Galaxy: An Assessment of Local Candidate Source Regions for 1I/’Oumuamua and 2I/Borisov

The low velocity of interstellar asteroid 1I/’Oumuamua with respect to our galaxy’s local standard of rest implies that it is young. Adopting the young age hypothesis, we assess possible origin systems for this interstellar asteroid and for 2I/Borisov, though the latter’s higher speed means it is unlikely to be young. First, their past trajectories are modeled under gravitational scattering by galactic components (“disk heating”) to assess how far back one can trace them. The stochastic nature of disk heating means that a back integration can only expect to be accurate to within 15 pc and 2 km s{sup −1} at −10 Myr, dropping steeply to 400 pc and 10 km s{sup −1} at −100 Myr, sharply limiting our ability to determine a precise origin. Nevertheless, we show that ’Oumuamua’s origin system likely is currently within 1 kpc of Earth, in the local Orion Arm. Second, we back integrate ’Oumuamua’s trajectory in order to assess source regions, emphasizing young systems and moving groups. Though disk heating allows for only a statistical link to source regions, ’Oumuamua passed through a considerable subset of the Carina and Columba moving groups when those groups were forming. This makes them perhaps the most plausible source region, if ’Oumuamua was ejected during planet formation or via intra-cluster interactions. We find three stars in the Ursa Major group, one brown dwarf, and seven other stars to have plausible encounters with 2I/Borisov, within 2 pc and 30 km s{sup −1}. These encounters’ high relative speeds mean none are likely to be the home of 2I/Borisov.

79 ASTRONOMY AND ASTROPHYSICS↗