Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Data Analytics Applied to Coal Fired Boilers for Detecting Leaks

Data analytics were used to detect boiler leaks from five different coal-fired boilers including both subcritical and supercritical systems. Discriminant functions were developed that detected leaks up to two weeks prior to forced plant shutdowns for repairs. The leaks were identified to occur at different sections of the boiler for each plant, including waterwalls, economizer and superheater using conventional process measurement data. Leaking conditions were detected with a high degree of confidence (≪ 1% misclassified observations) and were able to distinguish normal operations from those time periods with steam leaks even while operating the power plants in power cycling mode.Multivariable statistical analyses, including Principal Component (PCA), cluster, and Fischer Discriminant Analysis (FDA) were used to characterize the leak occurrence. Normal and operational states with steam leaks were provided in the original process datasets. These datasets were split into two different groups for training and validation purposes. The data were sorted chronologically, and every third observation was assigned to training the Discriminant Function Model (DFM) while the rest were reserved for validation. PCA was used to reduce dimensionality of the original datasets. Canonical and FDA analyses were used to investigate the relationship between process variables. The outcome of the analyses revealed that nearly 35,000 observations were classified correctly; less than 0.05% of total observations were misclassified to be leaking, i.e. both false positives and false negatives.

Indrawan, Natarianto↗

Automatic classification of soils and vegetation with ERTS-1 data

Preliminary results of a test of a computerized analysis method using ERTS 1 data are presented. The method consisted of a four-spectral-band supervised, maximum likelihood, Gaussian classifier with training statistics derived through a combination of clustering and manual methods. The multivariate analysis method leads to the assignment of each resolution element of the data to one of a preselected set of discrete classes. The data frame was an area over the Texas-Oklahoma border including Lake Texoma. The study suggests that multispectral scanner data coupled with machine processing shows promise for earth surface cover surveys. Futhermore, the processing time is short and consequently the costs are low; a full frame can be analyzed completely within 48 hours.

Landgrebe, D. A.↗

The evaluation of alternate methodologies for land cover classification in an urbanizing area

The usefulness of LANDSAT in classifying land cover and in identifying and classifying land use change was investigated using an urbanizing area as the study area. The question of what was the best technique for classification was the primary focus of the study. The many computer-assisted techniques available to analyze LANDSAT data were evaluated. Techniques of statistical training (polygons from CRT, unsupervised clustering, polygons from digitizer and binary masks) were tested with minimum distance to the mean, maximum likelihood and canonical analysis with minimum distance to the mean classifiers. The twelve output images were compared to photointerpreted samples, ground verified samples and a current land use data base. Results indicate that for a reconnaissance inventory, the unsupervised training with canonical analysis-minimum distance classifier is the most efficient. If more detailed ground truth and ground verification is available, the polygons from the digitizer training with the canonical analysis minimum distance is more accurate.

Smekofski, R. M.↗

A deep x-ray survey of the Pleiades cluster and the B6-A3 main sequence stars in Orion

We have obtained deep ROSAT images of three regions within the Pleiades open cluster. We have detected 317 X-ray sources in these ROSAT PSPC images, 171 of which we associate with certain probable members of the Pleiades cluster. We detect nearly all Pleiades members with spectral types later than G0 and within 25 arcminutes of our three field centers where our sensitivity is highest. This has allowed us to derive for the first time the luminosity function for the G, K, and M dwarfs of an open cluster without the need to use statistical techniques to account for the presence of upper limits in the data sample. Because of our high X-ray detection frequency down to the faint limit of the optical catalog, we suspect that some of our unidentified X-ray sources are previously unknown, very low-mass members of the Pleiades. A large fraction of the Pleiades members detected with ROSAT have published rotational velocities. Plots of L(sub x)/L(sub bol) versus spectroscopic rotational velocity show tightly correlated 'saturation' type relations for stars with (B - V)(sub O) greater than 0.60. For each of several color ranges, X-ray luminosities rise rapidly with increasing rotation rate until v sin i approximately equals 15 km/s, and then remain essentially flat for rotation rates up to at least v sin i approximately equal to 100 km/s. The dispersion in rotation among low-mass stars in the Pleiades is by far the dominant contributor to the dispersion in L(subx) at a given mass. Only about 35 percent of the B.A. and early F stars in the Pleiades are detected as X-ray sources in our survey. There is no correlation between X-ray flux and rotation for these stars. The X-ray luminosity function for the early-type Pleiades stars appears to be bimodal, with only a few exceptions. We either detect these stars at fluxes in the range found for low-mass stars or we derive X-ray limits below the level found for most Pleiades dwarfs. The X-ray spectra for the early-type Pleiades stars detected by ROSAT are indistinguishable from the spectra of the low-mass Pleiades members. We believe that the simple explanation for this behavior is that the early-type Pleiades stars are not themselves intrinsic X-ray sources and that the X-ray sources and that the X-ray emission actually arises from low-mass companions to these stars.

Caillault, Jean-Pierre↗

A deep imaging survey of the Pleiades with ROSAT

We have obtained deep ROSAT images of three regions within the Pleiades open cluster. We have detected 317 X-ray sources in these ROSAT Position Sensitive Proportional Counter (PSPC) images, 171 of which we associate with certain or probable members of the Pleiades cluster. We detect nearly all Pleiades members with spectral types later than G0 and within 25 arcminutes of our three field centers where our sensitivity is highest. This has allowed us to derive for the first time the luminosity function for the G, K, amd M dwarfs of an open cluster without the need to use statistical techniques to account for the presence of upper limits in the data sample. Because of our high X-ray detection frequency down to the faint limit of the optical catalog, we suspect that some of our unidentified X-ray sources are previously unknown, very low-mass members of Pleiades. A large fraction of the Pleiades members detected with ROSAT have published rotational velocities. Plots of L(sub X)/L(sub Bol) versus spectroscopic rotational velocity show tightly correlated `saturation' type relations for stars with ((B - V)(sub 0)) greater than or equal to 0.60. For each of several color ranges, X-ray luminosities rise rapidly with increasing rotation rate until c sin i approximately equal to 15 km/sec, and then remains essentially flat for rotation rates up to at least v sin i approximately equal to 100 km/sec. The dispersion in rotation among low-mass stars in the Pleiades is by far the dominant contributor to the dispersion in L(sub X) at a given mass. Only about 35% of the B, A, and early F stars in the Pleiades are detected as X-ray sources in our survey. There is no correlation between X-ray flux and rotation for these stars. The X-ray luminosity function for the early-type Pleiades stars appears to be bimodal -- with only a few exceptions, we either detect these stars at fluxes in the range found for low-mass stars or we derive X-ray limits below the level found for most Pleiades dwarfs. The X-ray spectra for the early-type Pleiades stars detected by ROSAT are indistinguishable from the spectra of the low-mass Pleiades members. We believe that the simplest explanation for this behavior is that the early-type Pleiades stars are not themselves intrinsic X-ray sources and that the X-ray emission actually arises from low-mass companions to these stars.

Stauffer, J. R.↗

Real-Time Kennedy Space Center and Cape Canaveral Air Force Station High-Resolution Model Implementation and Verification

NASA's Launch Services Program, Ground Systems Development and Operations, Space Launch System and other programs at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) use the daily and weekly weather forecasts issued by the 45th Weather Squadron (45 WS) as decision tools for their day-to-day and launch operations on the Eastern Range (ER). Examples include determining if they need to limit activities such as vehicle transport to the launch pad, protect people, structures or exposed launch vehicles given a threat of severe weather, or reschedule other critical operations. The 45 WS uses numerical weather prediction models as a guide for these weather forecasts, particularly the Air Force Weather Agency (AFWA) 1.67 km Weather Research and Forecasting (WRF) model. Considering the 45 WS forecasters' and Launch Weather Officers' (LWO) extensive use of the AFWA model, the 45 WS proposed a task at the September 2013 Applied Meteorology Unit (AMU) Tasking Meeting requesting the AMU verify this model. Due to the lack of archived model data available from AFWA, verification is not yet possible. Instead, the AMU proposed to implement and verify the performance of an ER version of the high-resolution WRF Environmental Modeling System (EMS) model configured by the AMU (Watson 2013) in real time. Implementing a real-time version of the ER WRF-EMS would generate a larger database of model output than in the previous AMU task for determining model performance, and allows the AMU more control over and access to the model output archive. The tasking group agreed to this proposal; therefore the AMU implemented the WRF-EMS model on the second of two NASA AMU modeling clusters. The AMU also calculated verification statistics to determine model performance compared to observational data. Finally, the AMU made the model output available on the AMU Advanced Weather Interactive Processing System II (AWIPS II) servers, which allows the 45 WS and AMU staff to customize the model output display on the AMU and Range Weather Operations (RWO) AWIPS II client computers and conduct real-time subjective analyses.

Meteorology↗

Clustering, randomness, and regularity in cloud fields. 4: Stratocumulus cloud fields

To complete the analysis of the spatial distribution of boundary layer cloudiness, the present study focuses on nine stratocumulus Landsat scenes. The results indicate many similarities between stratocumulus and cumulus spatial distributions. Most notably, at full spatial resolution all scenes exhibit a decidedly clustered distribution. The strength of the clustering signal decreases with increasing cloud size; the clusters themselves consist of a few clouds (less than 10), occupy a small percentage of the cloud field area (less than 5%), contain between 20% and 60% of the cloud field population, and are randomly located within the scene. In contrast, stratocumulus in almost every respect are more strongly clustered than are cumulus cloud fields. For instance, stratocumulus clusters contain more clouds per cluster, occupy a larger percentage of the total area, and have a larger percentage of clouds participating in clusters than the corresponding cumulus examples. To investigate clustering at intermediate spatial scales, the local dimensionality statistic is introduced. Results obtained from this statistic provide the first direct evidence for regularity among large (more than 900 m in diameter) clouds in stratocumulus and cumulus cloud fields, in support of the inhibition hypothesis of Ramirez and Bras (1990). Also, the size compensated point-to-cloud cumulative distribution function statistic is found to be necessary to obtain a consistent description of stratocumulus cloud distributions. A hypothesis regarding the underlying physical mechanisms responsible for cloud clustering is presented. It is suggested that cloud clusters often arise from 4 to 10 triggering events localized within regions less than 2 km in diameter and randomly distributed within the cloud field. As the size of the cloud surpasses the scale of the triggering region, the clustering signal weakens and the larger cloud locations become more random.

Lee, J.↗

Dark Energy Survey Year 6 Results: MagLim++ Lens Sample Selection and Measurements of Galaxy Clustering

Galaxy clustering is a sensitive probe of the expansion history and growth of structure of the universe, and key degeneracies can be broken by combining these data with measurements of cosmic shear and galaxy-galaxy lensing (a so-called 3$\times$2pt analysis). The largest and least biased statistical samples of galaxies for use in clustering analyses can be collected photometrically through large imaging surveys. However, selecting clean photometric subsamples for cosmology are crucial for avoiding contamination that can bias cosmological constraints. Here we present the MagLim++ galaxy sample, selected to optimize for cosmological constraining power and incorporating an array of novel quality cuts to identify and remove residual contamination. This sample comes from the full six years of observations from the Dark Energy Survey. We present measurements of the two-point angular clustering ($w(θ)$) of 9,186,205 galaxies distributed over 4031 sq. degrees and in six tomographic redshift bins centered at $\bar{z}\approx$ [0.31, 0.44, 0.62, 0.78, 0.90, 1.01]. These measurements are used as part of the 3$\times$2pt and other DES Y6 legacy cosmological analyses in companion works. We describe the battery of null tests and mitigation schemes implemented to address observational, astrophysical, and methodological systematics in the analysis. The resulting $w(θ)$ measurements have a S/N = 149 (90.2 for linear scales only), which we use to place galaxy-clustering-only constraints on the matter density of the Universe, $Ω_m=0.311^{+0.023}_{-0.035}$, and amplitude of galaxy clustering in each redshift bin, $b_iσ_8=[1.16^{+0.04}_{-0.06},\ 1.40^{+0.04}_{-0.06},\ 1.57^{+0.04}_{-0.06},\ 1.59^{+0.04}_{-0.05},\ 1.50^{+0.04}_{-0.05},\ 1.74^{+0.06}_{-0.08}]$.

Weaverdyck, N. [BCCP, Berkeley; UC, Berkeley; LBL,↗

Clustering, randomness and regularity in cloud fields. I - Theoretical considerations. II - Cumulus cloud fields

The current controversy existing in reference to the regularity vs. clustering in cloud fields is examined by means of analysis and simulation studies based upon nearest-neighbor cumulative distribution statistics. It is shown that the Poisson representation of random point processes is superior to pseudorandom-number-generated models and that pseudorandom-number-generated models bias the observed nearest-neighbor statistics towards regularity. Interpretation of this nearest-neighbor statistics is discussed for many cases of superpositions of clustering, randomness, and regularity. A detailed analysis is carried out of cumulus cloud field spatial distributions based upon Landsat, AVHRR, and Skylab data, showing that, when both large and small clouds are included in the cloud field distributions, the cloud field always has a strong clustering signal.

Weger, R. C.↗

Abundance gradients in cooling flow clusters: Ginga Large Area Counters and Einstein Solid State Spectrometer spectra of A496, A1795, A2142, and A2199

We analyze the Ginga Large Area Counters (LAC) and Einstein Solid State Spectrometer (SSS) spectra of four cooling flow clusters, A496, A1795, A2142, and A2199, each of which shows firm evidence of a relatively cool component. The inclusion of such cool spectral components in joint fits of SSS and LAC data leads to somewhat higher global temperatures than are derived from the high-energy LAC data alone. We find little evidence of cool emission outside the SSS field of view. Metal abundances appear to be centrally enhanced in all four clusters, with varying degrees of model dependence and statistical significance: the evidence is statistically strongest for A496 and A2142, somewhat weaker for A2199 and weakest for A1795. We also explore the model dependence in the amount of cold, X-ray-absorbing matter discovered in these clusters by White et al.

White, Raymond E., III↗

Methods of editing cloud and atmospheric layer affected pixels from satellite data

Practical methods of computer screening cloud-contaminated pixels from data of various satellite systems are proposed. Examples are given of the location of clouds and representative landscape features in HCMM spectral space of reflectance (VIS) vs emission (IR). Methods of screening out cloud affected HCMM are discussed. The character of subvisible absorbing-emitting atmospheric layers (subvisible cirrus or SCi) in HCMM data is considered and radiosonde soundings are examined in relation to the presence of SCi. The statistical characteristics of multispectral meteorological satellite data in clear and SCi affected areas are discussed. Examples in TIROS-N and NOAA-7 data from several states and Mexico are presented. The VIS-IR cluster screening method for removing clouds is applied to a 262, 144 pixel HCMM scene from south Texas and northeast Mexico. The SCi that remain after cluster screening are sited out by applying a statistically determined IR limit.

Nixon, P. R.↗

X-ray spectra of 12 distant clusters of galaxies

An X-ray spectral analysis of 12 distant clusters of galaxies observed on-axis with the Einstein Observatory imaging proportional counter is presented. Statistically, X-ray spectral data of the highest red shift clusters in the sample are inconsistent with an optically thin plasma emission model plus absorptions only in the Milky Way. Inclusions of excess absorptions in the clusters significantly improve the spectral fits to the data, indicating the possible presence of large amounts of X-ray absorbing cool gas in some of the distant clusters. By using X-ray luminosities determined from observed fluxes only in the 0.8-3.5 keV band and the temperature-to-luminosity correlation for nearby clusters, the estimated temperatures of the hot intracluster medium in these distant clusters constrain the absorption columns in the clusters. The data also show possible positive temperature evolution of the hot ICM with time which, if present, would further increase the absorptions required in fitting the spectra.

Wang, Qingde↗

Radio observations of Abell clusters and a comparison with certain Einstein observations

Areas around 70 clusters have been observed at the Arecibo Observatory primarily for coordination with about 60 Einstein X-ray sources. Arecibo source coordinates and flux density are tabulated, and some identifications are made with cataloged radio sources. Statistical estimates are made of the percentage of cluster sources among all sources in certain areas and to limits on the flux density of 430 MHz. Arecibo and other radio data are compared with the available Einstein data of seven clusters. Not every Einstein source has a radio counterpart, and the counterparts may variously be bilobed, tailed, or single. A parameter which is proportional to source continuum power at 430 MHz ranges over fewer orders of magnitude than the associated source X-ray luminosity, with no certain correlation between these parameters. NRAO Green Bank interferometer observations of A401 and A2142 are reported.

Johnson, H. M.↗

Uncertainty estimation of bifurcated solutions in the Rayleigh–Bénard problem for advanced nuclear reactors applications

Multiphysics models of nuclear reactors frequently comprise nonlinear systems of equations. The nonlinear nature of these models could lead to solution bifurcations, where a small change in a certain parameter, e.g., the thermophysical properties of the coolant, can lead to a sudden change in the system’s behavior. At the point in parameter space where this happens, called a critical point, the Jacobian matrix of the model’s nonlinear operator becomes singular potentially permitting multiple solutions to coexist. In this paper, we perform uncertainty estimation (UE) in a parameter range that includes bifurcated solutions within the context of Rayleigh–Bénard problem. We perform this analysis assuming uncertain temperature difference, and tilt angle for the iterative solution algorithm with a unit Prandtl number (Pr = 1). Also, we perform this analysis under uncertain thermophysical properties for both FLiBe molten salt and liquid sodium as working fluid. We deploy two approaches to compute statistical moments for the resulting distributions of selected flow-field variables. The first approach is the blind computation of the mean and the standard deviation without any consideration of solution bifurcation, while the second approach utilizes k-means clustering to cluster each branch’s solutions together and compute separate statistical moments for each branch. The statistical distributions are obtained by perturbing the selected parameters about nominal values that correspond to a solution on one of the valid branches, and that solution is used as initial guess for the iterative solution algorithm. We found that perturbation of any parameter when its nominal value is close to its critical point always leads to branch jumping, i.e., the iterations converge to a solution on a branch different from the branch of the initial guess. This produces a statistical ensemble comprised of fundamentally different solutions leading to wrong mean values and uncertainty estimates, whereas clustering provides an efficient way to deal with this type of computation. This work is important for developing Gen IV nuclear systems because many of these systems rely on natural convection for cooling especially in accident conditions.

97 - MATHEMATICS AND COMPUTING↗

Impact and mitigation of spectroscopic systematics on DESI DR1 clustering measurements

The large scale structure catalogs within DESI Data Release 1 (DR1) use nearly 6 million galaxies and quasars as tracers of the large-scale structure of the universe to measure the expansion history with baryon acoustic oscillations and the growth of structure with redshift-space distortions. In order to take advantage of DESI's unprecedented statistical power, we must ensure that the galaxy clustering measurements are unaffected by non-cosmological density fluctuations. One source of spurious fluctuations comes from variation in galaxy density with spectroscopic observing conditions, lowering the redshift efficiency (and thus galaxy density) in certain areas of the sky. We measure the uniformity of the redshift success rate for DESI luminous red galaxies (LRG), bright galaxies (BGS) and quasars (QSO), complementing the detailed discussion of emission line galaxy (ELG) systematics in a companion paper [1]. We find small but significant fluctuations of up to 3% in redshift success rate with the effective spectroscopic signal-to-noise, and create and describe weights that remove these fluctuations. We also describe the process to identify and remove data from certain poorly performing fibers from DESI DR1, and measure the stability of the redshift success rate with time. Finally, we find small but significant correlations of redshift success rate with position on the focal plane, survey speed, and number of exposures required, and show the impact of weights correcting these trends on the power spectrum multipoles and on cosmological parameters from BAO and RSD fits. These corrections change the best-fit parameters by <15% of their statistical errors, and thus contribute negligibly to the overall DESI error budget.

cosmological parameters from LSS↗

Continental land cover assessment using Landsat MSS data

A statistical procedure to assess level-II continental resources using Landsat MSS digital data is presented. The statistical procedure involves a two-stage cluster sample within a stratified random sample. The utility of this procedure is assessed by using it to estimate the areal extent of the conifer and hardwood resources of the continental U.S. National estimates of conifer and hardwood derived using this sampling procedure were within 3 percent of U.S. Forest Service (USFS) figures. According to the Landsat-based study, 11 percent of the country is conifer forest and 12 percent is hardwood. The corresponding USFS figures are 13 and 15 percent, respectively. Comparison of the MSS classification products and airphotos showed that the conifer cover class was correctly identified 74 percent of the time and hardwood 80 percent of the time. The average classification accuracy countrywide for the four cover types considered (conifer, hardwood, water, and 'other') is 74 percent, and the overall accuracy is 85 percent. The statistical procedure provides a method of incorporating Landsat MSS digital data as a second state for level-II continental resource assessment. Alternate data sources, e.g., satellite and aircraft photographic imagery, may also be used in conjunction with this statistical model.

Nelson, Ross↗

CIZA: The First Systematic X-Ray Search for Clusters of Galaxies Behind the Milky Way

The aim of the CIZA project (Clusters In the Zone of Avoidance) was to take the first step toward a complete X-ray census of clusters of galaxies behind the plane of the Galaxy (the absolute value of b less than or equal to 20 degrees), the historical Zone of Avoidance of optical extragalactic surveys. Finding these heavily obscured clusters in ROSAT All-Sky Survey data would allow us to: 1. Construct the first truly all-sky, statistically complete, X-ray flux limited sample of galaxy clusters; 2. Use this sample to obtain an improved measurement of the cluster dipole (both amplitude and direction); 3. Chart large-scale structure across the plane of the Milky Way as traced by galaxy clusters; 4. Identify potential massive galaxy clusters contributing to the observed large-scale flow pattern in the local universe, specifically in the region around the Great Attractor; and 5. Use least-action modelling to deduce the gravitational fields created by galaxy clusters and compare this reconstruction with the one obtained from local galaxy surveys. Our project was highly successful in demonstrating the feasibility of this undertaking and allowed substantial progress toward achieving the stated science goals.

Ebeling, Harald↗

Tracer-field cross-correlations with k -nearest neighbour distributions

ABSTRACT In astronomy and cosmology significant effort is devoted to characterizing and understanding spatial cross-correlations between points – e.g galaxy positions, high energy neutrino arrival directions, X-ray and AGN sources, and continuous fields – e.g. weak lensing meiand Cosmic Microwave Background maps. Recently, we introduced the k-nearest neighbour (kNN) formalism to better characterize the clustering of discrete (point) data sets. Here, we extend it to the point – field cross-correlations analysis. It combines kNN measurements of the point data set with measurements of the field smoothed at many scales. The resulting statistics are sensitive to all orders in the joint clustering of the points and the field. We demonstrate that this approach, unlike the 2-pt cross-correlation, can measure the statistical dependence of two data sets even when there are no linear (Gaussian) correlations between them. We further demonstrate that this framework is far more effective than the two point function in detecting cross-correlations when the continuous field is contaminated by high levels of noise. For a particularly high level of noise, the cross-correlation between haloes and the underlying matter field in a cosmological simulation, between 10 h−1 Mpc and 30 h−1 Mpc, is detected at >5σ significance using the technique presented here, when the two-point cross-correlation significance is ∼1σ. Finally, we show that kNN cross-correlations of haloes and the matter field can be well modelled on quasi-linear scales using the Hybrid Effective Field Theory (HEFT) framework, with the same set of bias parameters as are used for 2-pt cross-correlations. The substantial improvement in the statistical power of detecting cross-correlations using this method makes it a promising tool for various cosmological applications.

79 ASTRONOMY AND ASTROPHYSICS↗