NSPACE - An unsupervised clustering algorithm based on discretized marginal distributions
Explore the source record for details and available documents.
Eigen, D. J.↗
SEARCH · Engineering Papers
Results for “Marginal Distribution”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Joint Bayesian Component Separation and CMB Power Spectrum Estimation
We describe and implement an exact, flexible, and computationally efficient algorithm for joint component separation and CMB power spectrum estimation, building on a Gibbs sampling framework. Two essential new features are (1) conditional sampling of foreground spectral parameters and (2) joint sampling of all amplitude-type degrees of freedom (e.g., CMB, foreground pixel amplitudes, and global template amplitudes) given spectral parameters. Given a parametric model of the foreground signals, we estimate efficiently and accurately the exact joint foreground- CMB posterior distribution and, therefore, all marginal distributions such as the CMB power spectrum or foreground spectral index posteriors. The main limitation of the current implementation is the requirement of identical beam responses at all frequencies, which restricts the analysis to the lowest resolution of a given experiment. We outline a future generalization to multiresolution observations. To verify the method, we analyze simple models and compare the results to analytical predictions. We then analyze a realistic simulation with properties similar to the 3 yr WMAP data, downgraded to a common resolution of 3 deg FWHM. The results from the actual 3 yr WMAP temperature analysis are presented in a companion Letter.
numerical↗
Climatology of the Aerosol Optical Depth by Components from the Multi-Angle Imaging Spectroradiometer (MISR) and Chemistry Transport Models
The Multi-angle Imaging Spectroradiometer (MISR) Joint Aerosol (JOINT_AS) Level 3 product has provided a global, descriptive summary of MISR Level 2 aerosol optical depth (AOD) and aerosol type information for each month over 16+ years since March 2000. Using Version 1 of JOINT_AS, which is based on the operational (Version 22) MISR Level 2 aerosol product, this study analyzes, for the first time, characteristics of observed and simulated distributions of AOD for three broad classes of aerosols: spherical nonabsorbing, spherical absorbing, and nonspherical - near or downwind of their major source regions. The statistical moments (means, standard deviations, and skew-nesses) and distributions of AOD by components derived from the JOINT_AS are compared with results from two chemistry transport models (CTMs), the Goddard Chemistry Aerosol Radiation and Transport (GOCART) and SPectral RadIatioN-TrAnSport (SPRINTARS). Overall, the AOD distributions retrieved from MISR and modeled by GOCART and SPRINTARS agree with each other in a qualitative sense. Marginal distributions of AOD for each aerosol type in both MISR and models show considerable high positive skewness, which indicates the importance of including extreme AOD events when comparing satellite retrievals with models. The MISR JOINT_AS product will greatly facilitate comparisons between satellite observations and model simulations of aerosols by type.
SPRINTARS↗
Correlation, Cost Risk, and Geometry
The geometric viewpoint identifies the choice of a correlation matrix for the simulation of cost risk with the pairwise choice of data vectors corresponding to the parameters used to obtain cost risk. The correlation coefficient is the cosine of the angle between the data vectors after translation to an origin at the mean and normalization for magnitude. Thus correlation is equivalent to expressing the data in terms of a non orthogonal basis. To understand the many resulting phenomena requires the use of the tensor concept of raising the index to transform the measured and observed covariant components into contravariant components before vector addition can be applied. The geometric viewpoint also demonstrates that correlation and covariance are geometric properties, as opposed to purely statistical properties, of the variates. Thus, variates from different distributions may be correlated, as desired, after selection from independent distributions. By determining the principal components of the correlation matrix, variates with the desired mean, magnitude, and correlation can be generated through linear transforms which include the eigenvalues and the eigenvectors of the correlation matrix. The conversion of the data to a non orthogonal basis uses a compound linear transformation which distorts or stretches the data space. Hence, the correlated data does not have the same properties as the uncorrelated data used to generate it. This phenomena is responsible for seemingly strange observations such as the fact that the marginal distributions of the correlated data can be quite different from the distributions used to generate the data. The joint effect of statistical distributions and correlation remains a fertile area for further research. In terms of application to cost estimating, the geometric approach demonstrates that the estimator must have data and must understand that data in order to properly choose the correlation matrix appropriate for a given estimate. There is a general feeling by employers and managers that the field of cost requires little technical or mathematical background. Contrary to that opinion, this paper demonstrates that a background in mathematics equivalent to that needed for typical engineering and scientific disciplines at the masters or doctorate level is appropriate within the field of cost risk.
Dean, Edwin B.↗
The Application of New Software Technology to the Architecture of the National Cycle Program
As part of the Numerical Propulsion System Simulation (NPSS) effort of NASA Lewis in conjunction with the United States aeropropulsion industry, a new system simulation framework, the National Cycle Program (NCP), capable of combining existing empirical engine models with new detailed component-based computational models is being developed. The software architecture of the NCP program involves a generalized object- oriented framework and a base-set of engine component models along with supporting tool kits which will support engine simulation in a distributed environment. As the models are extended to contain two and three dimensions the computing load increases rapidly and it is intended that this load be distributed across multiple work stations executing concurrently in order to get acceptably fast results. The research carried out was directed toward performance analysis of the distributed object system. More specifically, the performance of the actor-based distributed object design I created earlier was desired. To this end, the research was directed toward the design and implementation of suitable performance-analysis techniques and software to demonstrate those techniques. There were three specific results which are reported in two separate reports submitted separately as NASA Technical Memoranda. The results are: (1) Design, implementation, and testing of a performance analysis program for a set of active objects (actor based objects) which allowed the individual actors to be assigned to arbitrary processes on an arbitrary set of machines. (2) The global-balance-equation approach has the fundamental limitation that the number of equations increases exponentially with the number of actors. Hence, unlike many approximate approaches to this problem, the nearest-neighbor approach allows checking of the solution and an estimate of the error. The technique was demonstrated in a prototype analysis program as part of this research. The results of the program were checked against the global-balance solution discussed above. Late during the grant, a much better approximation was developed and this is discussed in result below. As a consequence, a proposal was submitted to continue the research by developing the new approximation including development of a complete program from the prototype. (3) The source of approximation in the nearest-neighbor algorithm is the requirement for estimating some joint probabilities from some marginal distributions. A completely ad hoc estimate was used in the prototype.
Schoeffler, James D.↗
Statistical wind profile gust model
A statistical wind profile gust model for the Space Transportation Operations and Trade Studies is developed by using 1800 Jimsphere wind profile data collected at Cape Kennedy during 1965 to 1972. Wind profiles from the surface to 20 km in component form, i.e., zonal and meridional are processed through the digital filters of different wave length ranges bases on the Martin-Graham cosine rolloff model. The residuals obtained from the filtering processes for the data base for the statistical analysis. For each wind component the gust and gust length at a specified reference altitude in a residual profile are defined. A two parameter gamma probability marginal distribution seems to fit the component gust amplitude and the gust length when redefined. The problem of finding an appropriate bivariate joint distribution of the gust amplitude and length remains to be solved. The probability distribution of the modulus of the gust amplitudes was derived under the assumption that they are independently distributed as gamma variates.
Doss, D. C.↗
Theoretical studies of the effects of grain noise on photographic stellar astrometry and photometry
A method of incorporating the effects of photographic emulsion grain noise into digital image centering algorithms is presented which improves the accuracy of the derived stellar positions and magnitudes. Theoretical formulae are then derived for the limiting error of the center, and the photometric parameters. For IIIa-J, this error is 0.2-0.3 mu for bright unsaturated images, which agrees quite well with measurements made with the Yale PDS microdensitometer. It is expected that, with further improvements in the positional accuracy of the PDS, it should be possible to reach the emulsion grain noise limit, providing that emulsion shifts or other large scale errors do not dominate. It is also shown that, with appropriate trimming, marginal distribution image centering algorithms can yield an accuracy only slightly poorer than that obtained with two-dimensional distributions.
Lee, J.-F.↗
Isotropic probability measures in infinite dimensional spaces: Inverse problems/prior information/stochastic inversion
Let R be the real numbers, R(n) the linear space of all real n-tuples, and R(infinity) the linear space of all infinite real sequences x = (x sub 1, x sub 2,...). Let P sub n :R(infinity) approaches R(n) be the projection operator with P sub n (x) = (x sub 1,...,x sub n). Let p(infinity) be a probability measure on the smallest sigma-ring of subsets of R(infinity) which includes all of the cylinder sets P sub n(-1) (B sub n), where B sub n is an arbitrary Borel subset of R(n). Let p sub n be the marginal distribution of p(infinity) on R(n), so p sub n(B sub n) = p(infinity)(P sub n to the -1(B sub n)) for each B sub n. A measure on R(n) is isotropic if it is invariant under all orthogonal transformations of R(n). All members of the set of all isotropic probability distributions on R(n) are described. The result calls into question both stochastic inversion and Bayesian inference, as currently used in many geophysical inverse problems.
Backus, George↗
Isotropic probability measures in infinite-dimensional spaces
Let R be the real numbers, R(n) the linear space of all real n-tuples, and R(infinity) the linear space of all infinite real sequences x = (x sub 1, x sub 2,...). Let P sub in :R(infinity) approaches R(n) be the projection operator with P sub n (x) = (x sub 1,...,x sub n). Let p(infinity) be a probability measure on the smallest sigma-ring of subsets of R(infinity) which includes all of the cylinder sets P sub n(-1) (B sub n), where B sub n is an arbitrary Borel subset of R(n). Let p sub n be the marginal distribution of p(infinity) on R(n), so p sub n(B sub n) = p(infinity) (P sub n to the -1 (B sub n)) for each B sub n. A measure on R(n) is isotropic if it is invariant under all orthogonal transformations of R(n). All members of the set of all isotropic probability distributions on R(n) are described. The result calls into question both stochastic inversion and Bayesian inference, as currently used in many geophysical inverse problems.
Backus, George↗
Comparison of laser transit anemometry data analysis techniques
Two techniques for the extraction of two-dimensional flow information from laser transit anemometry (LTA) data sets are presented and compared via a simulation study and experimental investigation. The methods are a probability density function (PDF) estimation technique and a marginal distribution analysis technique. The simulation study builds on the results of previous work and provides a quantification of the accuracy of both techniques for various LTA data acquisition scenarios. The experimental comparison consists of using an LTA system to survey the flow downstream of a turbulence generator in a small low-speed wind tunnel. The collected data sets are analyzed and compared.
Humphreys, William M., Jr.↗
A simple test of independence for truncated data with applications to redshift surveys
This paper presents an easily applied permutation test for H0, closely related to Lyden-Bell's (1971) estimate of the marginal distribution of truncated data. The test is applied to two redshift-magnitude surveys, one of galaxies and one of quasars. Assuming statistical independence, testing H0 amounts to testing validity of the cosmological model. Segal's (1986) chronomatic cosmological model is rejected under H0. On the other hand, for the quasar sample H0 is rejected strongly in a conventional cosmological model (and in a chronomatic model as well) indicating either incorrectness of the models or, as is more commonly assumed, indicating strong luminosity evolution.
Efron, Bradley↗
DES Y3 + KiDS-1000: Consistent Cosmology Combining Cosmic Shear Surveys
We present a joint cosmic shear analysis of the Dark Energy Survey (DES Y3) and the Kilo-Degree Survey (KiDS-1000) in a collaborative effort between the two survey teams. We find consistent cosmological parameter constraints between DES Y3 and KiDS-1000 which, when combined in a joint-survey analysis, constrain the parameter S 8 =σ 8 √(Ω m /0.3) with a mean value of 0.790 +0.018 −0.014. The mean marginal is lower than the maximum a posteriori estimate, S 8 =0.801, owing to skewness in the marginal distribution and projection effects in the multi-dimensional parameter space. Our results are consistent with S 8 constraints from observations of the cosmic microwave background by Planck, with agreement at the 1.7 σ level. We use a Hybrid analysis pipeline, defined from a mock survey study quantifying the impact of the different analysis choices originally adopted by each survey team. We review intrinsic alignment models, baryon feedback mitigation strategies, priors, samplers and models of the non-linear matter power spectrum.
cosmology↗
Digital image centering. II
Digital image centering algorithms were compared in a test involving microdensitometer raster scans of a refractor parallax series consisting of 22 stars on 26 plates. The highest accuracy in determining stellar image positions was provided by an algorithm which involved fitting of a symmetric Gaussian curve and a flat background to the image marginal density distributions. Algorithms involving transmission marginals instead of density marginals were found to be less accurate. The repeatability and computational efficiency of the digital image centering technique were also studied.
Auer, L. H.↗
Interchange stability of a rapidly rotating magnetosphere
A rotation-dominated magnetosphere is unstable to magnetic flux-tube interchange motions if and only if the plasma content of a unit magnetic flux tube is a decreasing function of distance from the spin axis. For a spin-aligned dipole field, an approximate expression is obtained for the marginally stable distribution. Plasma filling the Jovian magnetosphere from internal sources would initially violate this stability criterion so that interchange motions would act to establish the marginally stable distribution.
Hill, T. W.↗
Bivariate extreme value distributions
In certain engineering applications, such as those occurring in the analyses of ascent structural loads for the Space Transportation System (STS), some of the load variables have a lower bound of zero. Thus, the need for practical models of bivariate extreme value probability distribution functions with lower limits was identified. We discuss the Gumbel models and present practical forms of bivariate extreme probability distributions of Weibull and Frechet types with two parameters. Bivariate extreme value probability distribution functions can be expressed in terms of the marginal extremel distributions and a 'dependence' function subject to certain analytical conditions. Properties of such bivariate extreme distributions, sums and differences of paired extremals, as well as the corresponding forms of conditional distributions, are discussed. Practical estimation techniques are also given.
Elshamy, M.↗
Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties
Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.
spectroscopy↗
Ordinary electromagnetic mode instability
The instability of the ordinary electromagnetic mode propagating perpendicular to an external magnetic field is studied for a single-species plasma with ring velocity distribution. The marginal instability boundaries for both the purely growing mode and the propagating growing modes are calculated from the instability criteria. The dispersion characteristics for various sets of plasma parameters are also given. The typical growth rates are of the order of the cyclotron frequency.
Cheng, C. Z.↗
Ordinary electromagnetic mode instability
The instability of the ordinary electromagnetic mode propagating perpendicular to an external magnetic field is analyzed for a single-species plasma with ring velocity distribution. The marginal instability boundaries for both the purely growing mode and the propagating growing modes are calculated from the instability criteria. The dispersion characteristics are derived for a cold plasma and a very strong static magnetic field. The point is determined at which the real parts of the complex frequency band are centered. The typical growth rates are found to be of the order of the cyclotron frequency and can be enhanced by increasing the ratio of parallel kinetic pressure to magnetic pressure.
Cheng, C.-Z.↗