Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Full Modeling and parameter compression methods in configuration space for DESI 2024 and beyond

In the contemporary era of high-precision spectroscopic surveys, led by projects like DESI, there is an increasing demand for optimizing the extraction of cosmological information from clustering data. This work conducts a thorough comparison of various methodologies for modeling the full shape of the two-point statistics in configuration space. We investigate the performance of both direct fits (Full Modeling) and the parameter compression approaches (ShapeFit and Standard). We utilize the ABACUS-SUMMIT simulations, tailored to exceed DESI's precision requirements. Particularly, we fit the two-point statistics of three distinct tracers (LRG, ELG, and QSO), by employing a Gaussian Streaming Model in tandem with Convolution Lagrangian Perturbation Theory and Effective Field Theory. We explore methodological setup variations, including the range of scales, the set of galaxy bias parameters, the inclusion of the hexadecapole, as well as model extensions encompassing varying ns and allowing for w 0 w a CDM dark energy model. Throughout these varied explorations, while precision levels fluctuate and certain configurations exhibit tighter parameter constraints, our pipeline consistently recovers the parameter values of the mocks within 1σ in all cases for a 1-year DESI volume. Additionally, we compare the performance of configuration space analysis with its Fourier space counterpart using three models: PyBird, FOLPS and velocileptors, presented in companion papers. We find good agreement with the results from all these models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Statistical tests on clustered global earthquake synthetic data sets

Abstract We study the ability of statistical tests to identify nonrandom features of earthquake catalogs, with a focus on the global earthquake record since 1900. We construct four types of synthetic data sets containing varying strengths of clustering, with each data set containing on average 10,000 events over 100 years with magnitudes above M = 6. We apply a suite of statistical tests to each synthetic realization in order to evaluate the ability of each test to identify the sequences of events as nonrandom. Our results show that detection ability is dependent on the quantity of data, the nature of the type of clustering, and the specific signal used in the statistical test. Data sets that exhibit a stronger variation in the seismicity rate are generally easier to identify as nonrandom for a given background rate. We also show that we can address this problem in a Bayesian framework, with the clustered data sets as prior distributions. Using this new Bayesian approach, we can place quantitative bounds on the range of possible clustering strengths that are consistent with the global earthquake data. At M = 7, we can estimate 99th percentile confidence bounds on the number of triggered events, with an upper bound of 20% of the catalog for global aftershock sequences, with a stronger upper bound on the fraction of triggered events of 10% for long‐term event clusters. At M = 8, the bounds are less strict due to the reduced number of events. However, our analysis shows that other types of clustering could be present in the data that we are unable to detect. Our results aid in the interpretation of the results of statistical tests on earthquake catalogs, both worldwide and regionally.

Daub, Eric G.↗
DOE OSTI2015

Gender differences in cadmium and cotinine levels in prepubertal children

Susceptibility to environmental stressors has been described for fetal and early childhood development. However, the possible susceptibility of the prepubertal period, characterized by the orchestration of the organism towards sexual maturation and adulthood has been poorly investigated and exposure data are scarce. In the current study levels of cadmium (Cd), cotinine and creatinine in urine were analyzed in a subsample 216 children from 12 European countries within the DEMOCOPHES project. The children were divided into six age–sex groups: boys (6–8 years, 9–10 years and 11 years old), and girls (6–7 years, 8–9 years, 10–11 years). The number of subjects per group was between 23 and 53. The cut off values were set at 0.1 µg/L for Cd, and 0.8 µg/L for cotinine defined according to the highest limit of quantification. The levels of Cd and cotinine were adjusted for creatinine level. In the total subsample group, the median level of Cd was 0.180 µg/L (range 0.10–0.69 µg/L), and for cotinine the median wet weight value was 1.50 µg/L (range 0.80–39.91 µg/L). There was no significant difference in creatinine and cotinine levels between genders and age groups. There was a significant correlation between levels of cadmium and creatinine in all children of both genders. This shows that even at such low levels the possible effect of cadmium on kidney function was present and measurable. An increase in Cd levels was evident with age. Cadmium levels were significantly different between 6–7 year old girls, 11 year old boys and 10–11 year old girls. As there was a balanced distribution in the number of subjects from countries included in the study, bias due to data clustering was not probable. The impact of low Cd levels on kidney function and gender differences in Cd levels needs further investigation. - Highlights: • In 216 children from 6 to 11 years old the median level of Cd was 0.18 µg/L. • The median level of cotinine was 1.50 µg/L. • Correlation between levels of Cd and creatinine in all children was detected. • Cd levels were different between 6–7 year old, 10–11 year old girls vs. 11 year old boys.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Combined Optical and Radio-Frequency Perspectives on a Hybrid Cloud-To-Ground Lightning Flash Observed by the FORTE Satellite

In this work, we use the coincident optical and radio-frequency (RF) measurements taken by the Fast On-orbit Recording of Transient Events (FORTE) satellite to shed light on common optical signatures recorded by NASA and NOAA lightning imagers during Cloud-to-Ground (CG) lightning. We build flash cluster data for FORTE using the same techniques as the NASA/NOAA instruments to document the optical/RF evolution of an oceanic hybrid -CG flash. The flash began with strong Very High Frequency (VHF)-band emission from a Narrow Bipolar Event (NBE) that initiated a period of normal bilevel intracloud (IC) activity in two vertical layers (8 and 12 km) that lasted for 490 ms. VHF waveforms show step leader activity ahead of the return stroke. All impulsive VHF sources after the stroke come from the lower (8 km) layer. K-changes are noted following the return stroke, but no subsequent strokes are detected. The optical flash began 136 ms after the NBE RF pulse. Twenty-two of the 33 optical groups were dim and occurred during the in-cloud phase of the flash. This activity included both isolated pulses and sustained periods of illumination over tens of milliseconds. Initial cloud pulses accounted for 23% of the total optical radiance from the flash. Illumination during the return stroke contributed 58% of the total radiance, and the K-changes and cloud pulses after the stroke supplied the remaining 19%. These results highlight the benefit of having RF alongside optical lightning measurements for clarifying signatures in the optical data and providing information on their physical origins.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Statistical moments of VIIRS night-time lights

Annual VIIRS global night-time lights traditionally report mean radiance levels after filtering to remove moonlit and cloudy data followed by outlier removal. The mean is the first statistical moment, but there are three other statistical moments (variance, skew and kurtosis) that are currently not produced globally. In this study, we generated VIIRS day/night band multiyear and annual statistical moments for a widely dispersed set of test areas. The moments were calculated from 15 arc second nightly temporal profiles spanning 2012-2020, filtered to exclude cloudy and sunlit data, with radiance adjustments to reduce view angle and lunar illuminance effects. The moment data were examined in two ways: (1) Geospatial grids-which reveal zonation and temporal changes present in urban areas and (2) Scattergrams of moment pairs. The variance versus mean scattergram exhibits several distinct data clusters used to define five zones: core lighting, dark-erratics, mid-erratics, bright-erratics and bright and seteady. The results indicate that the information content of VIIRS night-time lights can be augmented if all four statistical moments are calculated.

47 OTHER INSTRUMENTATION↗
DOE OSTI2014

RELAXATION PROCESSES IN SOLAR WIND TURBULENCE

Based on global conservation principles, magnetohydrodynamic (MHD) relaxation theory predicts the existence of several equilibria, such as the Taylor state or global dynamic alignment. These states are generally viewed as very long-time and large-scale equilibria, which emerge only after the termination of the turbulent cascade. As suggested by hydrodynamics and by recent MHD numerical simulations, relaxation processes can occur during the turbulent cascade that will manifest themselves as local patches of equilibrium-like configurations. Using multi-spacecraft analysis techniques in conjunction with Cluster data, we compute the current density and flow vorticity and for the first time demonstrate that these localized relaxation events are observed in the solar wind. Such events have important consequences for the statistics of plasma turbulence.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: combining correlated Gaussian posterior distributions

The cosmological information contained in anisotropic galaxy clustering measurements can often be compressed into a small number of parameters whose posterior distribution is well described by a Gaussian. Here, we present a general methodology to combine these estimates into a single set of consensus constraints that encode the total information of the individual measurements, taking into account the full covariance between the different methods. We also illustrate this technique by applying it to combine the results obtained from different clustering analyses, including measurements of the signature of baryon acoustic oscillations and redshift-space distortions, based on a set of mock catalogues of the final SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS). Our results show that the region of the parameter space allowed by the consensus constraints is smaller than that of the individual methods, highlighting the importance of performing multiple analyses on galaxy surveys even when the measurements are highly correlated. Our paper is part of a set that analyses the final galaxy clustering data set from BOSS. The methodology presented here is used in Alam et al. to produce the final cosmological constraints from BOSS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Linear point and sound horizon as purely geometric standard rulers

The baryon acoustic oscillations feature (BAO) imprinted in the clustering correlation function is known to furnish us cosmic distance determinations that are independent of the cosmological-background model and the primordial perturbation parameters. These measurements can be accomplished rigorously by means of the purely geometric BAO methods. To date two different purely geometric BAO approaches have been proposed. The first exploits the linear-point standard ruler. The second, called correlation-function model-fitting, exploits the sound-horizon standard ruler. A key difference between them is that, when estimated from clustering data, the linear point makes use of a cosmological-model-independent procedure to extract the ratio of the ruler to the cosmic distance, while the correlation-function model-fitting relies on a phenomenological cosmological model for the correlation function. Nevertheless the two rulers need to be precisely defined independently of any specific observable (e.g., the BAO). We define the linear point and sound horizon and we fully characterize and compare the two rulers’ cosmological-parameter dependence. We find that they are both geometrical (i.e., independent of the primordial cosmological parameters) within the required accuracy, and that they have the same parameter dependence for a wide range of parameter values. We estimate the rulers’ best-fit values and errors, given the cosmological constraints obtained by the Planck Satellite team from their measurements of the cosmic microwave background temperature and polarization anisotropies. We do this for three different cosmological models encompassed by the purely geometric BAO methods. In each case we find that the relative errors of the two rulers coincide and they are insensitive to the assumed cosmological model. Interestingly both the linear point and the sound horizon shift by 0.5σ when we do not fix the spatial geometry to be flat in Λ CDM. Finally, this points toward a sensitivity of the rulers to different cosmological models when they are estimated from the cosmic microwave background.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Model-independent versus model-dependent interpretation of the SDSS-III BOSS power spectrum: Bridging the divide

The traditional clustering analyses of galaxy redshift surveys compress the clustering data into a set of late-time physical variables in a model-independent way. This approach has recently been extended by an additional shape variable encoding early-time physics information. Here we apply this new technique, ShapeFit, to SDSS-III BOSS data and show that it matches the constraining power of alternative, model-dependent approaches, which directly constrain the model’s parameters adopting a cosmological model ab initio. ShapeFit is ~30 times faster, model independent, naturally splits early- and late-time variables, and enables a better control of observational systematics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2018

The Source Physics Experiment Large N Array

To improve the understanding of S wave generation from an explosion, a temporary deployment of 996 geophones, including both one component (Z) and three component sensors (3C), was installed from April 15 to May 23, 2016 at the Nevada National Security Site (NNSS). Sensor spacing varied from 25 to 100 m and consisted of 500 Z and 496 3C 5-Hz geophones. Data were continuously recorded during the deployment at low-gain (0 db) from April 15 to April 28 and high-gain (36 db) from April 29 to May 23. A buried (76.5 m depth) 5035 kg TNT equivalent chemical explosion (SPE-5) was recorded on April 26. It was situated in a weathered granite body surrounded by volcanic tuffs, Paleozoic carbonates, and alluvium. The array was deployed approximately 400 to 3000 m from the explosion. A set of large weight-drop shots (13,000 kg source) at 53 locations both inside and outside the geophone array were also recorded, as were local, regional, and teleseismic earthquakes. Data recovery was good, with 95% of data recovered from the chemical explosion and up to 99% in the following weeks, including both the weightdrop shots campaign and the continuous data. Important initial results from the deployment include estimates of the spatial correlation length of velocity heterogeneities and a higher resolution velocity model. Observations of the data and synthetics, indicate that some far-field (elastic) S wave energy is generated by scattering and conversion outside the near-field (inelastic) region. Interferometric processing was conducted on a Hadoop ‘big-data’ cluster.

58 GEOSCIENCES↗
DOE OSTI2015

Enabling Exascale Hardware and Software Design through Scalable System Virtualization (Final Report)

The purpose of this project has been to extend the state of the art of systems software for high-end computing (HEC) platforms, and to use systems software to better enable the evaluation of potential future HEC platforms, for example exascale platforms. Such platforms, and their systems software, have the goal of providing scientific computation at new scales, thus enabling new research in the physical sciences and engineering. Over time, the innovations in systems software for such platforms also become applicable to more widely used computing clusters, data centers, and clouds. This was a five-institution project, centered on the Palacios virtual machine monitor (VMM) systems software, a project begun at Northwestern, and originally developed in a previous collaboration between Northwestern University and the University of New Mexico. In this project, Northwestern (including via our subcontract to the University of Pittsburgh) contributed to the continued development of Palacios, along with other team members. We took the leadership role in (1) continued extension of support for emerging Intel and AMD hardware, (2) integration and performance enhancement of overlay networking, (3) connectivity with architectural simulation, (4) binary translation, and (5) support for modern Non-Uniform Memory Access (NUMA) hosts and guests. We also took a supporting role in support for specialized hardware for I/O virtualization, profiling, configurability, and integration with configuration tools. The efforts we led (1-5) were largely successful and executed as expected, with code and papers resulting from them. The project demonstrated the feasibility of a virtualization layer for HEC computing, similar to such layers for cloud or datacenter computing. For effort (3), although a prototype connecting Palacios with the GEM5 architectural simulator was demonstrated, our conclusion was that such a platform was less useful for design space exploration than anticipated due to inherent complexity of the connection between the instruction set architecture level and the microarchitectural level. For effort (4), we found that a code injection approach proved to be more fruitful. The results of our efforts are publicly available in the open source Palacios codebase and published papers, all of which are available from the project web site, v3vee.org. Palacios is currently one of the two codebases (the other being Sandia’s Kitten lightweight kernel) that underlies the node operating system for the DOE Hobbes Project, one of two projects tasked with building a systems software prototype for the national exascale computing effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Data Intensive Computing on Amazon Web Services

The Geophysical Monitoring Program (GMP) has spent the past few years building up the capability to perform data intensive computing using what have been referred to as “big data” tools. These big data tools would be used against massive archives of seismic signals (>300 TB) to conduct research not previously possible. Examples of such tools include Hadoop (HDFS, MapReduce), HBase, Hive, Storm, Spark, Solr, and many more by the day. These tools are useful for performing data analytics on datasets that exceed the resources of traditional analytic approaches. To this end, a research big data cluster (“Cluster A”) was set up as a collaboration between GMP and Livermore Computing (LC).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optimal and robust reconstruction of BAO, redshift-space distortions and the Alcock-Paczynski effect

The goal of this project is to optimally reconstruct cosmological information that has been lost from large-scale clustering of galaxies due to cosmic structure growth. The outcome of our research will be used to improve dark energy and other cosmological constraints from the ongoing extended Baryon Oscillation Spectroscopic Survey (eBOSS) and the upcoming Dark Energy Spectroscopic Instrument (DESI). The large-scale galaxy clustering data contain two important features: the Baryon Acoustic Oscillations (BAO) and the overall shape from small to large scales.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Coherent Structures at Ion Scales in Fast Solar Wind: Cluster Observations

We investigate the nature of magnetic turbulent fluctuations, around ion characteristic scales, in a fast solar wind stream, by using Cluster data. Contrarily to slow solar wind, where both Alfvénic (δb{sub ⊥}≫δb{sub ∥}) and compressive (δb{sub ∥}≫δb{sub ⊥}) coherent structures are observed, the turbulent cascade of fast solar wind is dominated by Alfvénic structures, namely, Alfvén vortices, with a small and/or finite compressive part, with the presence also of several current sheets aligned with the local magnetic field. Several examples of vortex chains are also recognized. Although an increase of magnetic compressibility around ion scales is observed also for fast solar wind, no strongly compressive structures are found, meaning that the nature of the slow and fast winds is intrinsically different. Multispacecraft analysis applied to this interval of fast wind indicates that the coherent structures are almost convected by the flow and aligned with the local magnetic field, i.e., their normal is perpendicular to B, which is consistent with a two-dimensional turbulence picture. Understanding intermittency and the related generation of coherent structures could provide a key insight into the nonlinear energy transfer and dissipation processes in magnetized and collisionless plasmas.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1990

Cobweb/3: A portable implementation

An algorithm is examined for data clustering and incremental concept formation. An overview is given of the Cobweb/3 system and the algorithm on which it is based, as well as the practical details of obtaining and running the system code. The implementation features a flexible user interface which includes a graphical display of the concept hierarchies that the system constructs.

Mckusick, Kathleen↗
NASA NTRS1993

An expanded set of brown dwarf and very low mass star models

We present in this paper updated and improved theoretical models of brown dwarfs and late M dwarfs. The evolution and characteristics of objects between 0.01 and 0.2 solar mass are exhaustively investigated and special emphasis is placed on their properties at early ages. The dependence on the helium fraction, deuterium fraction, and metallicity of the masses, effective temperature and luminosities at the edge of the hydrogen main sequence are calculated. We derive luminosity functions for representative mass functions and compare our predictions to recent cluster data. We show that there are distinctive features in the theoretical luminosity functions that can serve as diagnostics of brown dwarf physics. A zero-metallicity model is presented as a bound to or approximation of a putative extreme halo population.

Burrows, A.↗
DOE OSTI2016

CLASH: JOINT ANALYSIS OF STRONG-LENSING, WEAK-LENSING SHEAR, AND MAGNIFICATION DATA FOR 20 GALAXY CLUSTERS

We present a comprehensive analysis of strong-lensing, weak-lensing shear and magnification data for a sample of 16 X-ray-regular and 4 high-magnification galaxy clusters at 0.19≲z≲0.69 selected from Cluster Lensing And Supernova survey with Hubble (CLASH). Our analysis combines constraints from 16-band Hubble Space Telescope observations and wide-field multi-color imaging taken primarily with Suprime-Cam on the Subaru Telescope, spanning a wide range of cluster radii (10″–16′). We reconstruct surface mass density profiles of individual clusters from a joint analysis of the full lensing constraints, and determine masses and concentrations for all of the clusters. We find the internal consistency of the ensemble mass calibration to be ≤5% ± 6% in the one-halo regime (200–2000 kpc h{sup −1}) compared to the CLASH weak-lensing-only measurements of Umetsu et al. For the X-ray-selected subsample of 16 clusters, we examine the concentration–mass (c–M) relation and its intrinsic scatter using a Bayesian regression approach. Our model yields a mean concentration of c|{sub z=0.34}=3.95±0.35 at M{sub 200c} ≃ 14 × 10{sup 14} M{sub ⊙} and an intrinsic scatter of σ(lnc{sub 200c})=0.13±0.06, which is in excellent agreement with Λ cold dark matter predictions when the CLASH selection function based on X-ray morphological regularity and the projection effects are taken into account. We also derive an ensemble-averaged surface mass density profile for the X-ray-selected subsample by stacking their individual profiles. The stacked lensing signal is detected at 33σ significance over the entire radial range ≤4000 kpc h{sup −1}, accounting for the effects of intrinsic profile variations and uncorrelated large-scale structure along the line of sight. The stacked mass profile is well described by a family of density profiles predicted for cuspy dark-matter-dominated halos in gravitational equilibrium, namely, the Navarro–Frenk–White (NFW), Einasto, and DARKexp models, whereas the single power-law, cored isothermal and Burkert density profiles are disfavored by the data. We show that cuspy halo models that include the large-scale two-halo term provide improved agreement with the data. For the NFW halo model, we measure a mean concentration of c{sub 200c}=3.79{sub −0.28}{sup +0.30} at M{sub 200c}=14.1{sub −1.0}{sup +1.0}×10{sup 14} M{sub ⊙}, demonstrating consistency between the complementary analysis methods.

79 ASTRONOMY AND ASTROPHYSICS↗