Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Full calibration of the tomographic redshift distribution from the HSC PDR3 Shape Catalog with DESI

The calibration of tomographic redshift distributionsis essential for cosmological analysis of weak lensing data.In this work, we calibrate all four tomographic bins of the Hyper Suprime Camera (HSC) weak lensing catalog with the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 and 2 using the clustering redshifts technique. We include z > 1.2 redshift sources such as emission line galaxies (ELG) and quasars (QSO) sources in our calibration, which were not available in the previous HSC calibration (Rau et al. (2022), Mon. Not. Roy. Astron. Soc. 524 (2023) 5109), allowing a complete calibration of all the redshift bins. We find the first tomographic bin exhibits a small shift towards low redshifts. The second bin is in good agreement with the photometric calibration, while third and fourth bin exhibit a shift towards higher redshifts. However, these shifts are considerably smaller than the shifts obtained in the HSC Year 3 cosmic shear analyses. We evaluate the impact of galaxy bias and magnification effects from all the samples on the measurements, finding them to be small, and we propose corrections to reduce them further. Specifically, we relax the assumption of linear bias and only assume no redshift evolution of the cross-correlation coefficient, allowing us to leverage smaller clustering scales. We model the redshift distributions with splines and compare our results to previous analyses as well as to other parameterizations found in literature. For the two high-redshift tomographic bins, we find the shifts to higher redshifts with respect to the measurements performed in Rau+2022 to be Δz$_{3}$ =-0.039$^{+0.020}$$_{-0.021}$ and Δz$_{4}$ = -0.048$^{+0.012}$$_{-0.012}$.

Choppin de Janvry, J. [LBL, Berkeley; UC, Berkeley↗
DOE OSTI2024

Normalizing flows for domain adaptation when identifying Λ hyperon events

Here this study focuses on the application of a normalizing flow as a method of domain adaptation when classifying physics data. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a novel method of transforming latent representations of physics data to a normal distribution and then to a physics distribution again. The final distribution models a simulated distribution. After being transformed, the data can be classified by a neural network trained on labeled simulation data. The present study succeeds in training two normalizing flows that can transform between data (or simulation) and a Gaussian distribution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Beyond mass: detecting secondary halo properties with galaxy-galaxy lensing

ABSTRACT Secondary halo properties beyond mass, such as the mass accretion rate (MAR), concentration, and the half mass scale, are essential in understanding the formation of large-scale structure and dark matter haloes. In this paper, we study the impact of secondary halo properties on the galaxy-galaxy lensing observable, ΔΣ. We build an emulator trained on N-body simulations to model ΔΣ and quantify the impact of different secondary parameters on the ΔΣ profile. We focus on the impact of MAR on ΔΣ. We show that a 3σ detection of variations in MAR at fixed halo mass could be achieved with the Hyper Suprime Cam survey assuming no baryonic effects and a proxy for MAR with scatter <1.5. We show that the full radial profile of ΔΣ depends on secondary properties at fixed halo mass. Consequently, an emulator that can perform full shape fitting yields better than two times improvement upon the constraints on MAR than only using the outer part of the halo. Finally, we highlight that miscentring and MAR impact the radial profile of ΔΣ in a similar fashion, implying that miscentring and MAR need to be modelled jointly for unbiased estimates of both effects. We show that present-day lensing data sets have the statistical capability to place constraints on halo MAR within our assumptions. Our analysis opens up new possibilities for observationally measuring the assembly history of the dark matter haloes that host galaxies and clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Five-day track forecast skills of WRF model for the western North Pacific tropical cyclones

In this study, the characteristics of simulated tropical cyclones (TCs) over the western North Pacific by a regional model (the WRF Model) are verified. We utilize 12-km horizontal grid spacing, and simulations are integrated for 5 days from model initialization. A total of 125 forecasts are divided into five clusters through the k-means clustering method. The TCs in the cluster 1 and 2 (group 1), which includes many TCs moving northward in the subtropical region, generally have larger track errors than for TCs in cluster 3 and 4 (group 2). The optimal steering vector is used to examine the difference in the track forecast skill between these two groups. The bias in the steering vector between the model and analysis data is found to be more substantial for group 1 TCs than group 2 TCs. The larger steering vector difference for group 1 TCs indicates that environmental fields tend to be poorly simulated in group 1 TC cases. Furthermore, the residual terms, including the storm-scale process, asymmetric convection distribution, or beta-related effect, are also larger for group 1 TCs than group 2 TCs. Therefore, it is probable that the large track forecast error for group 1 TCs is a result of unreasonable simulations of environmental wind fields and residual processes in the midlatitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Environmental predictors of pulmonary nontuberculous mycobacteria (NTM) sputum positivity among persons with cystic fibrosis in the state of Florida

Nontuberculous mycobacteria (NTM) are opportunistic human pathogens that are commonly found in soil and water, and exposure to these organisms may cause pulmonary nontuberculous mycobacterial disease. Persons with cystic fibrosis (CF) are at high risk for developing pulmonary NTM infections, and studies have shown that prolonged exposure to certain environments can increase the risk of pulmonary NTM. It is therefore important to determine the risk associated with different geographic areas. Using annualized registry data obtained from the Cystic Fibrosis Foundation Patient Registry for 2010 through 2017, we conducted a geospatial analysis of NTM infections among persons with CF in Florida. A Bernoulli model in SaTScan was used to identify clustering of ZIP codes with higher than expected numbers of NTM culture positive individuals. Generalized linear mixed models with a binomial distribution were used to test the association of environmental variables and NTM culture positivity. We identified a significant cluster of M . abscessus and predictors of NTM sputum positivity, including annual precipitation and soil mineral levels.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1985

Evaluation of Thematic Mapper data for mapping forest, agricultural and soil resources

Color composite TM film products which include TM5, TM4, and a visible band (TM1, TM2, or TM3) are superior to composites which exclude TM4 for discriminating most forest and agricultural cover types and estimating area proportions for inventory and sampling purposes. Clustering a subset of TM data results in a spectral class map which groups diverse forest cover types into spectrally and ecologically similar areas suitable for use as a stratification base in traditional forest inventory practices. Analysis of simulated Thematic Mapper data indicate that the location and number of TM spectral bands are suitable for detecting differences in major soil properties and characterizing soil spectral curve form and magnitude.

Degloria, S.↗
NASA NTRS1991

Hard x ray imaging graphics development and literature search

This report presents work performed between June 1990 and June 1991 and has the following objectives: (1) a comprehensive literature search of imaging technology and coded aperture imaging as well as relevant topics relating to solar flares; (2) an analysis of random number generators; and (3) programming simulation models of hard x ray telescopes. All programs are compatible with NASA/MSFC Space Science LAboratory VAX Cluster and are written in VAX FORTRAN and VAX IDL (Interactive Data Language).

Emslie, A. Gordon↗
DOE OSTI2021

Exploratory analysis and performance prediction of big data transfer in High-performance Networks

Big data transfer in large-scale scientific and business applications is increasingly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) via advance bandwidth reservation. Provisioning agents need to carefully schedule data transfer requests, compute network paths, and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized, could be simply wasted due to the exclusive access during the approved time window, and cause extra overhead and complexity for resource management. This calls for accurate performance prediction to reserve bandwidths that match actual needs and avoid over-provisioning. We employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements collected in the past several years from data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated testbeds. We first analyze the performance patterns in response to a comprehensive list of parameters in end-host systems, network connections, and data transfer applications, which motivate the use of machine learning and also help us identify the effects of latent factors. We then propose threshold- and clustering-based methods to eliminate negative effects of latent factors in data preprocessing and build a robust performance predictor based on customized domain-oriented loss functions. The performance of the proposed methods is verified by extensive experiments using SVR and RFR as well as theoretical analysis of the general performance bound.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

High Speed Networking and Large-scale Simulation in Geodynamics

Large-scale numerical simulation has been one of the most important approaches for understanding global geodynamical processes. In this approach, peta-scale floating point operations (pflops) are often required to carry out a single physically-meaningful numerical experiment. For example, to model convective flow in the Earth's core and generation of the geomagnetic field (geodynamo), simulation for one magnetic free-decay time (approximately 15000 years) with a modest resolution of 150 in three spatial dimensions would require approximately 0.2 pflops. If such a numerical model is used to predict geomagnetic secular variation over decades and longer, with e.g. an ensemble Kalman filter assimilation approach, approximately 30 (and perhaps more) independent simulations of similar scales would be needed for one data assimilation analysis. Obviously, such a simulation would require an enormous computing resource that exceeds the capacity of a single facility currently available at our disposal. One solution is to utilize a very fast network (e.g. 10Gb optical networks) and available middleware (e.g. Globus Toolkit) to allocate available but often heterogeneous resources for such large-scale computing efforts. At NASA GSFC, we are experimenting with such an approach by networking several clusters for geomagnetic data assimilation research. We shall present our initial testing results in the meeting.

Kuang, Weijia↗
DOE OSTI2023

Evolution of short-range magnetic correlations in ferromagnetic Ni-V alloys

Here we experimentally study how the magnetic correlations develop in a binary alloy close to the ferromagnetic quantum critical point with small-angle neutron scattering (SANS). Upon alloying the itinerant ferromagnet nickel with vanadium, the ferromagnetic order is continuously suppressed. The critical temperature T c vanishes when vanadium concentrations reach the critical value of x c =0.116 indicating a quantum critical point separating the ferromagnetic and paramagnetic phases. Earlier magnetization and μ⁢SR data have indicated the presence of magnetic inhomogeneities in Ni 1-x ⁢V x and, in particular, recognize the magnetic clusters close to x c , on the paramagnetic and on the ferromagnetic sides with nontrivial dynamical properties [R. Wang et al., Phys. Rev. Lett. 118, 267202 (2017)]. We present the results of SANS study with full polarization analysis of polycrystalline Ni 1-x⁢ V x samples with x=0.10 and x=0.11 with low critical temperatures T c <50 K. For both Ni-V samples close to x c we find isotropic magnetic short-range correlations on the nanometer scale persisting at low temperatures. They are suppressed gradually in higher magnetic fields. In addition, signatures of long-range ordered magnetic domains are present below T c . The fraction of these magnetic clusters embedded in the ferromagnetic ordered phase grows toward x c and agrees well with the cluster fraction estimate from the magnetization and μ⁢SR data. Our SANS studies provide new insights into the nature of the inhomogeneities in a ferromagnetic alloy close to a quantum critical point.

36 MATERIALS SCIENCE↗
DOE OSTI2022

LoVoCCS. I. Survey Introduction, Data Processing Pipeline, and Early Science Results

We present the Local Volume Complete Cluster Survey (LoVoCCS; we pronounce it as "low-vox" or "law-vox," with stress on the second syllable), an NSF's National Optical-Infrared Astronomy Research Laboratory survey program that uses the Dark Energy Camera to map the dark matter distribution and galaxy population in 107 nearby (0.03 < z < 0.12) X-ray luminous ([0.1–2.4 keV] L X500 > 10 44 erg s –1 ) galaxy clusters that are not obscured by the Milky Way. The survey will reach Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Year 1–2 depth (for galaxies r = 24.5, i = 24.0, signal-to-noise ratio (S/N) > 20; u = 24.7, g = 25.3, z = 23.8, S/N > 10) and conclude in ~2023 (coincident with the beginning of LSST science operations), and will serve as a zeroth-year template for LSST transient studies. We process the data using the LSST Science Pipelines that include state-of-the-art algorithms and analyze the results using our own pipelines, and therefore the catalogs and analysis tools will be compatible with the LSST. We demonstrate the use and performance of our pipeline using three X-ray luminous and observation-time complete LoVoCCS clusters: A3911, A3921, and A85. A3911 and A3921 have not been well studied previously by weak lensing, and we obtain similar lensing analysis results for A85 to previous studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Exploring the Spatial Relationship Between Demographic Indicators and the Built Environment of a City

In addition to global and regional drivers of urbanization, neighborhood development in urban areas across the United States has been shown to be influenced by various local socio-economic factors. These factors, despite varying across socio-economic groups, have large implications regarding a population’s vulnerability to extreme climate events, including heat waves resulting in adverse health impacts. Additionally, the demographics of an urban area can shape its infrastructural characteristics, causing different populations groups to face varying levels of risks and benefits. As a result, the urban morphology and socio-economic characteristics of a city are deeply intertwined; however, their interactions on a finer scale are not yet fully understood. This research aims to better understand the relationships between various socio-economic factors and the built environment of a city, considering variability in building types, and temperature patterns. This research focuses on the city of Las Vegas, NV, and uses spatial data analysis to understand the correlation between of socio-economic characteristics, building morphology, building characteristics, and temperature data to understand the correlation between these various factors. Results of these research shows there is a distinct pattern of clustering of socio-economic characteristics with the city and there is a distinct correlation between age and cost, socio-economic characteristics, and locations of high heat distribution within the city.

Singh, Ridhima↗
DOE OSTI2025

Large field-of-view event-mode camera for high-precision epithermal neutron resonance imaging

A large-area event-mode camera system coupled with a 6 LiF-ZnS:Ag scintillator is applied for neutron resonance imaging (NRI) on the energy-resolved neutron imaging (ERNI) flight path, also known as Flight Path 5 (FP5), at the Los Alamos Neutron Science Center (LANSCE). This novel neutron imaging system, featuring a 120 x 120 mm 2 field of view, efficiently captures resonance information across the entire image in a single acquisition, significantly reducing beam time requirements compared to conventional energy-resolved neutron imaging systems. High-quality neutron radiographs with enhanced spatial resolution are achieved through the reconstruction of neutron events based on observations of individual photons emitted from the scintillator. The system demonstrates reduced background through neutron/gamma discrimination capabilities while maintaining sharpness across a large fields of view. In the measurements presented here, a spatial resolution of approximately 340 μm was achieved using center-of-gravity photon cluster centroiding. We demonstrate the system’s capability for quantitatively determining isotopic distributions in various thin samples, as well as automatically reconstructing complex scenes with overlapping resonances from diverse samples. These results are obtained using standard data analysis tools, despite the relatively slow 6 LiF-ZnS:Ag scintillator, which may not be optimal for absorption resonance detection. The capabilities demonstrated here offer a valuable, versatile, and cost-effective solution for high spatial and temporal resolution, large field-of-view energy-resolved neutron imaging, with potential applications across various scientific and industrial domains.

36 MATERIALS SCIENCE↗
DOE OSTI2020

The Atacama Cosmology Telescope: arcminute-resolution maps of 18 000 square degrees of the microwave sky from ACT 2008–2018 data combined with Planck

This paper presents a maximum-likelihood algorithm for combining sky maps with disparate sky coverage, angular resolution and spatially varying anisotropic noise into a single map of the sky. We use this to merge hundreds of individual maps covering the 2008–2018 ACT observing seasons, resulting in by far the deepest ACT maps released so far. We also combine the maps with the full Planck maps, resulting in maps that have the best features of both Planck and ACT: Planck’s nearly white noise on intermediate and large angular scales and ACT’s high-resolution and sensitivity on small angular scales. The maps cover over 18 000 square degrees, nearly half the full sky, at 100, 150 and 220 GHz. Furthermore, they reveal 4 000 optically-confirmed clusters through the Sunyaev Zel’dovich effect (SZ) and 18 500 point source candidates at > 5σ, the largest single collection of SZ clusters and millimeter wave sources to date. The multi-frequency maps provide millimeter images of nearby galaxies and individual Milky Way nebulae, and even clear detections of several nearby stars. Other anticipated uses of these maps include, for example, thermal SZ and kinematic SZ cluster stacking, CMB cluster lensing and galactic dust science. The method itself has negligible bias. However, due to the preliminary nature of some of the component data sets, we caution that these maps should not be used for precision cosmological analysis. The maps are part of ACT DR5, and will be made available on LAMBDA no later than three months after the journal publication of this article, along with an interactive sky atlas.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Atacama Cosmology Telescope: Multiprobe cosmology with unWISE galaxies and ACT DR6 CMB lensing

We present a joint analysis of the cosmic microwave background (CMB) lensing power spectra measured from the Data Release 6 of the Atacama Cosmology Telescope (ACT) and Planck PR4, cross-correlations between the ACT and Planck lensing reconstruction and galaxy clustering from unWISE, and the unWISE clustering auto-spectrum. We obtain 1.5% constraints on the matter density fluctuations at late times parametrized by the best constrained parameter combination 𝑆$^{3⁢x⁢2⁢pt}_{8}$ ≡ 𝜎 8 ⁢(Ω 𝑚 /0.3) 0.4 = 0.815 ± 0.012. The commonly used 𝑆 8 ≡ 𝜎 8⁢ (Ω 𝑚 /0.3) 0.5 parameter is constrained to 𝑆 8 = 0.816 ± 0.015. In combination with baryon acoustic oscillation (BAO) measurements we find 𝜎 8 = 0.815 ± 0.012. We also present sound-horizon-independent estimates of the present day Hubble rate of 𝐻 0 = 66.4$^{+3.2}_{−3.7}$ km s −1 Mpc −1 from our large scale structure data alone and 𝐻 0 = 64.3$^{+2.1}_{−2.4}$ km s −1 Mpc −1 in combination with uncalibrated supernovae from Pantheon+. Using parametric estimates of the evolution of matter density fluctuations, we place constraints on cosmic structure in a range of high redshifts typically inaccessible with cross-correlation analyses. Combining lensing cross- and autocorrelations, we derive a 3.3% constraint on the integrated matter density fluctuations above 𝑧 = 2.4, one of the tightest constraints in this redshift range and fully consistent with a Λ cold dark matter (Λ⁢CDM) model fit to the primary CMB from Planck. Finally, combining with primary CMB observations and using the extended low redshift coverage of these combined datasets we derive constraints on a variety of extensions to the Λ⁢CDM model including massive neutrinos, spatial curvature, and dark energy. We find in flat Λ⁢CDM⁢ ∑𝑚 𝜈 < 0.12 eV at 95% confidence using the large scale structure data, BAO measurements from Sloan Digital Sky Survey, and primary CMB observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗
NASA NTRS1981

Evaluating computer-drawn ground-cover maps

Computer-generated character maps from LANDSAT data are compared to aerial photos for test sites in Florida. Report Describes extraction of ground features by two analytical techniques: unsupervised clustering algorithm, called LANDSAT Signature Development Program (LSDP), and interactive algorithm based on multispectral image analyzer. Study concluded that computer classification of digital LANDSAT multispectral data, supplemented with certain ground-cover information, is valuable tool for analysis of renewable resources.

Arvanitis, L. G.↗
NASA NTRS1996

HRI observations of the Pleiades

The preliminary analysis of the data from the first four Rosat high resolution imager (HRI) pointings provided many new faint Pleiades detections. The completion of the high resolution survey of the most source-confused regions of this open cluster will lead to the construction of proper X-ray luminosity functions and will yield a definitive assessment of the coronal emission of the Pleiades members.

Harnden, F. R., Jr.↗