SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
We investigate the ability of the Space Infrared Telescope Facility's Infrared Array Camera to detect distant (z~3) galaxies and measure their photometric redshifts. Our analysis shows that changing the original long wavelength filter specifications provides significant improvements in performance in this and other areas.
ABSTRACT In this paper, we present photometric redshift (photo-z) estimates for the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys, currently the most sensitive optical survey covering the majority of the extragalactic sky. Our photo-z methodology is based on a machine-learning approach, using sparse Gaussian processes augmented with Gaussian mixture models (GMMs) that allow regions of parameter space to be identified and trained separately in a purely data-driven way. The same GMMs are also used to calculate cost-sensitive learning weights that mitigate biases in the spectroscopic training sample. By design, this approach aims to produce reliable and unbiased predictions for all parts of the parameter space present in wide area surveys. Compared to previous literature estimates using the same underlying photometry, our photo-zs are significantly less biased and more accurate at z > 1, with negligible loss in precision or reliability for resolved galaxies at z < 1. Our photo-z estimates offer accurate predictions for rare high-value populations within the parent sample, including optically selected quasars at the highest redshifts (z > 6), as well as X-ray or radio continuum selected populations across a broad range of flux (densities) and redshift. Deriving photo-z estimates for the full Legacy Imaging Surveys Data Release 8, the catalogues provided in this work offer photo-z estimates predicted to be of high quality for ≳9 × 108 galaxies over ${\sim}19\, 400\, \text{deg}^{2}$ and spanning 0 < z ≲ 7, offering one of the most extensive samples of redshift estimates ever produced.
We investigate the potential of submm-mm and submm-mm-radio photometric red-shifts using a sample of mm-selected sources as seen at 250, 350 and 500 micrometers by the SPIRE instrument on Herschel. From a sample of 63 previously identified mm-sources with reliable radio identifications in the GOODS-N and Lockman Hole North fields 46 (73 per cent) are found to have detections in at least one SPIRE band. We explore the observed submm/mm colour evolution with redshift, finding that the colours of mm-sources are adequately described by a modified blackbody with constant optical depth Tau = (nu/nu(0))beta where beta = +1.8 and nu(0) = c/100 micrometers. We find a tight correlation between dust temperature and IR luminosity. Using a single model of the dust temperature and IR luminosity relation we derive photometric redshift estimates for the 46 SPIRE detected mm-sources. Testing against the 22 sources with known spectroscopic, or good quality optical/near-IR photometric, redshifts we find submm/mm photometric redshifts offer a redshift accuracy of |delta z|/(1+z) = 0.16 (less than |delta z| greater than = 0.51). Including constraints from the radio-far IR correlation the accuracy is improved to |delta z|/(1 + z) = 0.15 (less than |delta z| greater than = 0.45). We estimate the redshift distribution of mm-selected sources finding a significant excess at z greater than 3 when compared to 850 micrometer selected samples.
The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will produce several billion photometric redshifts (photo-z's), enabling cosmological analyses to select a subset of galaxies with the most accurate photo-z. For this work, we perform initial redshift fits on Subaru Strategic Program galaxies with deep grizy photometry using Trees for Photo-Z (TPZ) before applying a custom neural network classifier (NNC) tuned to select galaxies with (z phot – z spec )/(1 + z spec ) < 0.10. We consider four cases of training and test sets ranging from an idealized case to using data augmentation to increase the representation of dim galaxies in the training set. Selections made using the NNC yield significant further improvements in outlier fraction and photo-z scatter (σ z ) over those made with typical photo-z uncertainties. As an example, when selecting the best third of the galaxy sample, the NNC achieves a 35% improvement in outlier rate and a 23% improvement in σ z compared to using uncertainties from TPZ. For cosmology and galaxy evolution studies, this method can be tuned to retain a particular sample size or to achieve a desired photo-z accuracy; our results show that it is possible to retain more than a third of an LSST-like galaxy sample while reducing σ z by a factor of 2 compared to the full sample, with one-fifth as many photo-z outliers. For surveys like LSST that are not limited by shot noise, this method enables a larger number of tomographic redshift bins and hence a significant increase in the total signal to noise of galaxy angular power spectra.
The Southern Photometric Local Universe Survey (S-PLUS) is a novel project that aims to map the Southern Hemisphere using a twelve filter system, comprising five broad-band SDSS-like filters and seven narrow-band filters optimized for important stellar features in the local universe. In this paper we use the photometry and morphological information from the first S-PLUS data release (S-PLUS DR1) cross-matched to unWISE data and spectroscopic redshifts from Sloan Digital Sky Survey DR15. We explore three different machine learning methods (Gaussian Processes with GPz and two Deep Learning models made with TensorFlow) and compare them with the currently used template-fitting method in the S-PLUS DR1 to address whether machine learning methods can take advantage of the twelve filter system for photometric redshift prediction. Using tests for accuracy for both single-point estimates such as the calculation of the scatter, bias, and outlier fraction, and probability distribution functions (PDFs) such as the Probability Integral Transform (PIT), the Continuous Ranked Probability Score (CRPS) and the Odds distribution, we conclude that a deep-learning method using a combination of a Bayesian Neural Network and a Mixture Density Network offers the most accurate photometric redshifts for the current test sample. In conclusion, it achieves single-point photometric redshifts with scatter (σ NMAD ) of 0.023, normalized bias of -0.001, and outlier fraction of 0.64% for galaxies with r_auto magnitudes between 16 and 21.
Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift—the stretching effect in observing the light of far-away galaxies—given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.
We present an optimization method for the assignment of photometric galaxies to a chosen set of redshift bins. This is achieved by combining simulated annealing, an optimization algorithm inspired by solid-state physics, with an unsupervised machine learning method, a self-organizing map (SOM) of the observed colours of galaxies. Starting with a sample of galaxies that is divided into redshift bins based on a photometric redshift point estimate, the simulated annealing algorithm repeatedly reassigns SOM-selected subsamples of galaxies, which are close in colour, to alternative redshift bins. We optimize the clustering cross-correlation signal between photometric galaxies and a reference sample of galaxies with well-calibrated redshifts. Depending on the effect on the clustering signal, the reassignment is either accepted or rejected. By dynamically increasing the resolution of the SOM, the algorithm eventually converges to a solution that minimizes the number of mismatched galaxies in each tomographic redshift bin and thus improves the compactness of their corresponding redshift distribution. This method is demonstrated on the synthetic Legacy Survey of Space and Time cosmoDC2 catalogue. We find a significant decrease in the fraction of catastrophic outliers in the redshift distribution in all tomographic bins, most notably in the highest redshift bin with a decrease in the outlier fraction from 57 percent to 16 percent.
We present a WFC3 F160W (H-band) selected catalog in the CANDELS/GOODS-N field containing photometry from the ultraviolet (UV) to the far-infrared (IR), photometric redshifts and stellar pa-rameters derived from the analysis of the multi-wavelength data. The catalog contains 35,445 sourcesover the 171 arcmin2of the CANDELS F160W mosaic. The 5σdetection limits (within an aperture ofradius 0.′′17) of the mosaic range betweenH= 27.8, 28.2 and 28.7 in the wide, intermediate and deepregions, that span approximately 50%, 15% and 35% of the total area. The multi-wavelength photom-etry includes broad-band data from UV (U band from KPNO and LBC), optical (HST/ACS F435W,F606W, F775W, F814W, and F850LP), near-to-mid IR (HST/WFC3 F105W, F125W, F140W andF160W, Subaru/MOIRCS Ks, CFHT/Megacam K, andSpitzer/IRAC 3.6, 4.5, 5.8, 8.0μm) and far IR(Spitzer/MIPS 24μm, HERSCHEL/PACS 100 and 160μm, SPIRE 250, 350 and 500μm) observations.In addition, the catalog also includes, optical medium-band data (R∼50) in 25 consecutive bands,λ= 500 to 950 nm, from the SHARDS survey and WFC3 IR spectroscopic observations with theG102 and G141 grisms (R∼210 and 130). The use of higher spectral resolution data to estimate pho-tometric redshifts provides very high, and nearly uniform, precision fromz= 0−2.5. The comparisonto 1,485 good quality spectroscopic redshifts up toz∼3 yields ∆z/(1+zspec)=0.0032 and an outlierfraction ofη=4.3%. In addition to the multi-band photometry, we release added-value catalogs withemission line fluxes, stellar masses, dust attenuations, UV- and IR-based star formation rates andrest-frame colors.
ABSTRACT Knowing the redshift of galaxies is one of the first requirements of many cosmological experiments, and as it is impossible to perform spectroscopy for every galaxy being observed, photometric redshift (photo-z) estimations are still of particular interest. Here, we investigate different deep learning methods for obtaining photo-z estimates directly from images, comparing these with ‘traditional’ machine learning algorithms which make use of magnitudes retrieved through photometry. As well as testing a convolutional neural network (CNN) and inception-module CNN, we introduce a novel mixed-input model that allows for both images and magnitude data to be used in the same model as a way of further improving the estimated redshifts. We also perform benchmarking as a way of demonstrating the performance and scalability of the different algorithms. The data used in the study comes entirely from the Sloan Digital Sky Survey (SDSS) from which 1 million galaxies were used, each having 5-filtre (ugriz) images with complete photometry and a spectroscopic redshift which was taken as the ground truth. The mixed-input inception CNN achieved a mean squared error (MSE) =0.009, which was a significant improvement ($30{{\ \rm per\ cent}}$) over the traditional random forest (RF), and the model performed even better at lower redshifts achieving a MSE = 0.0007 (a $50{{\ \rm per\ cent}}$ improvement over the RF) in the range of z < 0.3. This method could be hugely beneficial to upcoming surveys, such as Euclid and the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), which will require vast numbers of photo-z estimates produced as quickly and accurately as possible.
ABSTRACT We present measurements of the redshift-dependent clustering of a DESI-like luminous red galaxy (LRG) sample selected from the Legacy Survey imaging data set, and use the halo occupation distribution (HOD) framework to fit the clustering signal. The photometric LRG sample in this study contains 2.7 million objects over the redshift range of 0.4 < z < 0.9 over 5655 deg2. We have developed new photometric redshift (photo-z) estimates using the Legacy Survey DECam and WISE photometry, with σNMAD = 0.02 precision for LRGs. We compute the projected correlation function using new methods that maximize signal-to-noise ratio while incorporating redshift uncertainties. We present a novel algorithm for dividing irregular survey geometries into equal-area patches for jackknife resampling. For a five-parameter HOD model fit using the MultiDark halo catalogue, we find that there is little evolution in HOD parameters except at the highest redshifts. The inferred large-scale structure bias is largely consistent with constant clustering amplitude over time. In an appendix, we explore limitations of Markov chain Monte Carlo fitting using stochastic likelihood estimates resulting from applying HOD methods to N-body catalogues, and present a new technique for finding best-fitting parameters in this situation. Accompanying this paper, we have released the Photometric Redshifts for the Legacy Surveys catalogue of photo-z’s obtained by applying the methods used in this work to the full Legacy Survey Data Release 8 data set. This catalogue provides accurate photometric redshifts for objects with z < 21 over more than 16 000 deg2 of sky.
We present a systematic study of cosmological parameter bias in weak lensing and large-scale structure analyses for upcoming imaging surveys induced by the interplay of intrinsic alignments (IA) and photometric redshift (photo-z) model misspecification error. We first examine the degeneracies between the parameters of the tidal alignment–tidal torquing (TATT) model for IA and of a photo-z model including a mean shift ( Δ z ¯ ) and variance ( σ z ) for each tomographic bin of lenses and sources, under a variety of underlying true IA behaviors. We identify strong degeneracies between: (1) the redshift scaling of the tidal alignment amplitude and the mean shift and variances of source bins, (2) the redshift scaling of the tidal torquing amplitude and the variance of the lowest- z source bin, and (3) the IA source density weighting and the mean shift and variance of several source bins. We then use this information to guide our exploration of the level of cosmological parameter bias which can be induced given incorrect modeling of IA, photo-z, or both. We find that marginalizing over all the parameters of TATT is generally sufficient to preclude cosmological parameter bias in the scenarios we consider. However, this does not necessarily mean that IA and photo-z parameters are themselves unbiased, nor does it mean that the best-fit model is a good fit to the data. We also find scenarios where the inferred parameters produce χ d . o . f . 2 values indicative of a good fit but cosmological parameter bias is significant, particularly when the IA source density weighting parameter is not marginalized over. Published by the American Physical Society 2024
Accurate redshift estimates are a critical requirement for weak lensing surveys and one of the main uncertainties in constraints on dark energy and large-scale cosmic structure. In this paper, we study the potential to calibrate photometric redshift (photo-z) distributions for gravitational lensing using the Dark Energy Spectroscopic Instrument (DESI). Since beginning its science operations in 2021, DESI has collected more than 50 million redshifts, adding about one million monthly. In addition to its large-scale structure samples, DESI has also acquired over 256k high-quality spectroscopic redshifts (spec-zs) in the COSMOS and XMM and VVDS fields. This is already a factor of 3 larger than previous spec-z calibration compilations in these two regions. Here, we explore calibrating photo-zs for the subset of KiDS-1000 galaxies that fall into joint self-organizing map (SOM) cells overlapping the DESI COSMOS footprint using the DESI COSMOS observations. Estimating the redshift distribution in KiDS-1000 with the new DESI data, we find broad consistency with previously published results while also detecting differences in the mean redshift in some tomographic bins with an average shifts of Delta Mean(z) = -0.028 in the mean and Delta Median(z) = +0.011 in the median across tomographic bins. However, we also find that incompleteness per SOM cell, i.e., groups of galaxies with similar colors and magnitudes, can modify n(z) distributions. Finally, we comment on the fact that larger photometric catalogs, aligned with the DESI COSMOS and DESI XMM and VVDS footprints, would be needed to fully exploit the DESI dataset and would extend the coverage to nearly eight times the area of existing 9-band photometry.
Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced forLarge Synoptic Survey Telescope The Rubin Observatory Legacy Survey of Space and Time (lsst) Dark Energy Science Collaboration (desc). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. Additionally, we report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.
ABSTRACT The size–mass galaxy distribution is a key diagnostic for galaxy evolution. Massive compact galaxies are potential surviving relics of a high-redshift phase of star formation. Some of these could be nearly unresolved in Sloan Digital Sky Survey (SDSS) imaging and thus not included in galaxy samples. To overcome this, a sample was selected from the combination of SDSS and UKIRT Infrared Deep Sky Survey (UKIDSS) photometry to r < 17.8. This was done using colour–colour selection, and then by obtaining accurate photometric redshifts (photo-z) using scaled flux matching (SFM). Compared to spectroscopic redshifts (spec-z), SFM obtained a 1σ scatter of 0.0125 with only 0.3 per cent outliers (|Δln (1 + z)| > 0.06). A sample of 163 186 galaxies was obtained with 0.04 < z < 0.15 over $2300\, {\rm deg}^2$ using a combination of spec-z and photo-z. Following Barro et al. log Σ1.5 = log M* − 1.5log r50, maj was used to define compactness. The spectroscopic completeness was 76 per cent for compact galaxies (log Σ1.5 > 10.5) compared to 92 per cent for normal-sized galaxies. This difference is primarily attributed to SDSS ‘fibre collisions’ and not the completeness of the main galaxy sample selection. Using environmental overdensities, this confirms that compact quiescent galaxies are significantly more likely to be found in high-density environments compared to normal-sized galaxies. By comparison with a high-redshift sample from 3D-HST, log Σ1.5 distribution functions show significant evolution, with this being a compelling way to compare with simulations such as EAGLE. The number density of compact quiescent galaxies drops by a factor of about 30 from z ∼ 2 to log (n/Mpc−3) = − 5.3 ± 0.4 in the SDSS–UKIDSS sample. The uncertainty is dominated by the steep cut off in log Σ1.5, which is demonstrated conclusively using this complete sample.
We perform a rigorous cosmology analysis on simulated Type Ia supernovae (SNe Ia) and evaluate the improvement from including photometric host galaxy redshifts compared to using only the "z spec " subset with spectroscopic redshifts from the host or SN. We use the Deep Drilling Fields (~50 deg 2 ) from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC) in combination with a low-z sample based on Data Challenge2. The analysis includes light-curve fitting to standardize the SN brightness, a high-statistics simulation to obtain a bias-corrected Hubble diagram, a statistical+systematics covariance matrix including calibration and photo-z uncertainties, and cosmology fitting with a prior from the cosmic microwave background. Compared to using the z spec subset, including events with SN+host photo-z results in (i) more precise distances for z > 0.5, (ii) a Hubble diagram that extends 0.3 further in redshift, and (iii) a 50% increase in the Dark Energy Task Force figure of merit (FoM) based on the w 0 w a CDM model. Analyzing 25 simulated data samples, the average bias on w 0 and w a is consistent with zero. The host photo-z systematic of 0.01 reduces FoM by only 2% because (i) most z < 0.5 events are in the z spec subset, (ii) the combined SN+host photo-z has ×2 smaller bias, and (iii) the anticorrelation between fitted redshift and color self-corrects distance errors. To prepare for analyzing real data, the next SN Ia cosmology analysis with photo-zs should include non–SN Ia contamination and host galaxy misassociations.
With the advent of deep, all-sky radio surveys, the need for ancillary data to make the most of the new, high-quality radio data from surveys like the Evolutionary Map of the Universe (EMU), GaLactic and Extragalactic All-sky Murchison Widefield Array survey eXtended, Very Large Array Sky Survey, and LOFAR Two-metre Sky Survey is growing rapidly. Radio surveys produce significant numbers of Active Galactic Nuclei (AGNs) and have a significantly higher average redshift when compared with optical and infrared all-sky surveys. Thus, traditional methods of estimating redshift are challenged, with spectroscopic surveys not reaching the redshift depth of radio surveys, and AGNs making it difficult for template fitting methods to accurately model the source. Machine Learning (ML) methods have been used, but efforts have typically been directed towards optically selected samples, or samples at significantly lower redshift than expected from upcoming radio surveys. This work compiles and homogenises a radio-selected dataset from both the northern hemisphere (making use of Sloan Digital Sky Survey optical photometry) and southern hemisphere (making use of Dark Energy Survey optical photometry). We then test commonly used ML algorithms such as k-Nearest Neighbours (kNN), Random Forest, ANNz, and GPz on this monolithic radio-selected sample. We show that kNN has the lowest percentage of catastrophic outliers, providing the best match for the majority of science cases in the EMU survey. We note that the wider redshift range of the combined dataset used allows for estimation of sources up to z = 3 before random scatter begins to dominate. When binning the data into redshift bins and treating the problem as a classification problem, we are able to correctly identify ≈ 76% of the highest redshift sources—sources at redshift z > 2.51 —as being in either the highest bin (z > 2.51) or second highest (z = 2.25).
ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.
Explore the source record for details and available documents.