Final Report - Accelerating cosmological inference for LSST and DESI with neural networks
We describe results, products, papers, and achievement of the DOE AI/ML HEP grant "Accelerating cosmological inference for LSST and DESI with neural networks"
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
We describe results, products, papers, and achievement of the DOE AI/ML HEP grant "Accelerating cosmological inference for LSST and DESI with neural networks"
The opsim4 operations simulation program for the LSST astronomical survey uses a database of seeing values covering the range of times to besimulated. Idescribethe creation of such a database using Dual Image Motion Monitor(DIMM)datacollected at Cerro Pachon from 2004-03-17 to 2019-10-07. In times during which the data overlap, I compare the distribution of DIMM seeing values to the seeing measured in DECamimages,takenatasite 10kmaway. Becauseinstrumentalproblemsinthe DIMMmay indicate unreliablemeasurements,cutsonimagequality(asindicatedby the measured Strehlratio)wereexplored. TheDIMMhassignificantgaps,soImodel thedata(withandwithoutcutsonStrehlratio)andgenerateartificialdatainthegaps according to the model. The model consists of a sinusoidal variation with a period of one year, an autoregressive (AR1) model for variations in mean seeing from one night to the next, and another AR1 model for variations on a 5 minute timescale. I create four databases according to thisprocedure, twobasedonDIMMdatastarting 2006-01-01 (with and without a Strehl ratio cut), and two starting 2009-01-01. I then run opsim simulations using each, and an otherwise identical simulation using the default seeing database, and explore the differences
We perform a rigorous cosmology analysis on simulated Type Ia supernovae (SNe Ia) and evaluate the improvement from including photometric host galaxy redshifts compared to using only the "z spec " subset with spectroscopic redshifts from the host or SN. We use the Deep Drilling Fields (~50 deg 2 ) from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC) in combination with a low-z sample based on Data Challenge2. The analysis includes light-curve fitting to standardize the SN brightness, a high-statistics simulation to obtain a bias-corrected Hubble diagram, a statistical+systematics covariance matrix including calibration and photo-z uncertainties, and cosmology fitting with a prior from the cosmic microwave background. Compared to using the z spec subset, including events with SN+host photo-z results in (i) more precise distances for z > 0.5, (ii) a Hubble diagram that extends 0.3 further in redshift, and (iii) a 50% increase in the Dark Energy Task Force figure of merit (FoM) based on the w 0 w a CDM model. Analyzing 25 simulated data samples, the average bias on w 0 and w a is consistent with zero. The host photo-z systematic of 0.01 reduces FoM by only 2% because (i) most z < 0.5 events are in the z spec subset, (ii) the combined SN+host photo-z has ×2 smaller bias, and (iii) the anticorrelation between fitted redshift and color self-corrects distance errors. To prepare for analyzing real data, the next SN Ia cosmology analysis with photo-zs should include non–SN Ia contamination and host galaxy misassociations.
We present analyses of the early data from Rubin Observatory’s Data Preview 1 (DP1) for the field of the globular cluster 47 Tuc. The DP1 data set for 47 Tuc includes four nights of observations from the Rubin Commissioning Camera (LSSTComCam), covering multiple bands (ugriy). We address challenges of crowding in the inner region of the cluster and toward the SMC in DP1, and demonstrate improved star–galaxy separation by fitting fifth-degree polynomials to the stellar loci in color–color diagrams and applying multidimensional sigma clipping. We compile a catalog of 3576 probable 47 Tuc member stars selected via a combination of isochrone, Gaia proper-motion, and color–color space matched filtering. We explore the sources of photometric scatter in the 47 Tuc color–color sequence, evaluating contributions from various potential sources, including differential extinction within the cluster. Finally, of the 72 well-characterized variables in the field, we recover three known variable stars, including two RR Lyrae and one eclipsing binary, in the coadd-based object catalog, and identify 62 in the difference image-based object catalog. Although the DP1 lightcurves have sparse temporal sampling, they appear to follow the patterns of densely sampled literature lightcurves well. Despite some data limitations for crowded-field stellar analysis, DP1 demonstrates the promising scientific potential for future LSST data releases.
The LSST Commissioning Camera (LSSTComCam) was mounted on the Simonyi Survey Telescope in August 2022 and observed for seven weeks in late 2024 until it was removed from the telescope in December 2024. It is a smaller, fully functional version of LSSTCam, with only the central raft of 9 4k x 4k CCDs (all ITL sensors) and comprising 144 megapixels. Every CCD has 16 amplifiers, each reading 1 million pixels. LSSTComCam was designed to enable end-to-end testing of the observatory’s systems, including data acquisition, image processing, and observatory operations.
The LSST Camera is the sole instrument for the NSF-DOE Vera C. Rubin Observatory and consists of a 3.2 gigapixel focal plane mosaic with in-vacuum controllers, dedicated guider and wavefront CCDs, a three-element corrector whose largest lens is 1.55m in diameter, six optical interference filters covering a 320-1050nm band pass with an out-of-plane filter exchange mechanism, and camera slow control and data acquisition systems capable of digitizing each image in 2 seconds.
We describe our procedure for fitting an astrometric solution in the LSST Data Release Production.
Each LSST Data Release has to be associated with dataset DOIs. This document will describe the motivation and policy for issuing DOIs for Data Releases.
A description of plans for verifying LSST's Calibration Data Products. This document covers our approach to verification element LVV-57, addressing requirement DMS-REQ-0130.
A quantitative review of the key numbers associated with the Legacy Survey of Space and Time (LSST) Alert Stream.
A report on the Fall 2020 state of the LSST Alert Production Pipelines' ability to process deep images in the galactic bulge.
A viewgraph presentation describing delta doping high purity CCD's and CMOS for LSST is shown. The topics include: 1) Overview of JPL s versatile back-surface process for CCDs and CMOS; 2) Application to SNAP and ORION missions; 3) Delta doping as a back-surface electrode for fully depleted LBNL CCDs; 4) Delta doping high purity CCDs for SNAP and ORION; 5) JPL CMP thinning process development; and 6) Antireflection coating process development.
Not Available
Explore the source record for details and available documents.
Understanding the nature of dark energy and dark matter remains one of the fundamental questions in physics today; impacting our understanding of particle physics, cosmology, and possibly theories of gravity. Given the scale and complexity of the next generation of cosmology experiments (e.g., the Rubin Observatory, the Euclid satellite mission, and the Roman space telescope) we are entering an era where statistical noise no longer determines the accuracy to which we can measure cosmological parameters. Our ability to control and correct for systematics will ultimately determine the scientific impact of these experiments. This award addressed the challenge of how we determine what limits the accuracy of our cosmological measures, what techniques are appropriate for measuring and calibrating the properties of galaxies to best constrain cosmological models, how to develop statistical techniques that are insensitive to systematic errors, and how to optimize survey strategies in order to minimize systematics while maximizing the speed at which an experiment can achieve its science objectives. In this final technical report for award DE-SC0011635 we describe a set of open-source frameworks that simulate the characteristics and properties of current and planned cosmology surveys and the application of these frameworks to the development of new methodologies for estimating the properties and distances to galaxies that are robust to noisy and incomplete data.
Explore the source record for details and available documents.
Abstract We evaluate the performance of the Legacy Survey of Space and Time Science Pipelines Difference Image Analysis (DIA) on simulated images. By adding synthetic sources to galaxies on images, we trace the recovery of injected synthetic sources to evaluate the pipeline on images from the Dark Energy Science Collaboration Data Challenge 2. The pipeline performs well, with efficiency and flux accuracy consistent with the signal-to-noise ratio of the input images. We explore different spatial degrees of freedom for the Alard–Lupton polynomial-Gaussian image subtraction kernel and analyze for trade-offs in efficiency versus artifact rate. Increasing the kernel spatial degrees of freedom reduces the artifact rate without loss of efficiency. The flux measurements with different kernel spatial degrees of freedom are consistent. We also here provide a set of DIA flags that substantially filter out artifacts from the DIA source table. We explore the morphology and possible origins of the observed remaining subtraction artifacts and suggest that given the complexity of these artifact origins, a convolution kernel with a set of flexible bases with spatial variation may be needed to yield further improvements.
Special Programs are additional survey areas and/or observing strategies that are driven by specific science goals which build on, or are beyond, the core science pillars of the Wide Fast Deep Main Survey. In order to meet the requirements and enable science related to Special Programs, this document provides recommendations for Rubin Data Management regarding processing and serving data products for Special Programs. Hardware and processing boundaries on the potential diversity of data from Special Programs are discussed along with scenarios in which user-generated processing and data products might be needed to meet Special Programs' science goals.