Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data catalog”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Reconstructing the Stripping History of the Sagittarius Stream with Neural Networks

The Sagittarius (Sgr) Stream is produced by the ongoing disruption of the Sgr dwarf spheroidal (dSph) galaxy and is thought to contain multiple wraps that were stripped during different pericentric passages. In this study, we introduce a neural-network–based method trained on N-body simulations to infer the stripping time of Sgr Stream stars directly from their phase-space coordinates. We combine spectroscopic data from SEGUE, APOGEE DR17, and LAMOST DR7 low-resolution spectroscopic (LRS) survey with Gaia EDR3 astrometry and distance estimates from the latest StarHorse catalog to identify high-quality Sgr Stream members. Applying our method to these stars, we measure a clear metallicity gradient with stripping time, well described by a linear relation with slope ∼0.3 dex Gyr −1 . We further predict the stripping times of globular clusters previously suggested to originate from the Sgr dSph. M 54, Terzan 7, Terzan 8, and Arp 2 exhibit stripping times consistent with being currently bound to the Sgr remnant. Pal 12, Whiting 1, and NGC 2419 are inferred to have been stripped 0.9 ± 0.1, 1.1 ± 0.2, and 2.1 ± 0.2 Gyr ago, respectively. For NGC 4147 and NGC 5634, whose membership in the Sgr system remains uncertain, our analysis suggests stripping times of 1.1 ± 0.4 and 1.1 ± 0.1 Gyr, respectively, if they are ultimately confirmed as genuine Sgr members. These results demonstrate that data-driven models of dynamical stripping histories offer a promising approach for reconstructing the formation and chemical evolution of the Sgr Stream.

79 ASTRONOMY AND ASTROPHYSICS↗

A Unified Photometric Redshift Calibration for Weak Lensing Surveys Using the Dark Energy Spectroscopic Instrument

The effective redshift distribution n(z) of galaxies is a critical component in the study of weak gravitational lensing. Here, we introduce a new method for determining n(z) for weak lensing surveys based on high-quality redshifts and neural-network-based importance weights. Additionally, we present the first unified photometric redshift calibration of the three leading stage-III weak lensing surveys, the Dark Energy Survey (DES), the Hyper Suprime-Cam (HSC) survey, and the Kilo-Degree Survey (KiDS), with state-of-the-art spectroscopic data from the Dark Energy Spectroscopic Instrument (DESI). We verify our method using a new, data-driven approach and obtain n(z) constraints with statistical uncertainties of the order of $σ_z$ ~ 0.01 and smaller. Our analysis is largely independent of previous photometric redshift calibrations and, thus, provides an important cross-check in light of recent cosmological tensions. Overall, we find excellent agreement with previously published results on the DES Y3 and HSC Y1 data sets, while there are some differences on the mean redshift with respect to the previously published KiDS-1000 results. We attribute the latter to mismatches in photometric noise properties in the COSMOS field compared to the wider KiDS self-organizing map-gold catalog. At the same time, the new n(z) estimates for KiDS do not significantly change estimates of cosmic structure growth from cosmic shear. Finally, we discuss how our method can be applied to future weak lensing calibrations with DESI data.

Lange, J. U. [American Univ., Washington, DC (Unit↗

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Characterization of Main-sequence Binaries in the Old Open Cluster NGC 188

The binary fractions of open and globular clusters yield powerful constraints on their dynamical state and evolutionary history. We apply publicly available Bayesian analysis tools to a UBV RIJHK {sub S} photometric catalog of the open cluster NGC 188 to detect and characterize photometric binaries along the cluster main sequence. This technique has the advantage of self-consistently handling photometric errors, missing data in various bandpasses, and star-by-star prior constraints on cluster membership. Simulations are used to verify uncertainties and quantify selection biases in our analysis, illustrating that among binaries with mass ratios >0.5, we recover the binary fraction to better than 7% in the mean, with no significant dependence on binary fraction and a mild dependence on assumed mass-ratio distribution. Using our photometric catalog, we recover the majority (65% ± 11%) of spectroscopically identified main-sequence binaries, including eight of the nine with spectroscopically measured mass ratios. Accounting for incompleteness and systematics, we derive a mass-ratio distribution that rises toward lower mass ratios (within our q > 0.5 analysis domain). We observe a raw binary fraction for solar-type main-sequence stars with mass ratios q > 0.5 of 42% ± 4%, independent of the assumed mass-ratio distribution to within its uncertainties, consistent with literature values for old open clusters but significantly higher than the field solar-type binary fraction. We confirm that the binaries identified by our method are more concentrated than single stars, in agreement with previous studies, and we demonstrate that the binary nature of those candidates that remain unidentified spectroscopically is strongly supported by photometry from Gaia DR2.

79 ASTRONOMY AND ASTROPHYSICS↗

Refining the Census of the Upper Scorpius Association with Gaia

We have refined the census of stars and brown dwarfs in the Upper Sco association (∼10 Myr, ∼145 pc) by (1) updating the selection of candidate members from our previous survey to include the high-precision astrometry from the second data release of Gaia, (2) obtaining spectra of a few hundred candidate members to measure their spectral types and verify their youth, and (3) assessing the membership (largely with Gaia astrometry) of 2020 stars toward Upper Sco that show evidence of youth in this work and previous studies. We arrive at a catalog of 1761 objects that are adopted as members of Upper Sco. The distribution of spectral types among the adopted members is similar to those in other nearby star-forming regions, indicating a similar initial mass function. In previous studies, we have compiled mid-infrared photometry from the Wide-field Infrared Survey Explorer and the Spitzer Space Telescope for members of Upper Sco and used those data to identify the stars that show evidence of circumstellar disks; we present the same analysis for our new catalog of members. As in earlier work, we find that the fraction of members with disks increases with lower stellar masses, ranging from ≲10% for >1 M {sub ⊙} to ∼22% for 0.01–0.3 M {sub ⊙}. Finally, we have estimated the relative ages of Upper Sco and other young associations using their sequences of low-mass stars in M{sub G{sub R{sub P}}} versus G {sub BP} − G {sub RP}. This comparison indicates that Upper Sco is a factor of two younger than the β Pic association (21–24 Myr) according to both nonmagnetic and magnetic evolutionary models.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmological shocks around galaxy clusters: A coherent investigation with DES, SPT & ACT

We search for signatures of cosmological shocks in gas pressure profiles of galaxy clusters using the cluster catalogs from three surveys: the Dark Energy Survey (DES) Year 3, the South Pole Telescope (SPT) SZ survey, and the Atacama Cosmology Telescope (ACT) data releases 4, 5, and 6, and using thermal Sunyaev-Zeldovich (SZ) maps from SPT and ACT. The combined cluster sample contains around $10^5$ clusters with mass and redshift ranges $10^{13.7} < M_{\rm 200m}/M_\odot < 10^{15.5}$ and $0.1 < z < 2$, and the total sky coverage of the maps is $\approx 15,000 \,\,{\rm deg}^2$. We find a clear pressure deficit at $R/R_{\rm 200m}\approx 1.1$ in SZ profiles around both ACT and SPT clusters, estimated at $6\sigma$ significance, which is qualitatively consistent with a shock-induced thermal non-equilibrium between electrons and ions. The feature is not as clearly determined in profiles around DES clusters. We verify that measurements using SPT or ACT maps are consistent across all scales, including in the deficit feature. The SZ profiles of optically selected and SZ-selected clusters are also consistent for higher mass clusters. Those of less massive, optically selected clusters are suppressed on small scales by factors of 2-5 compared to predictions, and we discuss possible interpretations of this behavior. An oriented stacking of clusters -- where the orientation is inferred from the SZ image, the brightest cluster galaxy, or the surrounding large-scale structure measured using galaxy catalogs -- shows the normalization of the one-halo and two-halo terms vary with orientation. Finally, the location of the pressure deficit feature is statistically consistent with existing estimates of the splashback radius.

79 ASTRONOMY AND ASTROPHYSICS↗

Constraining the baryon abundance with the kinematic Sunyaev-Zel’dovich effect: Projected-field detection using Planck , WMAP , and unWISE

The kinematic Sunyaev-Zel'dovich (kSZ) effect -- the Doppler boosting of cosmic microwave background (CMB) photons scattering off free electrons with non-zero line-of-sight velocity -- is an excellent probe of the distribution of baryons in the Universe. In this paper, we measure the kSZ effect due to ionized gas traced by infrared-selected galaxies from the \emph{unWISE} catalog. We employ the "projected-field" kSZ estimator, which does not require spectroscopic galaxy redshifts. To suppress non-kSZ foreground signals associated with the galaxies (e.g., dust emission and thermal SZ), this estimator requires cleaned CMB maps, which we obtain from \emph{Planck} and \emph{WMAP} data. Using a new "asymmetric" estimator that combines different foreground-cleaned CMB maps to maximize the signal-to-noise, we measure the kSZ$^2$-galaxy cross-power spectrum for three subsamples of the \emph{unWISE} galaxy catalog, which peak at mean redshifts $z \approx$ 0.6, 1.1, and 1.5, have average halo mass $\sim 1$-$5\times 10^{13}$ $h^{-1} M_{\odot}$, and in total contain over 500 million galaxies. After marginalizing over CMB lensing contributions, we measure the amplitude of the kSZ signal $A_{\rm kSZ^2} = 0.42 \pm 0.31$, $5.02 \pm 1.01$, and $8.23 \pm 3.23$, for the three subsamples, where $A_{\rm kSZ^2} = 1$ corresponds to our fiducial model. The combined kSZ detection S/N $>$ 5. We discuss possible explanations for the excess kSZ signal associated with the $z \approx 1.1$ sample, and show that foreground contamination in the CMB maps is very unlikely to be the cause. Our measurements illustrate clearly that no baryons are missing on large scales at low redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

A Catalog of Temporally Localized Systematic Deviations in Global Body Wave Travel-Time Measurements

Accurate measurements of the arrival times of seismic waves are crucial for seismological analyses such as robust locations of earthquakes, characterization of seismic sources, and high-fidelity imaging of the Earth’s interior. However, these travel-time measurements can sometimes be contaminated by timing errors at the stations which record this data. In this study, we apply a classical approach, based on identifying time-dependence in measured body wave arrival times, to identify these timing errors in a dataset on the order of 107 individual measurements. We find timing deviations at a subset of the stations in our dataset and document the temporal location, extent, and severity of these errors, finding errors at 83 stations, and impacting ~100,000 measurements. This catalog of deviations may enable future investigators to obtain a more accurate dataset through the implementation of quality control measures to eliminate the contaminated data we have identified.

58 GEOSCIENCES↗

Semisupervised Learning for Seismic Monitoring Applications

The impressive performance that deep neural networks demonstrate on a range of seismic monitoring tasks depends largely on the availability of event catalogs that have been manually curated over many years or decades. However, the quality, duration, and availability of seismic event catalogs vary significantly across the range of monitoring operations, regions, and objectives. Semisupervised learning (SSL) enables learning from both labeled and unlabeled data and provides a framework to leverage the abundance of unreviewed seismic data for training deep neural networks on a variety of target tasks. We apply two SSL algorithms (mean-teacher and virtual adversarial training) as well as a novel hybrid technique (exponential average adversarial training) to seismic event classification to examine how unlabeled data with SSL can enhance model performance. In general, we find that SSL can perform as well as supervised learning with fewer labels. We also observe in some scenarios that almost half of the benefits of SSL are the result of the meaningful regularization enforced through SSL techniques and may not be attributable to unlabeled data directly. Lastly, the benefits from unlabeled data scale with the difficulty of the predictive task when we evaluate the use of unlabeled data to characterize sources in new geographic regions. Finally, in geographic areas where supervised model performance is low, SSL significantly increases the accuracy of source-type classification using unlabeled data.

58 GEOSCIENCES↗

The SAGA Survey. II. Building a Statistical Sample of Satellite Systems around Milky Way–like Galaxies

In this work, we present the Stage II results from the ongoing Satellites Around Galactic Analogs (SAGA) Survey. Upon completion, the SAGA Survey will spectroscopically identify satellite galaxies brighter than M r,o = -12.3 around 100 Milky Way (MW) analogs at z ~ 0.01. In Stage II, we have more than quadrupled the sample size of Stage I, delivering results from 127 satellites around 36 MW analogs with an improved target selection strategy and deep photometric imaging catalogs from the Dark Energy Survey and the Legacy Surveys. We have obtained 25,372 galaxy redshifts, peaking around z = 0.2. These data significantly increase spectroscopic coverage for very low redshift objects in 17 < r o < 20.75 around SAGA hosts, creating a unique data set that places the Local Group in a wider context. The number of confirmed satellites per system ranges from zero to nine and correlates with host galaxy and brightest satellite luminosities. We find that the number and luminosities of MW satellites are consistent with being drawn from the same underlying distribution as SAGA systems. The majority of confirmed SAGA satellites are star-forming, and the quenched fraction increases as satellite stellar mass and projected radius from the host galaxy decrease. Overall, the satellite quenched fraction among SAGA systems is lower than that in the Local Group. We compare the luminosity functions and radial distributions of SAGA satellites with theoretical predictions based on cold dark matter simulations and an empirical galaxy–halo connection model and find that the results are broadly in agreement.

79 ASTRONOMY AND ASTROPHYSICS↗

All-sky Neutrino Point-source Search with IceCube Combined Track and Cascade Data

Despite extensive efforts, discovery of high-energy astrophysical neutrino sources remains elusive. We present an event-level simultaneous maximum likelihood analysis of tracks and cascades using IceCube data collected from 2008 April 6 to 2022 May 23 to search the whole sky for neutrino sources, and using a source catalog, for coincidence of neutrino emission with gamma-ray emission. This is the first time a simultaneous fit of different detection channels is used to conduct a time-integrated all-sky scan with IceCube. Combining all-sky tracks, with superior pointing power and sensitivity in the northern sky, with all-sky cascades, with good energy resolution and sensitivity in the southern sky, we have developed the most sensitive point-source search to date by IceCube that targets the entire sky. The most significant point in the northern sky aligns with NGC 1068, a Seyfert II galaxy, which, from the catalog search, shows a 3.5σ excess over background after accounting for trials. The most significant point in the southern sky does not align with any source in the catalog and is not significant after accounting for trials. A search for the single most significant Gaussian flare at the locations of NGC 1068, PKS 1424+240, and the southern highest-significance point shows results consistent with expectations for steady emission. Notably, this is the first time that a flare shorter than four years has been excluded as being responsible for NGC 1068’s emergence as a neutrino source. Our results show that combining tracks and cascades when conducting neutrino source searches improves sensitivity and can lead to new discoveries.

Abbasi, R. [Loyola University, Chicago, IL (United↗

Two-epoch Orbit Estimation for Wide Binaries Resolved in Hipparcos and Gaia

The Hipparcos catalog and its Double and Multiple System Annex (DMSA) lists 4099 components with individual proper motions and coordinates on the epoch 1991.25. Many of these long-period binary stars are also present in Gaia Data Release 2 (DR2). Using the available relative positions and proper motions separated by 24.25 yr, the equations of relative orbital motion can be solved for the two epoch eccentric anomalies, orbital period, and eccentricity. This method employs elimination of the linear Thiele–Innes unknowns and nonlinear optimization of the remaining condition equations. The quality of these solutions is compromised by the insufficient condition and modest precision of the Hipparcos astrometric data, as revealed by Monte Carlo simulations with artificially perturbed data points. The presence of multiple systems and optical pairs can also perturb the results. Limited experiments with artificial data indicate that useful estimates can be obtained with a 25 yr epoch difference for wide binaries with orbital periods up to ~500 yr. The prospects of this method dramatically improve with the proposed next-generation space astrometry missions such as Gaia-NIR and Theia, especially when additional conditions are included from astrometric or spectroscopic measurements. An ancillary catalog of cross-identification and astrometric information for 1295 double-star pairs cross-matched in Gaia DR2 and Hipparcos is also published.

79 ASTRONOMY AND ASTROPHYSICS↗

Fundamental Parameters of ∼30,000 M dwarfs in LAMOST DR1 Using Data-driven Spectral Modeling

M dwarfs are the most common type of star in the Galaxy, and because of their small size are favored targets for searches of Earth-sized transiting exoplanets. Current and upcoming all-sky spectroscopic surveys, such as the Large Sky Area Multi Fiber Spectroscopic Telescope (LAMOST), offer an opportunity to systematically determine physical properties of many more M dwarfs than has been previously possible. Here, we present new effective temperatures, radii, masses, and luminosities for 29,678 M dwarfs with spectral types M0–M6 in the first data release (DR1) of LAMOST. We derived these parameters from the supervised machine-learning code, The Cannon, trained with 1388 M dwarfs in the Transiting Exoplanet Survey Satellite Cool Dwarf Catalog that were also present in LAMOST with high signal-to-noise ratio (>250) spectra. Our validation tests show that the output parameter uncertainties are strongly correlated with the signal-to-noise of the LAMOST spectra, and we achieve typical uncertainties of 110 K in T{sub eff} (∼3%), 0.065 R{sub ⊙} (∼14%) in radius, 0.054 M{sub ⊙} (∼12%) in mass, and 0.012 L{sub ⊙} (∼20%) in luminosity. The model presented here can be rapidly applied to future LAMOST data releases, significantly extending the samples of well-characterized M dwarfs across the sky using new and exclusively data-based modeling methods.

79 ASTRONOMY AND ASTROPHYSICS↗

Subaru Hyper Suprime-Cam revisits the large-scale environmental dependence on galaxy morphology over 360 deg2 at z = 0.3–0.6

This study investigates the role of large-scale environments on the fraction of spiral galaxies at z = 0.3–0.6 sliced to three redshift bins of Δz = 0.1. Here, we sample 276220 massive galaxies in a limited stellar mass of 5 × 1010 solar mass (~M*) over 360 deg2, as obtained from the Second Public Data Release of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). By combining projected two-dimensional density information (Shimakawa et al. 2021, MNRAS, 503, 3896) and the CAMIRA cluster catalog (Oguri et al. 2018, PASJ, 70, S20), we investigate the spiral fraction across large-scale overdensities and in the vicinity of red sequence clusters. We adopt transfer learning to reduce the cost of labeling spiral galaxies significantly and then perform stacking analysis across the entire field to overcome the limitations of sample size. Here we employ a morphological classification catalog by the Galaxy Zoo Hubble (Willett et al., 2017, MNRAS, 464, 4176) to train the deep learning model. Based on 74103 sources classified as spirals, we find moderate morphology–density relations on a 10 comoving Mpc scale, thanks to the wide-field coverage of HSC-SSP. Clear deficits of spiral galaxies have also been confirmed, in and around 1136 red sequence clusters. Furthermore, we verify whether there is a large-scale environmental dependence on rest-frame u - r colors of spiral galaxies; such a tendency was not observed in our sample.

Astronomy & Astrophysics↗

Transitioning from Stage-III to Stage-IV: cosmology from galaxy×CMB lensing and shear×CMB lensing

ABSTRACT We examine the cosmological constraining power from two cross-correlation probes between galaxy and cosmic microwave background (CMB) surveys: the cross-correlation of lens galaxy density with CMB lensing convergence 〈δgκCMB〉, and source galaxy weak lensing shear with CMB lensing convergence 〈γκCMB〉. These two cross-correlation probes provide an independent cross-check of other large-scale structure constraints and are insensitive to galaxy-only or CMB-only systematic effects. In addition, when combined with other large-scale structure probes, the cross-correlations can break degeneracies in cosmological and nuisance parameters, improving both the precision and robustness of the analysis. In this work, we study how the constraining power of 〈δgκCMB〉 + 〈γκCMB〉 changes from Stage-III (ongoing) to Stage-IV (future) surveys. Given the flexibility in selecting the lens galaxy sample, we also explore systematically the impact on cosmological constraints when we vary the redshift range and magnitude limit of the lens galaxies using mock galaxy catalogs. We find that in our setup, the contribution to cosmological constraints from 〈δgκCMB〉 and 〈γκCMB〉 are comparable in the Stage-III data sets; but in Stage-IV surveys, the noise in 〈δgκCMB〉 becomes subdominant to cosmic variance, preventing 〈δgκCMB〉 to further improve the constraints. This implies that to maximize the cosmological constraints from future 〈δgκCMB〉 + 〈γκCMB〉 analyses, we should focus more on the requirements on 〈γκCMB〉 instead of 〈δgκCMB〉. Furthermore, the selection of the lens sample should be optimized in terms of our ability to characterize its redshift or galaxy bias instead of its number density.

79 ASTRONOMY AND ASTROPHYSICS↗

Identifying TeV Source Candidates among Fermi -LAT Unclassified Blazars

Blazars, in particular the subclass of high synchrotron peaked active galactic nuclei are among the main targets for the present generation of Imaging Atmospheric Cerenkov Telescopes (IACTs), and they will remain of great importance for very high-energy γ-ray science in the era of the Cerenkov Telescope Array (CTA). Observations by IACTs, which have relatively small fields of view (~few degrees), are limited by viewing conditions; therefore, it is important to select the most promising targets to increase the number of detections. The aim of this paper is to search for unclassified blazars among known γ-ray sources from the Fermi Large Area Telescope (LAT) third source catalog that are likely detectable with IACTs or CTA. We use an artificial neural network algorithm and updated analysis of Fermi-LAT data. We found 80 γ-ray source candidates, and for the highest-confidence candidates, we calculate their potential detectability with IACTs and CTA based on an extrapolation of their energy spectra. Follow-up observations of our source candidates could significantly increase the current TeV source population sample and ultimately confirm the efficiency of our algorithm to select TeV sources.

79 ASTRONOMY AND ASTROPHYSICS↗

GALAXY CRUISE: Spiral and ring classifications for bright galaxies at z = 0.01–0.3

Abstract This paper presents a morphology classification catalog of spiral and ring features of 59854 magnitude-limited galaxies (r < 17.8 mag, and additional 628005 subsamples down to r = 20 mag) at z = 0.01–0.3 based on the Third Public Data Release of the Hyper Suprime-Cam Subaru Strategic Program. We employ two deep-learning classifiers to determine the spiral and ring structures separately based on GALAXY CRUISE Data Release 1, which is dedicated to Hyper Suprime-Cam data. The number of spiral and ring galaxies contain 31864 and 8808 sources, respectively, which constitute 53% and 15% of the sample. A notable result of this study is the construction of a large sample of ring galaxies utilizing high-quality imaging data delivered by the Subaru Hyper Suprime-Cam. However, the accurate identification of ring galaxies remains difficult at a limited seeing resolution. Additionally, we confirm that most spiral galaxies are located on the star-forming main sequence, whereas ring galaxies preferentially reside in the green valley at stellar masses of 1010.5–1011 solar mass. Furthermore, decreasing fractions of spiral and ring galaxies are observed toward the centers of the galaxy clusters. The obtained morphology catalog is publicly available on the GALAXY CRUISE website.

Shimakawa, Rhythm (ORCID:0000000344422750)↗

Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams

Abstract We present Lightcurve Anomaly Identification and Similarity Search ( LAISS ), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly Zwicky Transient Facility (ZTF) Alert Stream via the ANTARES broker, identifying a manageable ∼1–5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host galaxy features within a random forest classifier, tagging transients of rare classes ( spectroscopic anomalies), of uncommon host galaxy environments ( contextual anomalies), and of peculiar or interaction-powered phenomena ( behavioral anomalies). Moreover, we demonstrate the power of a low-latency (∼ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host galaxy environments. We use analogs for data-driven discovery, characterization, (re)classification, and imputation in retrospective and real-time searches. To date, we have identified ∼50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to superluminous supernovae (SLSNe), tidal disruption events, SNe IIn, SNe IIb, SNe I-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018 and 2021 and absent from public catalogs (∼1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the “needle in the haystack” in large-volume data streams. Because of its integration with the ANTARES broker, LAISS is built to detect exciting transients in Rubin data.

79 ASTRONOMY AND ASTROPHYSICS↗