Engineering Papers⌕ Search

Engineering topics

Ostdiek, Bryan

Publications and source records attributed to Ostdiek, Bryan.

At least 19 records

Neural embedding: learning the embedding of the manifold of physics data

In this paper, we present a method of embedding physics data manifolds with metric structure into lower dimensional spaces with simpler metrics, such as Euclidean and Hyperbolic spaces. We then demonstrate that it can be a powerful step in the data analysis pipeline for many applications. Using progressively more realistic simulated collisions at the Large Hadron Collider, we show that this embedding approach learns the underlying latent structure. With the notion of volume in Euclidean spaces, we provide for the first time a viable solution to quantifying the true search capability of model agnostic search algorithms in collider physics (i.e. anomaly detection). Finally, we discuss how the ideas presented in this paper can be employed to solve many practical challenges that require the extraction of physically meaningful representations from information in complex high dimensional datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Revealing the Milky Way’s most recent major merger with a Gaia EDR3 catalogue of machine-learned line-of-sight velocities

Machine learning can play a powerful role in inferring missing line-of-sight velocities from astrometry in surveys such as Gaia. In this paper, we apply a neural network to Gaia Early Data Release 3 (EDR3) and obtain line-of-sight velocities and associated uncertainties for ~92 million stars. The network, which takes as input a star’s parallax, angular coordinates, and proper motions, is trained and validated on ~6.4 million stars in Gaia with complete phase-space information. The network’s uncertainty on its velocity prediction is a key aspect of its design; by properly convolving these uncertainties with the inferred velocities, we obtain accurate stellar kinematic distributions. As a first science application, we use the new network-completed catalogue to identify candidate stars that belong to the Milky Way’s most recent major merger, Gaia-Sausage-Enceladus (GSE). We present the kinematic, energy, angular momentum, and spatial distributions of the ~450 000 GSE candidates in this sample, and also study the chemical abundances of those with cross matches to GALAH and APOGEE. Furthermore, the network’s predictive power will only continue to improve with future Gaia data releases as the training set of stars with complete phase-space information grows. This work provides a first demonstration of how to use machine learning to exploit high-dimensional correlations on data to infer line-of-sight velocities, and offers a template for how to train, validate, and apply such a neural network when complete observational data is not available.

79 ASTRONOMY AND ASTROPHYSICS↗

Substructure detection reanalysed: dark perturber shown to be a line-of-sight halo

ABSTRACT Observations of structure at subgalactic scales are crucial for probing the properties of dark matter, which is the dominant source of gravity in the universe. It will become increasingly important for future surveys to distinguish between line-of-sight haloes and subhalos to avoid wrong inferences on the nature of dark matter. We reanalyse a subgalactic structure (in lens JVAS B1938 + 666) that has been previously found using the gravitational imaging technique in galaxy-galaxy lensing systems. This structure has been assumed to be a satellite in the halo of the main lens galaxy. We fit the redshift of the perturber of the system as a free parameter, using the multiplane thin-lens approximation, and find that the redshift of the perturber is $z_\mathrm{int} = 1.42^{+0.10}_{-0.15}$ (with a main lens redshift of z = 0.881). Our analysis indicates that this structure is more massive than the previous result by an order of magnitude. This constitutes the first dark perturber shown to be a line-of-sight halo with a gravitational lensing method.

79 ASTRONOMY AND ASTROPHYSICS↗

Challenges for unsupervised anomaly detection in particle physics

Anomaly detection relies on designing a score to determine whether a particular event is uncharacteristic of a given background distribution. One way to define a score is to use autoencoders, which rely on the ability to reconstruct certain types of data (background) but not others (signals). In this paper, we study some challenges associated with variational autoencoders, such as the dependence on hyperparameters and the metric used, in the context of anomalous signal (top and W) jets in a QCD background. We find that the hyperparameter choices strongly affect the network performance and that the optimal parameters for one signal are non-optimal for another. In exploring the networks, we uncover a connection between the latent space of a variational autoencoder trained using mean-squared-error and the optimal transport distances within the dataset. We then show that optimal transport distances to representative events in the background dataset can be used directly for anomaly detection, with performance comparable to the autoencoders. Whether using autoencoders or optimal transport distances for anomaly detection, we find that the choices that best represent the background are not necessarily best for signal identification. These challenges with unsupervised anomaly detection bolster the case for additional exploration of semi-supervised or alternative approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Deep Set Auto Encoders for Anomaly Detection in Particle Physics

There is an increased interest in model agnostic search strategies for physics beyond the standard model at the Large Hadron Collider. We introduce a Deep Set Variational Autoencoder and present results on the Dark Machines Anomaly Score Challenge. We find that the method attains the best anomaly detection ability when there is no decoding step for the network, and the anomaly score is based solely on the representation within the encoded latent space. This method was one of the top-performing models in the Dark Machines Challenge, both for the open data sets as well as the blinded data sets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

We describe the outcome of a data challenge conducted as part of the Dark Machines (https://www.darkmachines.org) initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims to detect signals of new physics at the Large Hadron Collider (LHC) using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 billion simulated LHC events corresponding to 10\, fb^{-1} 10 f b − 1 of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Image segmentation for analyzing galaxy-galaxy strong lensing systems

The goal of this Letter is to develop a machine learning model to analyze the main gravitational lens and detect dark substructure (subhalos) within simulated images of strongly lensed galaxies. Using the technique of image segmentation, we turn the task of identifying subhalos into a classification problem, where we label each pixel in an image as coming from the main lens, a subhalo within a binned mass range, or neither. Our network is only trained on images with a single smooth lens and either zero or one subhalo near the Einstein ring. On an independent test set with lenses with large ellipticities, quadrupole and octopole moments, and for source apparent magnitudes between 17–25, the area of the main lens is recovered accurately. On average, only 1.3% of the true area is missed and 1.2% of the true area is added to another part of the lens. In addition, subhalos as light as 10 8.5 M ⊙ can be detected if they lie in bright pixels along the Einstein ring. Furthermore, the model is able to generalize to new contexts it has not been trained on, such as locating multiple subhalos with varying masses or more than one large smooth lens.

79 ASTRONOMY AND ASTROPHYSICS↗

Parameter inference from event ensembles and the top-quark mass

One of the key tasks of any particle collider is measurement. In practice, this is often done by fitting data to a simulation, which depends on many parameters. Sometimes, when the effects of varying different parameters are highly correlated, a large ensemble of data may be needed to resolve parameter-space degeneracies. An important example is measuring the top-quark mass, where other physical and unphysical parameters in the simulation must be profiled when fitting the top-quark mass parameter. We compare four different methodologies for top-quark mass measurement: a classical histogram fit similar to one commonly used in experiment augmented by soft-drop jet grooming; a 2D profile likelihood fit with a nuisance parameter; a machine-learning method called DCTR; and a linear regression approach, either using a least-squares fit or with a dense linearly-activated neural network. Despite the fact that individual events are totally uncorrelated, we find that the linear regression methods work most effectively when we input an ensemble of events sorted by mass, rather than training them on individual events. Although all methods provide robust extraction of the top-quark mass parameter, the linear network does marginally best and is remarkably simple. For the top study, we conclude that the Monte-Carlo-based uncertainty on current extractions of the top-quark mass from LHC data can be reduced significantly (by perhaps a factor of 2) using networks trained on sorted event ensembles. More generally, machine learning from ensembles for parameter estimation has broad potential for collider physics measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine Learning the Sixth Dimension: Stellar Radial Velocities from 5D Phase-space Correlations

The Gaia satellite will observe the positions and velocities of over a billion Milky Way stars. In the early data releases, the majority of observed stars do not have complete 6D phase-space information. In this Letter, we demonstrate the ability to infer the missing line-of-sight velocities until more spectroscopic observations become available. Here, we utilize a novel neural network architecture that, after being trained on a subset of data with complete phase-space information, takes in a star's 5D astrometry (angular coordinates, proper motions, and parallax) and outputs a predicted line-of-sight velocity with an associated uncertainty. Working with a mock Gaia catalog, we show that the network can successfully recover the distributions and correlations of each velocity component for stars that fall within ~5 kpc of the Sun. We also demonstrate that the network can accurately reconstruct the velocity distribution of a kinematic substructure in the stellar halo that is spatially uniform, even when it comprises a small fraction of the total star count.

79 ASTRONOMY AND ASTROPHYSICS↗

Chasing Accreted Structures within Gaia DR2 Using Deep Learning

In previous work, we developed a deep neural network classifier that only relies on phase-space information to obtain a catalog of accreted stars based on the second data release of Gaia (DR2). In this paper, we apply two clustering algorithms to identify velocity substructure within this catalog. We focus on the subset of stars with line-of-sight velocity measurements that fall in the range of Galactocentric radii $r\in [6.5,9.5]\,{\rm{kpc}}$ and vertical distances $| z| \lt 3\,{\rm{kpc}}$. Known structures such as Gaia Enceladus and the Helmi stream are identified. The largest previously unknown structure, Nyx, is a vast stream consisting of at least 200 stars in the region of interest. This study displays the power of the machine-learning approach by not only successfully identifying known features but also discovering new kinematic structures that may shed light on the merger history of the Milky Way.

Astronomy & Astrophysics↗

On the ATLAS top mass measurements and the potential for stealth stop contamination

The discovery of the stop — the Supersymmetric partner of the top quark — is a key goal of the physics program enabled by the Large Hadron Collider. Although much of the accessible parameter space has already been probed, all current searches assume the top mass is known. This is relevant for the “stealth stop” regime, which is characterized by decay kinematics that force the final state top quark off its mass shell; such decays would contaminate the top mass measurements. We investigate the resulting bias imparted to the template method based ATLAS approach. A careful recasting of these results shows that effect can be as large as 2.0 GeV, comparable to the current quoted uncertainty on the top mass. Thus, a robust exploration of the stealth stop splinter requires the simultaneous consideration of the impact on the top mass. Additionally, we explore the robustness of the template technique, and point out a simple strategy for improving the methodology implemented for the semi-leptonic channel.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Mass agnostic jet taggers

Searching for new physics in large data sets needs a balance between two competing effects—signal identification vs background distortion. In this work, we perform a systematic study of both single variable and multivariate jet tagging methods that aim for this balance. The methods preserve the shape of the background distribution by either augmenting the training procedure or the data itself. Multiple quantitative metrics to compare the methods are considered, for tagging 2-, 3-, or 4-prong jets from the QCD background. This is the first study to show that the data augmentation techniques of Planing and PCA based scaling deliver similar performance as the augmented training techniques of Adversarial NN and uBoost, but are both easier to implement and computationally cheaper.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dark mesons at the LHC

A new, strongly-coupled “dark” sector could be accessible to LHC searches now. These dark sectors consist of composites formed from constituents that are charged under the electroweak group and interact with the Higgs, but are neutral under Standard Model color. In these scenarios, the most promising target is the dark meson sector, consisting of dark vector-mesons as well as dark pions. In this paper we study dark meson production and decay at the LHC in theories that preserve a global SU(2) dark flavor symmetry. Dark pions — like the pions of QCD — can be pair-produced through resonant dark vector meson production, pp → ρ D → π D π D , and decay in one of two distinct ways: “gaugephobic”, when π D →$f\bar{f}$' generally dominates; or “gaugephilic”, when π D → W + h, Z + h dominates once kinematically open. Unlike QCD, the decay π$^D_0$ → γγ is virtually absent due to the dark flavor symmetry. We recast a vast set of existing LHC searches to determine the current constraints on (and future opportunities for) dark meson production and decay. When m ρD is slightly heavier than 2m π${_D}$ and ρ$^{±,0}_D$ kinetically mixes with the weak gauge bosons, the 8 TeV same-sign lepton search strategy sets the best bound, m π${_D}$ > 500 GeV. Yet, when only the ρ$^0_D$ kinetically mixes with hypercharge, we find the strongest LHC bound is m π${_D}$ > 130 GeV, that is only slightly better than what LEP II achieved two decades ago. We find the relative insensitivity of LHC searches, especially at 13 TeV, can be blamed mainly on their penchant for high mass objects or large missing energy. Dedicated searches would undoubtedly yield substantially improved sensitivity. We provide a GitHub page to speed the implementation of these searches in future LHC analyses. Our findings for dark meson production and decay provide a strong motivation for model-independent searches of the form pp → A → B + C → SM SM + SM SM where the theoretical prejudice is for SM to be a 3rd generation quark or lepton, W, Z, or h.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Magnifying the ATLAS stealth stop splinter: impact of spin correlations and finite widths

In this paper, we recast a “stealth stop” search in the notoriously difficult region of the stop-neutralino Simplified Model parameter space for which m($\tilde{t}$ 1 )-m($\tilde{X}$~$0\atop{1}$)≃m t . The properties of the final state are nearly identical for tops and stops, while the rate for stop pair production is O(10%) of that for $t\overline{t}$. Stop searches away from this stealth region have left behind a “splinter” of open parameter space when m($\overline{t}$ 1 )≃m t . Removing this splinter requires surgical precision: the ATLAS constraint on stop pair production reinterpreted here treats the signal as a contaminant to the measurement of the top pair production cross section using data from s√=7 TeV and 8 TeV in a correlated way to control for some systematic errors. ATLAS fixed m($\tilde{t}$ 1 )≃mtandm($\tilde{X}$~$0\atop{1}$)=1 GeV, implying that a careful recasting of these results into the full m($\tilde{t}$ 1 )-m($\tilde{X}$~$0\atop{1}$) plane is warranted. We find that the parameter space with m($\tilde{X}$~$0\atop{1}$)≲55 GeV is excluded for m($\tilde{t}$ 1 )≃m t — although this search does cover new parameter space, it is unable to fully pull the splinter. Along the way, we review a variety of interesting physical issues in detail: (i) when the two-body width is a good approximation; (ii) how assuming the narrow width approximation affects the total rate; (iii ) how the production rate is affected when the wrong widths are used; (iv ) what role propagating the spin correlations consistently through the multi-body decay chain plays in the limits. In addition, we provide a guide to using MadGraph for implementing the full production including finite width and spin correlation effects, and we survey a variety of pitfalls one might encounter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

(Machine) learning to do more with less

Determining the best method for training a machine learning algorithm is critical to maximizing its ability to classify data. In this paper, we compare the standard “fully supervised” approach (which relies on knowledge of event-by-event truth-level labels) with a recent proposal that instead utilizes class ratios as the only discriminating information provided during training. This so-called “weakly supervised” technique has access to less information than the fully supervised method and yet is still able to yield impressive discriminating power. In addition, weak supervision seems particularly well suited to particle physics since quantum mechanics is incompatible with the notion of mapping an individual event onto any single Feynman diagram. We examine the technique in detail — both analytically and numerically — with a focus on the robustness to issues of mischaracterizing the training samples. Weakly supervised networks turn out to be remarkably insensitive to a class of systematic mismodeling. Furthermore, we demonstrate that the event level outputs for weakly versus fully supervised networks are probing different kinematics, even though the numerical quality metrics are essentially identical. This implies that it should be possible to improve the overall classification ability by combining the output from the two types of networks. For concreteness, we apply this technology to a signature of beyond the Standard Model physics to demonstrate that all these impressive features continue to hold in a scenario of relevance to the LHC. Example code is provided on GitHub.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Improving LHC searches for dark photons using lepton-jet substructure

Collider signals of dark photons are an exciting probe for new gauge forces and are characterized by events with boosted lepton jets. Existing techniques are efficient in searching for muonic lepton jets but due to substantial backgrounds have difficulty constraining lepton jets containing only electrons. This is unfortunate since upcoming intensity frontier experiments are sensitive to dark photon masses which only allow electron decays. Analyzing a recently proposed model of kinetic mixing, with new scalar particles decaying into dark photons, we find that existing techniques for electron jets can be substantially improved. We show that using lepton-jet-substructure variables, in association with a boosted decision tree, improves background rejection, significantly increasing the LHC’s reach for dark photons in this region of parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

750 GeV diphotons from supersymmetry with Dirac gauginos

Motivated by the recent excess in the diphoton invariant mass near 750 GeV, we explore a supersymmetric extension of the Standard Model that includes the minimal set of superpartners as well as additional Dirac partner chiral superfields in the adjoint representation for each gauge group. The bino partner pseudoscalar is identified as the 750 GeV resonance, while superpotential interactions between it and the gluino (wino) partners yield production via gluon fusion (decay to photon pairs) at one-loop. The gauginos and these additional adjoint superpartners are married by a Dirac mass and must also have Majorana masses. While a large wino partner Majorana mass is necessary to explain the excess, the gluino can be approximately Dirac-like, providing benefits consistent with being both “supersoft” (loop corrections to the scalar masses from Dirac gauginos are free of logarithmic enhancements) and “supersafe” (the experimental limits on the squark/gluino masses can be relaxed due to the reduced production rate). Consistency with the measured Standard Model–like Higgs boson mass is imposed, and a numerical exploration of the parameter space is provided. Finally, models that can account for the diphoton excess are additionally characterized by having couplings that can remain perturbative up to very high scales, while remaining consistent with experimental constraints, the Higgs boson mass, and an electroweak scale which is not excessively fine-tuned.

43 PARTICLE ACCELERATORS↗