Engineering Papers⌕ Search

Engineering topics

Silverstein, Eva

Publications and source records attributed to Silverstein, Eva.

At least 19 records

Optimizers for stabilizing likelihood-free inference

A growing number of applications in particle physics and beyond use neural networks as unbinned likelihood ratio estimators applied to real or simulated data. Precision requirements on the inference tasks demand a high-level of stability from these networks, which are affected by the stochastic nature of training. We show how physics concepts can be used to stabilize network training through a physics-inspired optimizer. In particular, the energy conserving descent (ECD) optimization framework uses classical Hamiltonian dynamics on the space of network parameters to reduce the dependence on the initial conditions while also stabilizing the result near the minimum of the loss function. We develop a version of this optimizer known as , which has few free hyperparameters with limited ranges guided by physical reasoning. We apply to representative likelihood-ratio estimation tasks in particle physics and find on average that it out-performs the widely used Adam optimizer. We expect that ECD will be a useful tool for wide array of data-limited problems, where it is computationally expensive to exhaustively optimize hyperparameters and mitigate fluctuations with ensembling.

Monte Carlo methods↗

Microcanonical Hamiltonian Monte Carlo

We develop Microcanonical Hamiltonian Monte Carlo (MCHMC), a class of models that follow fixed energy Hamiltonian dynamics, in contrast to Hamiltonian Monte Carlo (HMC), which follows canonical distribution with different energy levels. MCHMC tunes the Hamiltonian function such that the marginal of the uniform distribution on the constant-energy-surface over the momentum variables gives the desired target distribution. We show that MCHMC requires occasional energy-conserving billiard-like momentum bounces for ergodicity, analogous to momentum resampling in HMC. We generalize the concept of bounces to a continuous version with partial direction preserving bounces at every step, which gives energy-conserving underdamped Langevin-like dynamics with non-Gaussian noise (MCLMC). MCHMC and MCLMC exhibit favorable scalings with condition number and dimensionality. We develop an efficient hyperparameter tuning scheme that achieves high performance and consistently outperforms NUTS HMC on several standard benchmark problems, in some cases by orders of magnitude.

97 MATHEMATICS AND COMPUTING↗

Snowmass Theory Frontier: Astrophysics and Cosmology

We summarize progress made in theoretical astrophysics and cosmology over the past decade and areas of interest for the coming decade. This Report is prepared as the TF09 "Astrophysics and Cosmology" topical group summary for the Theory Frontier as part of the Snowmass 2021 process.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Drifting oscillations in axion monodromy

In this paper, we study the pattern of oscillations in the primordial power spectrum in axion monodromy inflation, accounting for drifts in the oscillation period that can be important for comparing to cosmological data. In these models the potential energy has a monomial form over a super-Planckian field range, with superimposed modulations whose size is model-dependent. The amplitude and frequency of the modulations are set by the expectation values of moduli fields. We show that during the course of inflation, the diminishing energy density can induce slow adjustments of the moduli, changing the modulations. We provide templates capturing the effects of drifting moduli, as well as drifts arising in effective field theory models based on softly broken discrete shift symmetries, and we estimate the precision required to detect a drifting period. A non-drifting template suffices over a wide range of parameters, but for the highest frequencies of interest, or for sufficiently strong drift, it is necessary to include parameters characterizing the change in frequency over the e-folds visible in the CMB. Finally, we use these templates to perform a preliminary search for drifting oscillations in a part of the parameter space in the Planck nominal mission data.

79 ASTRONOMY AND ASTROPHYSICS↗

Productive interactions: heavy particles and non-Gaussianity

We analyze the shape and amplitude of oscillatory features in the primordial power spectrum and non-Gaussianity induced by periodic production of heavy degrees of freedom coupled to the inflaton Φ. We find that non-adiabatic production of particles can contribute effects which are detectable or constrainable using cosmological data even if their time-dependent masses are always heavier than the scale Φ 1/2 , much larger than the Hubble scale. This provides a new role for UV completion, consistent with the criteria from effective field theory for when heavy fields cannot be integrated out. This analysis is motivated in part by the structure of axion monodromy, and leads to an additional oscillatory signature in a subset of its parameter space. At the level of a quantum field theory model that we analyze in detail, the effect arises consistently with radiative stability for an interesting window of couplings up to of order ≲ 1. The amplitude of the bispectrum and higher-point functions can be larger than that for Resonant Non-Gaussianity, and its signal/noise may be comparable to that of the corresponding oscillations in the power spectrum (and even somewhat larger within a controlled regime of parameters). Its shape is distinct from previously analyzed templates, but was partly motivated by the oscillatory equilateral searches performed recently by the Planck collaboration. As a result, we also make some general comments about the challenges involved in making a systematic study of primordial non-Gaussianity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Testing Inflation with Large Scale Structure: Connecting Hopes with Reality

The statistics of primordial curvature fluctuations are our window into the period of inflation, where these fluctuations were generated. To date, the cosmic microwave background has been the dominant source of information about these perturbations. Large-scale structure is, however, from where drastic improvements should originate. In this paper, we explain the theoretical motivations for pursuing such measurements and the challenges that lie ahead. In particular, we discuss and identify theoretical targets regarding the measurement of primordial non-Gaussianity. We argue that when quantified in terms of the local (equilateral) template amplitude f$loc\atop{NL}$ (f$eq\atop{NL}$), natural target levels of sensitivity are Δf$loc, eq\atop{NL}$ ≃ 1. We highlight that such levels are within reach of future surveys by measuring 2-, 3- and 4-point statistics of the galaxy spatial distribution. This paper summarizes a workshop held at CITA (University of Toronto) on October 23-24, 2014.

79 ASTRONOMY AND ASTROPHYSICS↗

New solutions with accelerated expansion in string theory

We present concrete solutions with accelerated expansion in string theory, requiring a small, tractable list of stress energy sources. We explain how this construction (and others in progress) evades previous no go theorems for simple accelerating solutions. Our solutions respect an approximate scaling symmetry and realize discrete sequences of values for the equation of state, including one with an accumulation point at w = –1 and another accumulating near w = –1/3 from below. In another class of models, a density of defects generates scaling solutions with accelerated expansion. Here, we briefly discuss potential applications to dark energy phenomenology, and to holography for cosmology.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

New sources of gravitational waves during inflation

We point out that detectable inflationary tensor modes can be generated by particle or string sources produced during inflation, consistently with the requirements for inflation and constraints from scalar fluctuations. We show via examples that this effect can dominate over the contribution from quantum fluctuations of the metric, occurring even when the inflationary potential energy is too low to produce a comparable signal. Thus a detection of tensor modes from inflation does not automatically constitute a determination of the inflationary Hubble scale.

79 ASTRONOMY AND ASTROPHYSICS↗

Anomalous dimensions and non-gaussianity

Here, we analyze the signatures of inflationary models that are coupled to interacting field theories, a basic class of multifield models also motivated by their role in providing dynamically small scales. Near the squeezed limit of the bispectrum, we find a simple scaling behavior determined by operator dimensions, which are constrained by the appropriate unitarity bounds. Specifically, we analyze two simple and calculable classes of examples: conformal field theories (CFTs), and large-N CFTs deformed by relevant time-dependent double-trace operators. Together these two classes of examples exhibit a wide range of scalings and shapes of the bispectrum, including nearly equilateral, orthogonal and local non-Gaussianity in different regimes. Along the way, we compare and contrast the shape and amplitude with previous results on weakly coupled fields coupled to inflation. This signature provides a precision test for strongly coupled sectors coupled to inflation via irrelevant operators suppressed by a high mass scale up to ~ 10 3 times the inflationary Hubble scale.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗