Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Search for a light CP-odd Higgs boson decaying into a pair of τ -leptons in proton-proton collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

This paper reports a search for a light CP-odd scalar resonance with a mass of 20 GeV to 90 GeV in 13 TeV proton-proton collision data with an integrated luminosity of 140 fb -1 collected with the ATLAS detector at the Large Hadron Collider. The analysis assumes the resonance is produced via gluon-gluon fusion and decays into a $τ^+ τ^-$ pair which subsequently decays into a fully leptonic $µ^+ ν_µ \overline{ν}_τ e^- \overline{ν}_ e ν_τ$ or $e^+ ν_e \overline{ν}_τ µ^- \overline{ν}_µ ν_τ$ final state. No significant excess of events above the predicted Standard Model background is observed. The results are interpreted within a favour-aligned two-Higgs-doublet model, and a model independent cross-section interpretation is also given. Upper limits at 95% confidence level between 3.0 pb and 68 pb are set on the cross-section for producing a CP-odd Higgs boson that decays into a $τ^+ τ^-$ pair.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Lossy compression of statistical data using quantum annealer

Abstract We present a new lossy compression algorithm for statistical floating-point data through a representation learning with binary variables. The algorithm finds a set of basis vectors and their binary coefficients that precisely reconstruct the original data. The optimization for the basis vectors is performed classically, while binary coefficients are retrieved through both simulated and quantum annealing for comparison. A bias correction procedure is also presented to estimate and eliminate the error and bias introduced from the inexact reconstruction of the lossy compression for statistical data analyses. The compression algorithm is demonstrated on two different datasets of lattice quantum chromodynamics simulations. The results obtained using simulated annealing show 3–3.5 times better compression performance than the algorithm based on neural-network autoencoder. Calculations using quantum annealing also show promising results, but performance is limited by the integrated control error of the quantum processing unit, which yields large uncertainties in the biases and coupling parameters. Hardware comparison is further studied between the previous generation D-Wave 2000Q and the current D-Wave Advantage system. Our study shows that the Advantage system is more likely to obtain low-energy solutions for the problems than the 2000Q.

97 MATHEMATICS AND COMPUTING↗

Seamless integration of commercial Clouds with ATLAS Distributed Computing

The CERN ATLAS Experiment successfully uses a worldwide dis-tributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data are distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing ser-vices have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4.

97 MATHEMATICS AND COMPUTING↗

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for Higgs Boson and Observation of $Z$ Boson through Their Decay into a Charm Quark-Antiquark Pair in Boosted Topologies in Proton-Proton Collisions at $\sqrt{s}$ = 13 TeV

A search for the standard model (SM) Higgs boson ($H$) produced with transverse momentum ($p_T$) greater than 450 GeV and decaying to a charm quark-antiquark ($c\bar{c}$) pair is presented. The search is performed using proton-proton collision data collected at $\sqrt{s} = 13$ TeV by the CMS experiment at the LHC, corresponding to an integrated luminosity of 138 fb$^{-1}$. Boosted $H \to c\overline{c}$ decay products are reconstructed as a single large-radius jet and identified using a deep neural network charm tagging technique. The method is validated by measuring the $Z \to c\bar{c}$ decay process, which is observed in association with jets at high $p_T$ for the first time with a signal strength of $1.00^{+0.17}_{-0.14}$ (syst)$\pm 0.08$ (theo) $\pm 0.06$ (stat), defined as the ratio of the observed process rate to the SM expectation. The observed (expected) upper limit on $\sigma (H){\cal B}(H \to c\overline{c})$ is set at 47 (39) times the SM prediction at 95\%confidence level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Latent Dirichlet Allocation modeling of environmental microbiomes

Interactions between stressed organisms and their microbiome environments may provide new routes for understanding and controlling biological systems. However, microbiomes are a form of high-dimensional data, with thousands of taxa present in any given sample, which makes untangling the interaction between an organism and its microbial environment a challenge. Here we apply Latent Dirichlet Allocation (LDA), a technique for language modeling, which decomposes the microbial communities into a set of topics (non-mutually-exclusive sub-communities) that compactly represent the distribution of full communities. LDA provides a lens into the microbiome at broad and fine-grained taxonomic levels, which we show on two datasets. In the first dataset, from the literature, we show how LDA topics succinctly recapitulate many results from a previous study on diseased coral species. We then apply LDA to a new dataset of maize soil microbiomes under drought, and find a large number of significant associations between the microbiome topics and plant traits as well as associations between the microbiome and the experimental factors, e.g. watering level. This yields new information on the plant-microbial interactions in maize and shows that LDA technique is useful for studying the coupling between microbiomes and stressed organisms.

59 BASIC BIOLOGICAL SCIENCES↗

Lessons Learned from Ecosystem-Scale Experimental Field Studies (Workshop Report)

Efforts to understand and predict ecosystem responses to environmental change require long-term, large-scale, spatially representative experiments and observations that capture natural variability, test predictive models, and generate transferable knowledge. Such studies are indispensable for unraveling the complexities of terrestrial ecosystems and their responses to disturbances and evolving environmental conditions, while generating the data necessary for developing mechanistic models and predictive tools that inform decision-making processes. Having a rich history of designing and executing large-scale ecosystem experiments, the U.S. Department of Energy’s Environmental System Science program convened a workshop in January 2025 that brought together leaders in the field to distill critical lessons from decades of experience in large-scale experiments. The workshop aimed to (1) provide an ecosystem experiment primer for best practices, thus ensuring a high scientific return on investment for funding agencies, and (2) offer a robust framework for the design and management of future research initiatives. This report synthesizes insights and experiences from workshop participants and is structured to capture the entire research life cycle, from goal setting and design to operations, adaptive management, team dynamics, collaborations, and the often overlooked aspect of decommissioning. By synthesizing decision-making and lessons learned across diverse research approaches, the report aims to provide a template of essential factors to consider when designing successful long-term, large-scale ecosystem experiments.

54 ENVIRONMENTAL SCIENCES↗

Big Data Seismology

The discipline of seismology is based on observations of ground motion that are inherently undersampled in space and time. Our basic understanding of earthquake processes and our ability to resolve 4D Earth structure are fundamentally limited by data volume. Currently, Big Data Seismology is an emergent revolution involving the use of large, data-dense inquiries that is providing new opportunities to make fundamental advances in these areas. This article reviews recent scientific advances enabled by Big Data Seismology through the context of three major drivers: the development of new data-dense sensor systems, improvements in computing, and the development of new types of techniques and algorithms. Each driver is explored in the context of both global and exploration seismology, alongside collaborative opportunities that combine the features of long-duration data collections (common to global seismology) with dense networks of sensors (common to exploration seismology). The review explores some of the unique challenges and opportunities that Big Data Seismology presents, drawing on parallels from other fields facing similar issues. Finally, recent scientific findings enabled by dense seismic data sets are discussed, and we assess the opportunities for significant advances made possible with Big Data Seismology. This review is designed to be a primer for seismologists who are interested in getting up-to-speed with how the Big Data revolution is advancing the field of seismology.

58 GEOSCIENCES↗

Multiscale Temporal Variability of the Global Air‐Sea CO 2 Flux Anomaly

Abstract The global air‐sea CO 2 flux (F) impacts and is impacted by a plethora of climate‐related processes operating at multiple time scales. In bulk mass transfer formulations, F is driven by physico‐ and bio‐chemical factors such as the air‐sea partial pressure difference (∆pCO 2 ), gas transfer velocity, sea surface temperature, and salinity–all varying at multiple time scales. To de‐convolve the impact of these factors on variability in F at different time scales, time‐resolved estimates of F were computed using a global data set assembled between 1988 and 2015. The F anomalies were defined as temporal deviations from the 28‐year time‐averaged value. Spectral analysis revealed four dominant timescales of variability in F–subseasonal, seasonal, interannual, and decadal with relative amplitude differences varying across regions. A second‐order Taylor series expansion was then conducted along these four timescales to separate drivers across differing regions. The analysis showed that on subseasonal timescales, wind speed variability explains some 66% of the global F anomaly and is the dominant driver. On seasonal, interannual, and decadal timescales, the ∆pCO 2 effect controlled by the ∆pCO 2 anomaly, explained much of the F anomaly. On decadal timescales, the F anomaly was almost entirely governed by the ∆pCO 2 effect with large contributions from high latitudes. The main drivers across timescales also dominate the regional F anomaly, particularly in the mid‐high latitude regions. Finally, the driver of the ∆pCO 2 effect was closely connected with the relative strength of atmospheric pCO 2 and the nonthermal component of oceanic pCO 2 anomaly associated with dissolved inorganic carbon and alkalinity.

Environmental Sciences & Ecology↗

Scheduling strategies for the ESPRESSO follow-up of TESS targets

ABSTRACT Radial-velocity follow-up of stars harbouring transiting planets detected by TESS is expected to require very large amounts of expensive telescope time in the next few years. Therefore, scheduling strategies should be implemented to maximize the amount of information gathered about the target planetary systems. We consider myopic and non-myopic versions of a novel uniform-in-phase scheduler, as well as a random scheduler, and compare these scheduling strategies with respect to the bias, accuracy and precision achieved in recovering the mass and orbital parameters of transiting and non-transiting planets. This comparison is carried out based on realistic simulations of radial-velocity follow-up with ESPRESSO of a sample of 50 TESS target stars, with simulated planetary systems containing at least one transiting planet with a radius below 4R⊕. Radial-velocity data sets were generated under reasonable assumptions about their noise component, including that resulting from stellar activity, and analysed using a fully Bayesian methodology. We find the random scheduler leads to a more biased, less accurate, and less precise, estimation of the mass of the transiting exoplanets. No significant differences are found between the results of the myopic and non-myopic implementations of the uniform-in-phase scheduler. With only about 22 radial velocity measurements per data set, our novel uniform-in-phase scheduler enables an unbiased (at the level of 1 per cent) measurement of the masses of the transiting planets, while keeping the average relative accuracy and precision around 16 per cent and 23 per cent, respectively. The number of non-transiting planets detected is similar for all the scheduling strategies considered, as well as the bias, accuracy and precision with which their masses and orbital parameters are recovered.

Cabona, L.↗

Deep learning simulations of the microwave sky

Here we present 500 high-resolution, full-sky millimeter-wave deep learning (DL) simulations that include lensed CMB maps and correlated foreground components. We find that these MillimeterDL simulations can reproduce a wide range of non-Gaussian summary statistics matching the input training simulations, while only being optimized to match the power spectra. The procedure we develop in this work enables the capability to mass produce independent full-sky realizations from a single expensive full-sky simulation, when ordinarily the latter would not provide enough training data. We also circumvent a common limitation of high-resolution DL simulations that they be confined to small sky areas, often due to memory or GPU issues; we do this by developing a “stitching” procedure that can recover the large-scale, high-order statistics and avoid discontinuities or repeated features in the maps. In addition, since our network takes as input a full-sky lensing convergence map, it can in principle take a full-sky lensing convergence map from any large-scale structure (LSS) simulation and generate the corresponding lensed CMB and correlated foreground components at millimeter wavelengths; this is especially useful in the current era of combining results from both CMB and LSS surveys, which require a common set of simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Strategic Energy Management Program Persistence and Cost Effectiveness An Analysis of the SEM Program Landscape

This study examines the relationship between strategic energy management (SEM) programs and their persistence and cost effectiveness, with analysis based on interview data from 24 SEM program administrators, SEM program evaluations, and other reports. The 80 interview questions focused on the topics of program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. The generosity of interview respondents provided a wealth of data, resulting in a report of sufficient length to warrant inclusion of this brief guide of the report structure. The major sections are listed below with brief descriptions. Individual sections of this report are mainly stand-alone and do not require reading of other sections. As a result, there is some duplication between sections, but with differing levels of detail. Executive Summary: Presents three key conclusions of this work with a short description of potential actions to advance the understanding of each key finding. Brief Observations: Lists a large number of bulleted observations resulting from this research, arranged by the five major topic areas included in the interviews. Analysis details are provided in the Analysis of Interview Results section. Foundations for this Research: Provides an overview of SEM, SEM frameworks, SEM programs, the topics of persistence and cost effectiveness, and the focus of this research. Methodology: Details the approach and strategy of this research, providing background information relevant to the formulation of interview questions and the identification of which SEM programs to interview. Observations from Compiled Evaluations and Other Reports: Reports observations from the collection and analysis of program evaluations, annual reports, utility planning documents, and SEM-related white papers. This section, presented in bullet form, highlights challenges in data collection and ultimately a comparison of program practices as they pertain to persistence and cost effectiveness. Analysis of Interview Results: Presents detailed analysis of responses from SEM program administrators, arranged by the five major categories examined: program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. Interview questions are generally grouped together into subsections when it makes sense to examine them together. SEM Programs Challenge Traditional Cost-Effectiveness Metrics: Details an analysis based on five key factors showing that applying traditional cost-effectiveness metrics to SEM programs is not straightforward. This invites the opportunity to consider whether traditional cost-effectiveness metrics are applicable to SEM programs, either individually or at large. Resolution of Research Hypotheses: Tabulates a set of hypotheses that were developed to address the fundamental nature of the research at hand. Analysis of responses to multiple questions informs an understanding of each hypothesis and can be used to better understand the SEM program environment at large.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗

Mitigating Data Center Impact on Grid Stability: A Coordinated Control Strategy Using Verrus StabiliGrid Architecture

Large data centers, which now represent a significant and growing share of the total U.S. grid load, can inadvertently destabilize the electrical grid when they disconnect simultaneously during brief voltage disturbances. The July 10, 2024, Eastern Interconnection incident, in which a sub-100-millisecond transmission fault triggered the cascading loss of approximately 1,500 MW of data center load, illustrates this vulnerability. While commercial battery energy storage systems (BESS) deployed in data centers provide device-level fault ride-through per IEEE 1547, they lack coordination with facility protection logic and uninterruptible power supplies (UPS), limiting their effectiveness as grid-stabilizing assets. This report presents the Verrus StabiliGrid architecture, a coordinated control framework that integrates BESS, UPS, and point-of-interconnection (POI) protection settings to enable data centers to ride through both undervoltage and overvoltage grid contingencies without disconnecting. The four-step strategy encompasses: (1) high-resolution power quality monitoring to detect the grid state during events such as undervoltage, overvoltage, underfrequency, and overfrequency; (2) POI protection settings that allow for extended ride-through and grid-connected operation during grid contingencies; (3) grid state-driven autonomous dispatch of assets to improve grid resilience by reducing power draw during undervoltage or absorbing more power during overvoltage events; and (4) coordinated post-recovery dispatch of data center assets to restore firm load to pre-contingency levels. Validated through controller-hardware-in-the-loop (C-HIL) simulations at the National Laboratory of the Rockies, results show grid import restoration to pre-fault levels within 100 milliseconds of voltage recovery. This work advances the ability of data centers to transition from passive, disturbance-sensitive loads to active participants in grid stability, a capability increasingly required by emerging NERC and ERCOT regulatory frameworks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Synthesizing Stellar Populations in South Pole Telescope Galaxy Clusters. I. Ages of Quiescent Member Galaxies at 0.3 < $\textit{z}$ < 1.4

Using stellar population synthesis models to infer star formation histories (SFHs), we analyze photometry and spectroscopy of a large sample of quiescent galaxies that are members of Sunyaev–Zel'dovich (SZ)-selected galaxy clusters across a wide range of redshifts. We calculate stellar masses and mass-weighted ages for 837 quiescent cluster members at 0.3 < $\textit{z}$ < 1.4 using rest-frame optical spectra and the Python-based Prospector framework, from 61 clusters in the SPT-GMOS Spectroscopic Survey (0.3 < $\textit{z}$ < 0.9) and three clusters in the SPT Hi-z cluster sample (1.25 < $\textit{z}$ < 1.4). We analyze spectra of subpopulations divided into bins of redshift, stellar mass, cluster mass, and velocity-radius phase-space location, as well as by creating composite spectra of quiescent member galaxies. We find that quiescent galaxies in our data set sample a diversity of SFHs, with a median formation redshift (corresponding to the lookback time from the redshift of observation to when a galaxy forms 50% of its mass, $t_{50}$) of $\textit{z}$ = 2.8 ± 0.5, which is similar to or marginally higher than that of massive quiescent field and cluster galaxy studies. We also report median age–stellar mass relations for the full sample (age of the universe at $t_{50}$ (Gyr) = 2.52 (±0.04)–1.66 (±0.12) log$_{10}(M/10^{11}M_⊙$)) and recover downsizing trends across stellar mass; we find that massive galaxies in our cluster sample form on aggregate ~0.75 Gyr earlier than lower-mass galaxies. We also find marginally steeper age–mass relations at high redshifts, and report a bigger difference in formation redshifts across stellar mass for fixed environment, relative to formation redshifts across environment for fixed stellar mass.

79 ASTRONOMY AND ASTROPHYSICS↗

Observation of Cosmic-Ray Anisotropy in the Southern Hemisphere with 12 yr of Data Collected by the IceCube Neutrino Observatory

We analyzed the 7.92 × 10 11 cosmic-ray-induced muon events collected by the IceCube Neutrino Observatory from 2011 May 13, when the fully constructed experiment started to take data, to 2023 May 12. This data set provides an up-to-date cosmic-ray arrival direction distribution in the Southern Hemisphere with unprecedented statistical accuracy covering more than a full period length of a solar cycle. Improvements in Monte Carlo event simulation and better handling of year-to-year differences in data processing significantly reduce systematic uncertainties below the level of statistical fluctuations compared to the previously published results. We confirm the observation of a change in the angular structure of the cosmic-ray anisotropy between 10 TeV and 1 PeV, more specifically in the 100–300 TeV energy range. For the first time, we analyzed the angular power spectrum at different energies. The observed variations of the power spectra with energy suggest relatively reduced large-scale features at high energy compared to those of medium and small scales. The large volume of data enhances the statistical significance at higher energies, up to the PeV scale, and smaller angular scales, down to approximately 6° compared to previous findings.

79 ASTRONOMY AND ASTROPHYSICS↗

Core-collapse contamination in photometric samples of Type Ia Supernovae

This is an exciting time for cosmology with type Ia supernovae (SNe Ia). The recentlyconcluded Dark Energy Survey SN programme (DES-SN) has obtained the largest anddeepest high-redshift cosmological SN Ia sample, and the Vera Rubin Observatory isexpected to observe at least one order of magnitude more SNe Ia in the next decade.In both these experiments, only a limited fraction (.10 per cent) of the SNe can bespectroscopically classified. This leaves us with large ‘photometric’ SN samples, withthe potential for significant contamination by core-collapse SNe that may bias SN Iacosmological measurements. This thesis demonstrates how this contamination can bemodelled and accounted for in current and future cosmological analyses.First, I present state-of-the-art simulations of the SN universe. These are designedto accurately model the population of SNe Ia, peculiar SNe Ia and core-collapse SNe, aswell as their host galaxies. To improve the diversity and quality of the simulated corecollapseSNe, I build a new library of core-collapse SN templates using spectroscopicand photometric (optical and near-ultraviolet) data of 67 core-collapse SNe from theliterature. I account for our incomplete knowledge of core-collapse SN properties bygenerating a set of SN simulations (rather than a single one), each exploring differentmodelling choices and template libraries. I then characterise selection effects in theDES-SN survey and incorporate them in the simulations, thus obtaining a series ofDES-like simulated SN samples that can be compared to the observed DES-SN data.The agreement between the simulations and data is excellent across many observed SNproperties, including Hubble residuals. These simulations are the first to reproduce theobserved photometric SN and host galaxy properties in high-redshift surveys with no fine-tuning of the input parameters.I use my simulation framework to train and test the performance of SuperNNova,a photometric SN classifier based on recurrent neural networks. I explore differenttraining and validation strategies and show that, across all the DES-SN simulationstested, SuperNNova reduces core-collapse SN contamination to 0.8–3.5 per cent. Ithen show that biases due to contamination on the equation-of-state of dark energy,w, are < 0:008 when using our reference SuperNNova model. This compares to anexpected statistical uncertainty on w from the DES-SN sample of 0:039, thus showing that contamination is not a limiting systematic for the cosmological analysis of theDES-SN sample.The results presented in this thesis are the foundation of the DES SN Ia cosmologicalanalysis; they also provide important implications for the future of SN cosmology,as they demonstrate that contamination is not expected to significantly degrade thecosmological figure of merit of the Rubin SN Ia analysis.

79 ASTRONOMY AND ASTROPHYSICS↗