Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble simulations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Performance assessment of ensembles of in situ workflows under resource constraints

Summary Scientific breakthroughs in biomolecular methods and improvements in hardware technology have shifted from a long‐running simulation to a large set of shorter simulations running simultaneously, called an ensemble. In an ensemble, simulations are usually coupled with analyses of data produced by the simulations. In situ methods can be used to analyze large volumes of data generated by scientific simulations at runtime (i.e., simulations and analyses are performed concurrently). In this work, we study the execution of ensemble‐based simulations paired with in situ analyses using in‐memory staging methods. Using an ensemble of molecular dynamics in situ workflows with multiple simulations and analyses, we first show that collecting traditional metrics such as makespan, instructions per cycle, memory usage, or cache miss ratio is not sufficient to characterize complex behaviors of ensembles. We propose a method to evaluate the performance of ensembles of workflows that captures multiple resource usage aspects: resource efficiency, resource allocation, and resource provisioning. Experimental results demonstrate that the proposed method can effectively distinguish the performance of different component placements in an ensemble with up to 32 ensemble members. By evaluating different co‐location scenarios, our proposed performance indicators demonstrate benefits of co‐locating simulation and coupled analyses within a compute node.

Do, Tu Mai Anh↗
DOE OSTI2022

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗
DOE OSTI2021

Future projections in the climatology of global low-level jets from CORDEX-CORE simulations

The potential changes in the strength and location of five low-level jets (LLJs) located within four Coordinated Regional Climate Downscaling Experiment (CORDEX) domains are examined for present and future climate conditions using an ensemble of simulations conducted with the RegCM4 regional model at a 25 km horizontal grid spacing. Lateral and lower boundary forcing fields are from three General Circulation Models (GCMs), and we analyse a historical period (1995–2014) along with two future periods (2041–2060 and 2080–2099) under the Representative Concentration Pathways 2.6 and 8.5. The RegCM4, as driven by the GCMs, is capable of capturing most of the observed climatological features of the LLJs, both in terms of spatial location and seasonal evolution. Analysis of the influence of global warming on the LLJs shows a consistent strengthening of the jets and a shift in their location under both warming scenarios. The Monsoon and West African westerly LLJs exhibit a northward shift, while the Caribbean and South American LLJs present a westward expansion. The use of an ensemble of high-resolution simulations is found to provide a key element for a robust assessment of changes in LLJs associated with future global warming scenarios.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Amundsen Sea Embayment ice-sheet mass-loss predictions to 2050 calibrated using observations of velocity and elevation change

Mass loss from the Amundsen Sea Embayment of the West Antarctic Ice Sheet is a major contributor to global sea-level rise (SLR) and has been increasing over recent decades. Predictions of future SLR are increasingly modelled using ensembles of simulations within which model parameters and external forcings are varied within credible ranges. Accurately reporting the uncertainty associated with these predictions is crucial in enabling effective planning for, and construction of defences against, rising sea levels. Calibrating model simulations against current observations of ice-sheet behaviour enables the uncertainty to be reduced. Here we calibrate an ensemble of BISICLES ice-sheet model simulations of ice loss from the Amundsen Sea Embayment using remotely sensed observations of surface elevation and ice speed. Each calibration type is shown to be capable of reducing the 90% credibility bounds of predicted contributions to SLR by 34 and 43% respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty in Simulating Twentieth Century West African Precipitation Trends: The Role of Anthropogenic Aerosol Emissions

Anthropogenic aerosol emissions from North America and Europe have strong effects on the decadal variability of the West African monsoon (WAM). Anthropogenic aerosol effective radiative forcing is model dependent, but the impact of such uncertainty on the simulation of long-term WAM variability is unknown. We use an ensemble of simulations with HadGEM3-GC3.1 that span the most recent estimates in simulated anthropogenic aerosol effective radiative forcing. We show that uncertainty in anthropogenic aerosol radiative forcing leads to significant uncertainty at simulating multi-decadal trends in West African precipitation. At the large scale, larger forcing leads to a larger decrease in the interhemispheric temperature gradients, in temperature over both the North Atlantic Ocean and northern Sahara. There are also differences in dynamic changes specific to the WAM (locations of the Saharan heat low and African Easterly Jet, of the strength of the West African westerly jet, and of African Easterly Wave activity). We also assess effects on monsoon precipitation characteristics and temperature. We show that larger aerosol forcing results in a decrease of the number of rainy days and of heavy and extreme precipitation events and warm spells. However, simulated changes in onset and demise dates do not appear to be sensitive to the magnitude of aerosol forcing. Our results demonstrate the importance of reducing the uncertainty in anthropogenic aerosol forcing for understanding and predicting multi-decadal variability in the WAM.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Producing High-fidelity Synthetic Population Ensembles at Scale

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the US via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. Our initial task involves creating ensembles for 17 US metropolitan areas, each consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system comprised of a research cloud, virtual containerization, GPU-enhanced functionality, and a dual API/CLI to interact with UrbanPop’s maturing Likeness Python ecosystem. We observe a reduction in theoretical execution time while maintaining high-fidelity approximations of residential totals by metropolitan area and the demographic characteristics of neighborhoods. We discuss expansion of our approach to produce synthetic population ensembles for the entire US, particularly plans to establish automated workflows for job orchestration to increase computational efficiency, as well as provide outlook for broadening applications of the ensembles.

Gaboardi, James [ORNL] (ORCID:0000000247766826)↗
DOE OSTI2022

Increased Variability of Biomass Burning Emissions in CMIP6 Amplifies Hydrologic Cycle in the CESM2 Large Ensemble

Abstract Historical simulations performed for the Coupled Model Intercomparison Project Phase 6 used biomass burning emissions between 1997 and 2014 containing higher spatial and temporal variability compared to emission inventories specified for earlier years, and compared to emissions used in previous (e.g., CMIP5) simulation intercomparisons. Using the Community Earth System Model version 2 Large Ensemble, we show this increased biomass burning emissions variability leads to amplification of the hydrologic cycle poleward of 40°N. Notably, the high variability of biomass burning emissions leads to increased latent heat fluxes, column‐integrated precipitable water, and precipitation. Greater ocean heat uptake, weaker meridional energy transport from the tropics, greater atmospheric shortwave and longwave absorption, and lower relative humidity act to moderate this hydrologic cycle amplification. Our results suggest it is not only the secular changes (on multidecadal timescales) in biomass burning emissions that impact the hydrologic cycle, but also the shorter timescale variability in emissions.

Heyblom, Kyle B.↗
DOE OSTI2024

How well are hazards associated with derechos reproduced in regional climate simulations?

Abstract. A 15-member ensemble of convection-permitting regional simulations of the fast-moving and destructive derecho of 29–30 June 2012 that impacted the northeastern urban corridor of the USA is presented. This event generated 1100 reports of damaging winds, generated significant wind gusts over an extensive area of up to 500 000 km2, caused several fatalities, and resulted in widespread loss of electrical power. Extreme events such as this are increasingly being used within pseudo-global-warming experiments to examine the sensitivity of historical, societally important events to global climate non-stationarity and how they may evolve as a result of changing thermodynamic and dynamic contexts. As such it is important to examine the fidelity with which such events are described in hindcast experiments. The regional simulations presented herein are performed using the Weather Research and Forecasting (WRF) model. The resulting ensemble is used to explore simulation fidelity relative to observations for wind gust magnitudes, spatial scales of convection (as is manifest in high composite reflectivity, cREF), and both rainfall and hail production as a function of model configuration (microphysics parameterization, lateral boundary conditions (LBCs), start date, use of nudging, compiler choice, damping, and number of vertical levels). We also examine the degree to which each ensemble member differs with respect to key mesoscale drivers of convective systems (e.g., convective available potential energy and vertical wind shear) and critical manifestations of deep convection, e.g., vertical velocities, cold-pool generation, and how those properties relate to the correct characterization of the associated atmospheric hazards (wind gusts and hail). Use of a double-moment, seven-class scheme with number concentrations for all species (including hail and graupel) results in the greatest fidelity of model-simulated wind gusts and convective structure to the observations of this event. All ensemble members, however, fail to capture the intensity of the event in terms of the spatial extent of convection and the production of high near-surface wind gusts. We further show very high sensitivity to the LBCs employed and specifically that simulation fidelity is higher for simulations nested within ERA-Interim compared to ERA5. Excess convective available potential energy (CAPE) in all ensemble members after the derecho passage leads to excess production of convective cells, wind gusts, cREF > 40 dBZ, and precipitation during a frontal passage on the subsequent day. This event proved very challenging to forecast in real time and to reproduce in the 15-member hindcast simulation ensemble presented here. Future work could examine if simulations with other initial and lateral boundary conditions can achieve greater fidelity.

Shepherd, Tristan (ORCID:0000000186276419)↗
DOE OSTI2020

A Novel Modeling Framework for Computationally Efficient and Accurate Real-Time Ensemble Flood Forecasting With Uncertainty Quantification

A novel modeling framework that simultaneously improves accuracy, predictability, and computational efficiency is presented. It embraces the benefits of three modeling techniques integrated together for the first time: surrogate modeling, parameter inference, and data assimilation. The use of polynomial chaos expansion (PCE) surrogates significantly decreases computational time. Parameter inference allows for model faster convergence, reduced uncertainty, and superior accuracy of simulated results. Ensemble Kalman filters assimilate errors that occur during forecasting. To examine the applicability and effectiveness of the integrated framework, we developed 18 approaches according to how surrogate models are constructed, what type of parameter distributions are used as model inputs, and whether model parameters are updated during the data assimilation procedure. We conclude that (1) PCE must be built over various forcing and flow conditions, and in contrast to previous studies, it does not need to be rebuilt at each time step; (2) model parameter specification that relies on constrained, posterior information of parameters (so-called Selected specification) can significantly improve forecasting performance and reduce uncertainty bounds compared to Random specification using prior information of parameters; and (3) no substantial differences in results exist between single and dual ensemble Kalman filters, but the latter better simulates flood peaks. The use of PCE effectively compensates for the computational load added by the parameter inference and data assimilation (up to ~80 times faster). Therefore, the presented approach contributes to a shift in modeling paradigm arguing that complex, high-fidelity hydrologic and hydraulic models should be increasingly adopted for real-time and ensemble flood forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Sensitivity of organized convective storms to model grid spacing in current and future climates

Mesoscale convective systems (MCSs) are complexes of thunderstorms that become organized and cover hundreds of kilometres over several hours. MCSs are prolific rain producers in the tropics and mid-latitudes and are the major cause of warm-season flooding. Traditionally, climate models have difficulties in simulating MCSs partly due to the misrepresentation of complex process interactions that operate across a large range of scales. Significant improvements in simulating MCSs have been found in kilometre-scale models that explicitly simulate deep convection. However, these models operate in the grey zone of turbulent motion and have known deficiencies in simulating small-scale processes (e.g. entrainment, vertical mass transport). Here, we perform mid-latitude idealized ensemble MCS simulations under current and future climate conditions in three atmospheric regimes: hydrostatic (12 km horizontal grid spacing; Δx), non-hydrostatic (Δx = 4, 2 and 1 km) and large eddy scale (Δx = 500 m and 250 m). Our results show a dramatic improvement in simulating MCS precipitation, movement, cold pools, and cloud properties when transitioning from 12 km to 4 km Δx. Decreasing Δx beyond 4 km results in modest improvements except for up- and downdraft sizes, average vertical mass fluxes, and cloud top height and temperature, which continue to change. Most important for climate modelling is that Δx = 4 km simulations reliably capture most MCS climate change signals compared to those of the Δx = 250 m runs. Significantly different climate change signals are found in Δx = 12 km runs that overestimate extreme precipitation changes by up to 100%.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2019

Investigating Sources of Variability and Error in Simulations of Carbon Dioxide in an Urban Region

Greenhouse gas (GHG) emissions estimation methods that use atmospheric trace gas observations, including inverse modeling techniques, perform better when carbon dioxide (CO2) fluxes are more accurately transported and dispersed in the atmosphere by a numerical model. In urban areas, transport and dispersion is particularly difficult to simulate using current mesoscale meteorological models due, in part, to added complexity from surface heterogeneity and fine spatial/temporal scales. It is generally assumed that the errors in GHG estimation methods in urban areas are dominated by errors in transport and dispersion. Other significant errors include, but are not limited to, those from assumed emissions magnitude and spatial distribution. To assess the predictability of simulated trace gas mole fractions in urban observing systems using a numerical weather prediction model, we employ an Eulerian model that combines traditional meteorological variables with multiple passive tracers of atmospheric CO2 from anthropogenic inventories and a biospheric model. The predictability of the Eulerian model is assessed by comparing simulated atmospheric CO2 mole fractions to observations from four in situ tower sites (three urban and one rural) in the Washington DC/Baltimore, MD area for February 2016. Four different gridded fossil fuel emissions inventories along with a biospheric flux model are used to create an ensemble of simulated atmospheric CO2 observations within the model. These ensembles help to evaluate whether the modeled observations are impacted more by the underlying emissions or transport. The spread of modeled observations using the four emission fields indicates the model's ability to distinguish between the different inventories under various meteorological conditions. Overall, the Eulerian model performs well; simulated and observed average CO2 mole fractions agree within 1% when averaged at the three urban sites across the month. However, there can be differences greater than 10% at any given hour, which are attributed to complex meteorological conditions rather than differences in the inventories themselves. On average, the mean absolute error of the simulated compared to actual observations is generally twice as large as the standard deviation of the modeled mole fractions across the four emission inventories. This result supports the assumption, in urban domains, that the predicted mole fraction error relative to observations is dominated by errors in model meteorology rather than errors in the underlying fluxes in winter months. As such, minimizing errors associated with atmospheric transport and dispersion may help improve the performance of GHG estimation models more so than improving flux priors in the winter months. We also find that the errors associated with atmospheric transport in urban domains are not restricted to certain times of day. This suggests that atmospheric inversions should use CO2 observations that have been filtered using meteorological observations rather than assuming that meteorological modeling is most accurate at certain times of day (such as using only mid-afternoon observations).

CO2↗
DOE OSTI2022

Co-scheduling Ensembles of In Situ Workflows

Molecular dynamics (MD) simulations are widely used to study large-scale molecular systems. HPC systems are ideal platforms to run these studies, however, reaching the necessary simulation timescale to detect rare processes is challenging, even with modern supercomputers. To overcome the timescale limitation, the simulation of a long MD trajectory is replaced by multiple short-range simulations that are executed simultaneously in an ensemble of simulations. Analyses are usually co-scheduled with these simulations to efficiently process large volumes of data generated by the simulations at runtime, thanks to in situ techniques. Executing a workflow ensemble of simulations and their in situ analyses requires efficient co- scheduling strategies and sophisticated management of computational resources so that they are not slowing down each other. In this paper, we propose an efficient method to co-schedule simulations and in situ analyses such that the makespan of the workflow ensemble is minimized. We present a novel approach to allocate resources for a workflow ensemble under resource constraints by using a theoretical framework modeling the workflow ensemble’s execution. We evaluate the proposed approach using an accurate simulator based on the WRENCH simulation framework on various workflow ensemble configurations. Results demonstrate the significance of co-scheduling simulations and in situ analyses that couple data together to benefit from data locality, in which inefficient scheduling decisions can lead to slowdown in makespan up to a factor of 30.

Do, Tu Mai Anh↗
DOE OSTI2025

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns

Coupled AI-Simulation workflows are becoming the major workloads for HPC facilities, and their increasing complexity necessitates new tools for performance analysis and prototyping of new in-situ workflows. We present SimAI-Bench, a tool designed to both prototype and evaluate these coupled workflows. In this paper, we use SimAI-Bench to benchmark the data transport performance of two common patterns on the Aurora supercomputer: a one-to-one workflow with co-located simulation and AI training instances, and a many-to-one workflow where a single AI model is trained from an ensemble of simulations. For the one-to-one pattern, our analysis shows that node-local and DragonHPC data staging strategies provide excellent performance compared Redis and Lustre file system. For the many-to-one pattern, we find that data transport becomes a dominant bottleneck as the ensemble size grows. Our evaluation reveals that file system is the optimal solution among the tested strategies for the many-to-one pattern.

Tummalapalli, Harikrishna [Argonne National Labora↗
NASA NTRS2012

New Approaches to Quantifying Transport Model Error in Atmospheric CO2 Simulations

In recent years, much progress has been made in observing CO2 distributions from space. However, the use of these observations to infer source/sink distributions in inversion studies continues to be complicated by difficulty in quantifying atmospheric transport model errors. We will present results from several different experiments designed to quantify different aspects of transport error using the Goddard Earth Observing System, Version 5 (GEOS-5) Atmospheric General Circulation Model (AGCM). In the first set of experiments, an ensemble of simulations is constructed using perturbations to parameters in the model s moist physics and turbulence parameterizations that control sub-grid scale transport of trace gases. Analysis of the ensemble spread and scales of temporal and spatial variability among the simulations allows insight into how parameterized, small-scale transport processes influence simulated CO2 distributions. In the second set of experiments, atmospheric tracers representing model error are constructed using observation minus analysis statistics from NASA's Modern-Era Retrospective Analysis for Research and Applications (MERRA). The goal of these simulations is to understand how errors in large scale dynamics are distributed, and how they propagate in space and time, affecting trace gas distributions. These simulations will also be compared to results from NASA's Carbon Monitoring System Flux Pilot Project that quantified the impact of uncertainty in satellite constrained CO2 flux estimates on atmospheric mixing ratios to assess the major factors governing uncertainty in global and regional trace gas distributions.

Ott, L.↗
DOE OSTI2023

The Role of Atmospheric Noise in Decadal SST Variability

Abstract A substantial role for atmospheric noise in simulations of decadal internal variability of SST is demonstrated by a comparison of a multicentury climate model control and a corresponding interactive ensemble (IE) simulation. The IE is designed to reduce atmospheric noise in the heat flux, wind stress, and freshwater flux at the air–sea interface. This comparison suggests that nearly all SST variability on decadal time scales is forced by internal atmospheric variability. The results are examined to determine the relative roles of atmospheric surface heat flux noise and ocean dynamics in the decadal volume-averaged heat budget of the upper ocean. The regional heat budgets in two regions, the South Pacific and the midlatitude North Atlantic, show the net atmospheric surface heat flux to be approximately in equilibrium with the ocean dynamics forcing. The IE and control results are used in the equilibrium heat budget approximation to infer the atmospheric heat flux response to SST, as well as the time series of the control atmospheric noise surface heat flux and ocean dynamics forcings for several regions. The South Pacific region SST is found to be primarily forced by the atmospheric noise surface heat flux and the North Atlantic region SST is forced by the ocean dynamics. Similar strengths for the atmospheric heat flux noise and ocean dynamics forcing, with an interdecadal atmospheric heat flux noise time scale and a centennial ocean dynamics time scale, are found for an Atlantic multidecadal variability region SST.

Meteorology & Atmospheric Sciences↗
NASA NTRS1995

Cloud model-based simulation of spaceborne radar observations

Simulations of observations from potential spaceborne radars are made based on storm structure generated from the three-dimensional (3D) Goddard cumulus ensemble model simulation of an intense overland convective system. Five frequencies of 3, 10, 14, 35, and 95 GHz are discussed, but the Tropical Rainfall Measuring Mission precipitation radar sensor frequency (14 GHz) is the focus of this study. Radar reflectives and their attenuation in various atmospheric conditions are studied in this simulation. With the attenuation from cloud and precipitation in the estimation of reflectivity factor (dBZ), the reflectivities in the lower atmosphere in the convective cores are significantly reduced. With spatial resolution of 4 km X 4 km, attenuation at 14 GHz may cause as large as a 20-dBZ difference between the simulated measurements of the peak, Z(sub mp) and near-surface reflectivity, Z(sub ms) in the most intense convective region. The Z(sub mp) occurs at various altitudes depending on the hydrometeor concentrations and their vertical distribution. Despite the significant attenuation in the intense cores, the presence of the rain maximum is easily detected by using information of Z(sub mp). In the stratiform region, the attenuation is quite limited (usually less than 5 dBZ), and the reduction of reflectivity is mostly related to the actual vertical structure of cloud distribution. Since Z(sub ms) suffers severe attenuation and tends to underestimate surface rainfall intensity in convective regions. Z(sub mp) can be more representative for rainfall retrieval in the lower atmosphere in these regions. In the stratiform region where attenuation is negligible, however, Z(sub mp) tends to overestimate surface rainfall and Z(sub ms) is more appropriate for rainfall retrieval. A hybrid technique using a weight between the two rain intensities is tested and found potentially usefull for future applications. The estimated surface rain-rate map based on this hybrid approach captures many of the details of the cloud model rain field but still slightly underestimates the rain-rate maximum.

Yeh, H.-Y. M.↗
DOE OSTI2024

Evaluation of Autoconversion Representation in E3SMv2 Using an Ensemble of Large-Eddy Simulations of Low-Level Warm Clouds

In numerical atmospheric models that treat cloud and rain droplet populations as separate condensate categories, precipitation initiation in warm clouds is often represented by an autoconversion rate (Au), which is the rate of formation of new rain droplets through the collisions of cloud droplets. Being a function of the cloud droplet size distribution (DSD), the local Au is commonly parameterized as a function of DSD moments: cloud droplet number (n c ) and mass (q c ) concentrations. When applied in a large-scale model, the grid-mean Au must also include a correction, or enhancement factor, to account for the horizontal variability of the cloud properties across the model grid. In this study, we evaluate the Au representation in the Energy Exascale Earth System Model version 2 (E3SMv2) climate model using large-eddy simulations (LES), which explicitly resolve cloud droplet spectra, and therefore the local Au, as well as its spatial variability. The analysis of an ensemble of warm low-level cloud cases shows that the E3SMv2 formulation represents the Au reasonably well compared to the horizontally averaged explicitly computed rate from LES. The agreement, however, comes from a combination of an underestimated E3SM-tuned local Au rate and an overestimated subgrid cloud variability enhancement factor. The latter bias is traced to neglecting the horizontal variability of n c and its co-variability with q c in parameterizing the grid-mean Au.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗