Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variability prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

FACETS Dynamical Downscaling Simulations over North America by the CAM-MPAS Variable-Resolution Model

Comprehensive assessment of climate datasets created by statistical or dynamical models is important for effectively communicating model projection and associated uncertainty to stakeholders and decision-makers. The Department of Energy FACETS project aims to foster such communication through development of metrics and their demonstration on a hierarchy of downscaled climate datasets to quantify aspects of climate change projections that are credible, particularly for supporting decisions related to the energy-water-land nexus. As a part of this effort, we have produced a regional climate dataset using the Model for Prediction Across Scales coupled to the Community Atmosphere Model (CAM-MPAS). This global modeling framework is configured with variable-resolution meshes featuring higher resolutions over North America, as well as quasi-uniform resolution meshes across the globe. The variable-resolution configurations allow fine-scale features to be better resolved inside the refinement and interact with global-scale circulations. The dataset includes multiple uniform- (240km and 120km) and variable-resolution (200-50km, 100-25km, and 46-12km) simulations that are designed to be compatible with other regional climate simulations that contribute to the hierarchy of downscaled climate datasets of the project. Furthermore, the dataset consists of simulations for both the present-day (1989-2010) and future (2079-2100) climate and post-processing of the model output has been coordinated across the project for consistency to facilitate common analysis across the hierarchy of datasets. Altogether, this CAM-MPAS model dataset provides a unique opportunity to assess the influence of resolutions and modeling framework on model credibility and climate change projection.

Sakaguchi, Koichi↗

Development of a compressive failure model for carbon fiber composites and associated uncertainties.

An approach to increase the value of carbon fiber for wind turbines blades, and other compressive strength driven designs, is to identify pathways to increase its cost-specific compressive strength. A finite element model has been developed to evaluate the predictiveness of current finite element methods and to lay groundwork for future studies that focus on improving the cost-specific compressive strength. Parametric studies are conducted to understand which uncertainties in the model inputs have the greatest impact on compressive strength predictions. Furthermore, a statistical approach is also presented that enables the micromechanical model, which is deterministic, to efficiently account for statistical variability in the fiber misalignment present in composite materials; especially if the results from the hexagonal and square pack models are averaged. The model was found to agree well with experimental results for a Zoltek PX-35 pultrusion. The sensitivity studies suggest that the fiber packing and the interface shear strength have the greatest impact on compressive strength prediction for the fiber reinforced polymer studied here. Based on the performance of the modeling approach presented in this work, it is deemed sufficient for future work which will seek to identify carbon fiber composites with improved cost-specific compressive strength.

36 MATERIALS SCIENCE↗

Quantifying spatiotemporal variability in occupant exposure to an indoor airborne contaminant with an uncertain source location

Well-mixed zone models are often employed to compute indoor air quality and occupant exposures. While effective, a potential downside to assuming instantaneous, perfect mixing is underpredicting exposures to high intermittent concentrations within a room. When such cases are of concern, more spatially resolved models, like computational-fluid dynamics methods, are used for some or all of the zones. But, these models have higher computational costs and require more input information. A preferred compromise would be to continue with a multi-zone modeling approach for all rooms, but with a better assessment of the spatial variability within a room. Here to do so, we present a quantitative method for estimating a room's spatiotemporal variability, based on influential room parameters. Our proposed method disaggregates variability into the variability in a room's average concentration, and the spatial variability within the room relative to that average. This enables a detailed assessment of how variability in particular room parameters impacts the uncertain occupant exposures. To demonstrate the utility of this method, we simulate contaminant dispersion for a variety of possible source locations. We compute breathing-zone exposure during the releasing (source is active) and decaying (source is removed) periods. Using CFD methods, we found after a 30 minutes release the average standard deviation in the spatial distribution of exposure was approximately 28% of the source average exposure, whereas variability in the different average exposures was lower, only 10% of the total average. We also find that although uncertainty in the source location leads to variability in the average magnitude of transient exposure, it does not have a particularly large influence on the spatial distribution during the decaying period, or on the average contaminant removal rate. By systematically characterizing a room's average concentration, its variability, and the spatial variability within the room important insights can be gained as to how much uncertainty is introduced into occupant exposure predictions by assuming a uniform in-room contaminant concentration. We discuss how the results of these characterizations can improve our understanding of the uncertainty in occupant exposures relative to well-mixed models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Measurements and interpretations of W ± Z production cross-sections in pp collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

Measurements of integrated and differential cross-sections for W ± Z production in proton-proton collisions are presented. The data collected by the ATLAS detector at the Large Hadron Collider from 2015 to 2018 at a centre-of-mass energy of $\sqrt{s}=13$ TeV are used, corresponding to an integrated luminosity of 140 fb −1 . The W ± Z candidate events are reconstructed using leptonic decay modes of the gauge bosons into electrons or muons. The integrated cross-section per lepton flavour for the production of W ± Z is measured in the detector fiducial region with a relative precision of 4%. The measured value is compared with the Standard Model prediction at a precision of up to next-to-next-to-leading-order in QCD and next-to-leading-order in electroweak. Cross-sections for W + Z and W − Z production and their ratio are presented. The W ± Z production is also measured differentially as functions of various kinematic variables, including new observables sensitive to CP-violation effects. All measurements are compared with state-of-the-art Standard Model predictions from fixed-order calculations or Monte Carlo generators based on next-to-leading-order matrix elements interfaced with parton showers. An effective field theory interpretation of the measurements is performed, considering both CP-conserving and CP-violating dimension-6 operators modifying the W ± Z production. In the absence of observed deviations from the Standard Model, limits on CP-conserving Wilson coefficients are extracted using the transverse mass of the W ± Z system. For CP-violating coefficients a machine learning approach is used to construct an observable with enhanced sensitivity to CP-violation effects.

hadron-hadron scattering↗

A multi-dimensional parametric study of variability in multi-phase flow dynamics during geologic CO 2 sequestration accelerated with machine learning

Successful geologic CO 2 storage projects depend on numerical simulations to predict reservoir performance during site selection, injection verification, and post-injection monitoring phases of the project. These numerical simulations solve non-linear sets of coupled partial differential equations, while accounting for multi-phase fluid dynamics on the basis of constitutive equations that are embedded into the solution scheme. As a consequence, individual simulations often require tens to hundreds of hours to complete on high-performance computing clusters. Moreover, laboratory experiments reveal that parametric functions for capillary pressure and relative permeability exhibit substantial variability, even within the same rock type. This combination of computational expense and wide-ranging parametric variability means that there remains substantial uncertainty in the behavior of multi-phase CO 2 -water systems, particularly in the context of feedbacks between relative permeability and capillary pressure. To bridge this knowledge gap, here we develop a novel workflow that utilizes physics-based numerical simulation to train an artificial neural network (ANN) emulator for interrogating the multivariate parameter space that governs both capillary pressure and relative permeability. With this approach, the ANN is trained to emulate both fluid pressure distribution and CO 2 saturation, which are then interrogated quantitatively to generate parametric response surface mappings with high-fidelity resolution. Results from this study initially show that capillary entry pressure is the dominant control on both CO 2 plume geometry and fluid pressure propagation when considering the combined effects of capillary pressure and relative permeability, particularly when phase interference is low and residual CO 2 saturation is high. Moreover, the ANN emulator provides tremendous computational speed-up by computing 2691 individual simulations in several minutes; whereas, the same simulation ensemble would have required ~3 years of simulation time using only physics-based simulation methods (25,000 times speed up).

58 GEOSCIENCES↗

Enhancing Biomass Productivity by Forecast‐Informed Pond Operations

ABSTRACT Microalgal cultivation for biofuels and proteins holds significant promise but faces challenges in achieving economically viable biomass productivity under variable environmental conditions. This study introduces a forecast‐informed pond operation (FIPO) system that uses numerical weather prediction (NWP) ensemble forecasts and the biomass assessment tool (BAT) to optimize daily dilution rates for enhanced biomass production. In contrast to the current practice, where fixed dilution rates are based on operator experience, the FIPO system determines the optimal dilution rate based on future weather forecasts and biomass growth conditions. Our experiments validate the effectiveness of FIPO in both short‐ and long‐term growth scenarios. In short‐term experiments, FIPO increased biomass production by 21.3% compared to batch growth and 7.4% over fixed dilution (60% every 3 days) operations. The NWP forecast‐informed operations achieved biomass production nearly identical to that using perfect weather forecasts, highlighting the accuracy of current NWP forecasts for guiding pond operations. In long‐term experiments, FIPO resulted in biomass production increases of 13.3% and 17.8% compared to two fixed dilution rates (60% every 3 days and 20% daily). These findings underscore the viability of using NWP forecasts to optimize microalgal cultivation systems. By adjusting daily dilution rates in response to forecasted weather, operators can achieve higher biomass yields and mitigate risks associated with environmental variability. This study provides a foundation for future research and practical applications in commercial‐scale microalgal production.

Yan, Hongxiang [Energy and Environment Directorate↗

Preserving isohydricity: vertical environmental variability explains Amazon forest water-use strategies

Abstract Increases in hydrological extremes, including drought, are expected for Amazon forests. A fundamental challenge for predicting forest responses lies in identifying ecological strategies which underlie such responses. Characterization of species-specific hydraulic strategies for regulating water-use, thought to be arrayed along an ‘isohydric–anisohydric’ spectrum, is a widely used approach. However, recent studies have questioned the usefulness of this classification scheme, because its metrics are strongly influenced by environments, and hence can lead to divergent classifications even within the same species. Here, we propose an alternative approach positing that individual hydraulic regulation strategies emerge from the interaction of environments with traits. Specifically, we hypothesize that the vertical forest profile represents a key gradient in drought-related environments (atmospheric vapor pressure deficit, soil water availability) that drives divergent tree water-use strategies for coordinated regulation of stomatal conductance (gs) and leaf water potentials (ΨL) with tree rooting depth, a proxy for water availability. Testing this hypothesis in a seasonal eastern Amazon forest in Brazil, we found that hydraulic strategies indeed depend on height-associated environments. Upper canopy trees, experiencing high vapor pressure deficit (VPD), but stable soil water access through deep rooting, exhibited isohydric strategies, defined by little seasonal change in the diurnal pattern of gs and steady seasonal minimum ΨL. In contrast, understory trees, exposed to less variable VPD but highly variable soil water availability, exhibited anisohydric strategies, with fluctuations in diurnal gs that increased in the dry season along with increasing variation in ΨL. Our finding that canopy height structures the coordination between drought-related environmental stressors and hydraulic traits provides a basis for preserving the applicability of the isohydric-to-anisohydric spectrum, which we show here may consistently emerge from environmental context. Our work highlights the importance of understanding how environmental heterogeneity structures forest responses to climate change, providing a mechanistic basis for improving models of tropical ecosystems.

Forestry↗

Predictability of Localized Plasmonic Responses in Nanoparticle Assemblies

Design of nanoscale structures with desired optical properties is a key task for nanophotonics. In this work, the correlative relationship between local nanoparticle geometries and their plasmonic responses is established using encoder-decoder neural networks. In the im2spec network, the relationship between local particle geometries and local spectra is established via encoding the observed geometries to a small number of latent variables and subsequently decoding into plasmonic spectra; in the spec2im network, the relationship is reversed. Surprisingly, these reduced descriptions allow high-veracity predictions of local responses based on geometries for fixed compositions and surface chemical states. Analysis of the latent space distributions and the corresponding decoded and closest (in latent space) encoded images yields insight into the generative mechanisms of plasmonic interactions in the nanoparticle arrays. Ultimately, this approach creates a path toward determining configurations that yield the spectrum closest to the desired one, paving the way for stochastic design of nanoplasmonic structures.

nanoparticle arrays↗

First Sagittarius A* Event Horizon Telescope Results. I. The Shadow of the Supermassive Black Hole in the Center of the Milky Way

We present the first Event Horizon Telescope (EHT) observations of Sagittarius A* (Sgr A*), the Galactic center source associated with a supermassive black hole. These observations were conducted in 2017 using a global interferometric array of eight telescopes operating at a wavelength of λ = 1.3 mm. The EHT data resolve a compact emission region with intrahour variability. A variety of imaging and modeling analyses all support an image that is dominated by a bright, thick ring with a diameter of 51.8 ± 2.3 μas (68% credible interval). The ring has modest azimuthal brightness asymmetry and a comparatively dim interior. Using a large suite of numerical simulations, we demonstrate that the EHT images of Sgr A* are consistent with the expected appearance of a Kerr black hole with mass ∼4 × 10$^{6}$ M $_{⊙}$, which is inferred to exist at this location based on previous infrared observations of individual stellar orbits, as well as maser proper-motion studies. Our model comparisons disfavor scenarios where the black hole is viewed at high inclination (i > 50°), as well as nonspinning black holes and those with retrograde accretion disks. Our results provide direct evidence for the presence of a supermassive black hole at the center of the Milky Way, and for the first time we connect the predictions from dynamical measurements of stellar orbits on scales of 10$^{3}$–10$^{5}$ gravitational radii to event-horizon-scale images and variability. Furthermore, a comparison with the EHT results for the supermassive black hole M87* shows consistency with the predictions of general relativity spanning over three orders of magnitude in central mass.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparing Calibration Algorithms for the Rapid Characterization of Pretreated Corn Stover Using Near-Infrared Spectroscopy

Rapid characterization of biomass composition is a key enabling technology for biorefineries—the ability to measure the chemical composition of biomass materials entering the biorefinery as well as the composition of key process intermediate streams would allow real-time process control and the development of robust models to predict process performance. The utility of near-infrared (NIR) spectroscopy for rapid characterization requires multivariate algorithms for building calibration models. The most prevalent algorithm used for building calibration models using NIR spectra is the linear modeling algorithm Partial Least Squares Regression (PLS). Nonlinear regression algorithms (which are typically more computationally intensive than linear modeling approaches) have gained popularity in recent years due to their ability to solve a wide variety of classification and regression problems and the dramatic increase in available computational resources. In this work, we demonstrate that a calibration model can predict the composition of corn stover process intermediate samples pretreated with three different treatments—hot water (HW), dilute acid (DA), and deacetylation followed by dilute acid (DDA). We quantitatively compare three different algorithms for building prediction models based on near-infrared spectroscopy—partial least squares (PLS), support vector machines (SVM), and random forests (RF). We demonstrate the utility of improving model performance by accounting for instrument performance variability using repeated measurements of standard materials (e.g., the “repeatability file” strategy) and investigate its performance with nonlinear regression techniques, and we discuss methods for quantifying the uncertainties of specific predictions among the three methods.

09 BIOMASS FUELS↗

The updated ITPA global H-mode confinement database: description and analysis

The multi-machine ITPA Global H-mode Confinement Database has been upgraded with new data from JET with the ITER-like wall and ASDEX Upgrade with the full tungsten wall. This paper describes the new database and presents results of regression analysis to estimate the global energy confinement scaling in H-mode plasmas using a standard power law. Various subsets of the database are considered, focusing on type of wall and divertor materials, confinement regime (all H-modes, ELMy H or ELM-free) and ITER-like constraints. Apart from ordinary least squares, two other, robust regression techniques are applied, which take into account uncertainty on all variables. Regression on data from individual devices shows that, generally, the confinement dependence on density and the power degradation are weakest in the fully metallic devices. Using the multi-machine scalings, predictions are made of the confinement time in a standard ELMy H-mode scenario in ITER. The uncertainty on the scaling parameters is discussed with a view to practically useful error bars on the parameters and predictions. One of the derived scalings for ELMy H-modes on an ITER-like subset is studied in particular and compared to the IPB98(y,2) confinement scaling in engineering and dimensionless form. Transformation of this new scaling from engineering variables to dimensionless quantities is shown to result in large error bars on the dimensionless scaling. Regression analysis in the space of dimensionless variables is therefore proposed as an alternative, yielding acceptable estimates for the dimensionless scaling. The new scaling, which is dimensionally correct within the uncertainties, suggests that some dependencies of confinement in the multi- machine database can be reconciled with parameter scans in individual devices. This includes vanishingly small dependence of confinement on line-averaged density and normalized plasma pressure (β), as well as a noticeable, positive dependence on effective atomic mass and plasma triangularity. Extrapolation of this scaling to ITER yields a somewhat lower confinement time compared to the IPB98(y, 2) prediction, possibly related to the considerably weaker dependence on major radius in the new scaling (slightly above linear). Further studies are needed to compare more flexible regression models with the power law used here. In addition, data from more devices concerning possible ‘hidden variables’ could help to determine their influence on confinement, while adding data in sparsely populated areas of the parameter space may contribute to further disentangling some of the global confinement dependencies in tokamak plasmas.

Database↗

An approach to learn regulation to maximize growth and entropy production rates in metabolism

Elucidating cell regulation remains a challenging task due to the complexity of metabolism and the difficulty of experimental measurements. Here we present a method for prediction of cell regulation to maximize cell growth rate while maintaining the solvent capacity of the cell. Prediction is formulated as an optimization problem using a thermodynamic framework that can leverage experimental data. We develop a formulation and variable initialization procedure that allows for computing solutions of the optimization with an interior point method. The approach is applied to photoheterotrophic growth of Rhodospirilium rubrum using ethanol as a carbon source, which has applications to biosynthesis of ethylene production. Growth is captured as the rate of synthesis of amino acids into proteins, and synthesis of nucleotide triphoshaptes into RNA and DNA. The method predicts regulation that produces a high rate of protein and RNA synthesis while DNA synthesis is reduced close to zero in agreement with production of DNA being turned off for much of the cell cycle.

59 BASIC BIOLOGICAL SCIENCES↗

Local-scale heterogeneity of soil thermal dynamics and controlling factors in a discontinuous permafrost region

In permafrost regions, the strong spatial and temporal variability in soil temperature cannot be explained by the weather forcing only. Understanding the local heterogeneity of soil thermal dynamics and their controls is essential to understand how permafrost systems respond to climate change and to develop process-based models or remote sensing products for predicting soil temperature. In this study, we analyzed soil temperature dynamics and their controls in a discontinuous permafrost region on the Seward Peninsula, Alaska. We acquired one-year temperature time series at multiple depths (at 5 or 10 cm intervals up to 85 cm depth) at 45 discrete locations across a 2.3 km 2 watershed. We observed a larger spatial variability in winter temperatures than that in summer temperatures at all depths, with the former controlling most of the spatial variability in mean annual temperatures. We also observed a strong correlation between mean annual ground temperature at a depth of 85 cm and mean annual or winter season ground surface temperature across the 45 locations. We demonstrate that soils classified as cold, intermediate, or warm using hierarchical clustering of full-year temperature data closely match their co-located vegetation (graminoid tundra, dwarf shrub tundra, and tall shrub tundra, respectively). We show that the spatial heterogeneity in soil temperature is primarily driven by spatial heterogeneity in snow cover, which induces variable winter insulation and soil thermal diffusivity. These effects further extend to the subsequent summer by causing variable latent heat exchanges. Finally, we discuss the challenges of predicting soil temperatures from snow depth and vegetation height alone by considering the complexity observed in the field data and reproduced in a model sensitivity analysis.

54 ENVIRONMENTAL SCIENCES↗

Variability in soil redox response to seasonal flooding in a vernal pond

Vernal ponds are ephemeral landscape features that experience intermittent flooding and drying, leading to variable saturation in underlying soils. Redox potential (E h ) is an important indicator of biogeochemical processes that changes in response to these hydrological shifts; however, high-resolution measurements of E h in variably inundated environments remain sparse. In this study, the responses of soil E h to ponding, drying, and rewetting of a vernal pond were investigated over a 5-month period from late spring through early autumn. Soil E h was measured at 10-min frequencies and at multiple soil depths (2–48 cm below the soil surface) in shallow and deep sections within the seasonally ponded lowland and in unsaturated soils of the surrounding upland. Over the study period, average E h in surface soils (0–8 cm) was oxidizing in the upland (753 ± 79 mV) but relatively reducing in the shallow lowland (369 ± 49 mV) and deep lowland (198 ± 37 mV). Reducing conditions (E h <300 mV) in surface soils prevailed for up to 6 days in the shallow lowland and up to 24 days in the deep lowland after surface water dried out. Intermittent reflooding resulted in multiple shifts between reducing and oxidizing conditions in the shallow lowland while the deep lowland remained reducing following reflooding. Soil E h in the uplands was consistently oxidizing over the study period with transient increases in response to rain events. Reducing conditions in the lowland resulted in greater Fe-oxide dissolution and release of dissolved Fe and P into porewater than in the surrounding uplands. We determined that change in water depth alone was not a good indicator of soil E h , and additional factors such as soil saturation and clay composition should be considered when predicting how E h responds to surface flooding and drying. These findings highlight the spatial and temporal variability of E h within ponds and have implications for how soil processes and ecosystem function are impacted by shifts in hydrology at terrestrial-aquatic interfaces.

54 ENVIRONMENTAL SCIENCES↗

Leveraging Inequality-Constrained Data for Enhanced Liquidus Temperature Prediction in Nuclear Waste Glass Melts

Inequality-constrained data are frequently discarded in engineering, leading to significant information loss in data-scarce domains like glass characterization in nuclear waste vitrification. This paper presents a nonparametric censored-data regression framework based on an l1-norm optimization criterion that leverages slack variables to integrate left-, right-, and interval-constrained observations into training without distributional assumptions. Validated on synthetic data and a Physics-Informed Neural Network (PINN) for predicting liquidus temperature (TL), the method improved R2 from 0.60 to 0.89 and reduced Mean Absolute Error (MAE) by 48% (51.46 to 26.89?rC) on deterministic values. The traditional models failed to satisfy any inequality constraints while the proposed l1-norm PINN satisfies 81.25% of the constraints. The proposed framework effectively extracts actionable information from previously unusable data to enhance predictive accuracy, reduce epistemic uncertainty, and ensure physical consistency in complex industrial applications.

Garcia-Morado, Erick↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

Direct sensitivity analysis on the parameterization of crystal plasticity models

Various methods for calibrating crystal plasticity finite element (CPFE) models lead to non-unique input parameter values, which subsequently introduce uncertainty in the predicted mechanical response. Sensitivity analysis (SA) conducted on crystal plasticity models is used to identify how variability in these parameters contribute to output uncertainty. Traditional SA on CPFE parameters uses simplified surrogate models to save computational time. However, the accuracy of the surrogate models depends on the quantity of training data used, and any modeling error can propagate into the SA results, potentially affecting their reliability. In this work, the elementary effects test (EET) method, a global SA technique using direct CPFE simulations was employed, and the results obtained were compared with the First Order Second Moment (FOSM) method. ExaConstit, an open-source GPU-enabled CPFE code, was used to perform the simulations and direct SA. The EET method was accurately able to capture the non-linear effects of all the input parameters on the output and is a valuable approach for reliably attributing parameter sensitivities in CPFE models. Based on the results, efficient strategies to perform future parameter calibration and SA are discussed. Additionally, the SA trends observed in different single crystal orientations closely mirrored the activity of the slip systems.

Elementary Effects Test↗

Indicator Patterns of Forced Change Learned by an Artificial Neural Network

Abstract Many problems in climate science require the identification of signals obscured by both the “noise” of internal climate variability and differences across models. Following previous work, we train an artificial neural network (ANN) to predict the year of a given map of annual‐mean temperature (or precipitation) from forced climate model simulations. This prediction task requires the ANN to learn forced patterns of change amidst a background of climate noise and model differences. We then apply a neural network visualization technique (layerwise relevance propagation) to visualize the spatial patterns that lead the ANN to successfully predict the year. These spatial patterns thus serve as “reliable indicators” of the forced change. The architecture of the ANN is chosen such that these indicators vary in time, thus capturing the evolving nature of regional signals of change. Results are compared to those of more standard approaches like signal‐to‐noise ratios and multilinear regression in order to gain intuition about the reliable indicators identified by the ANN. We then apply an additional visualization tool (backward optimization) to highlight where disagreements in simulated and observed patterns of change are most important for the prediction of the year. This work demonstrates that ANNs and their visualization tools make a powerful pair for extracting climate patterns of forced change.

54 ENVIRONMENTAL SCIENCES↗