Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “simulator study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Simultaneous measurements of kinetic and scalar energy spectrum time evolution in the Richtmyer–Meshkov instability upon reshock

The Richtmyer–Meshkov instability (Richtmyer, Commun. Pure Appl. Maths , vol. 13, issue 2, 1960, pp. 297–319; Meshkov, Fluid Dyn. , vol. 4, issue 5, 1972, pp. 101–104) of a twice-shocked gas interface is studied using both high spatial resolution single-shot (SS) and lower spatial resolution, time-resolved, high-speed (HS) simultaneous planar laser-induced fluorescence and particle image velocimetry in the Wisconsin Shock Tube Laboratory's vertical shock tube. The initial condition (IC) is a shear layer with broadband diffuse perturbations at the interface between a helium–acetone mixture and argon. This IC is accelerated by a shock of nominal strength Mach number $M = 1.75$ , and then accelerated again by the transmitted shock that reflects off the end wall of the tube. An ensemble of experiments is analysed after reshock while the interface mixing width grows linearly with time. The kinetic and scalar energy spectra and the terms of their evolution equation are calculated and compared between SS and HS experiments. The inertial range scaling of the scalar power spectrum is found to follow Gibson's relation (Gibson, Phys. Fluids , vol. 11, issue 11, 1968, pp. 2316–2327) as a function of Schmidt number when the effective turbulent Schmidt number is used in place of the material Schmidt number that controls equilibrium scaling. Further, the spatially integrated scalar flux follows similar behaviour observed for the kinetic energy in large eddy simulation studies by Zeng et al. ( Phys. Fluids , vol. 30, issue 6, 2018, 064106) while the spatially varying scalar flux exhibits back scatter along the centre of the mixing layer and forward energy transfer in the spike and bubble regions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Covariate Dependent Sparse Functional Data Analysis

This study proposes a method to incorporate covariate information into sparse functional data analysis. The method aims at cases where each subject has a limited number of longitudinal measurements and is associated with static covariates. This research is motivated by several use cases in practice. One representative example is void swelling, a nuclear-specific material degradation mechanism. Void swelling is affected by many covariates, including alloy composition and irradiation type. How to accurately model the complicated joint effects of such covariates on the swelling process is the key to mitigating the effect of swelling and ensuring safe operation. Unlike most of the existing methods, the proposed method can handle high-dimensional covariates with the informative covariate identification procedure and sparse and irregularly spaced measurements, that is, does not require complete or dense observations. The main innovation of the proposed method is that we model the variation coming from covariates and the variation left conditioned on covariates, such that the functional principal component analysis and Gaussian process can be conducted in a unified manner. Further, we also propose a systematic approach to identify important covariates in the hypothesis testing context. The methodology is demonstrated on applications in nuclear engineering and healthcare and simulation studies.

42 ENGINEERING↗

Search for Lightly Ionizing Particles in SuperCDMS and simulation of neutron backgrounds

The Super Cryogenic Dark Matter Search (SuperCDMS) is a direct-detection dark matter search experiment that primarily aims to search for Weakly Interacting Massive Particles (WIMPs) using state-of-the-art solid-state detection technology. During its operation at the Soudan underground laboratory, germanium detectors were operated with high bias voltage mode known as the CDMS low ionization threshold experiment (CDMSlite) to achieve below-keV thresholds. CDMSlite, for being able to measure small energy depositions in detectors, also provides sensitivity to Lightly Ionizing Particles (LIPs) with very small fractional charges. This thesis will discuss an analysis to search LIPs with the data acquired in CDMSlite mode. An important component for LIPs search is the expected energy-deposition distributions for LIPs falling on the CDMSlite detector. In this thesis, a simulation framework to calculate the energy-deposition distributions is developed. This thesis presents first direct-detection limits on the intensity of cosmogenic LIPs with electric charges smaller than e /(3 × 10 5 ) as well as the strongest limits for charges ≤ e /160, with a minimum intensity of 1.36 × 10 -7 cm -2 s -1 sr -1 at charge e /160.In any rare-event search experiment, understanding background is crucial. Neutrons capable of mimicking dark matter signals are a major background for any dark matter search experiment. A simulation study to estimate the neutron background for an India based dark matter search experiment at Jaduguda Underground Science Laboratory (JUSL) is performed. The experiment at JUSL will be the first phase of a proposed Dark matter search at India-based Neutrino Observatory (DINO). It will be a direct detection experiment with primary aims to search for WIMPs as dark matter candidates. In this thesis, we discuss the methodology of estimating neutron flux at JUSL and report the results. The total neutron flux reaching the laboratory above 1 MeV energy threshold is found to be 5.76(±0.69) × 10 -6 cm -2 s -1 . The impact of neutron background on the sensitivity of the experiment to detect dark matter at JUSL is also discussed. The thesis is organized as follows. Chapter 1 provides a brief introduction to the Lightly Ionizing Particle (LIPs). The analysis to search LIPs in SuperCDMS is briefly outlined in the chapter. This chapter also discusses the importance of neutron background estimates in a dark matter search experiment, more specifically, in the context of a proposed India-based dark matter search experiment at Jaduguda Underground Science Laboratory. In Chapter 2, the SuperCDMS experiment is introduced. In Chapter 3, the framework developed to perform simulations for Lightly Ionizing Particles is presented. In Chapter 4, the LIPs search analysis with the CDMSlite data and the results are discussed. In Chapter 5, the simulation of neutron background and the feasibility of dark-matter search at JUSL is discussed. Finally, conclusions from all the results discussed in this thesis are presented in Chapter 6.

Banik, Samir↗

Differential Canard deflection for generation of yawing moment on the X-31 with and without the vertical tail

The feasibility of augmenting the available yaw control power on the X-31 through differential deflection of the canard surfaces was studied as well as the possibility of using differential canard control to stabilize the X-31 with its vertical tail removed. Wind-tunnel tests and the results of departure criteria and linear analysis showed the destabilizing effect of the reduction of the vertical tail on the X-31. Wind-tunnel testing also showed that differential canard deflection was capable of generating yawing moments of roughly the same magnitude as the thrust vectoring vanes currently in place on the X-31 in the post-stall regime. Analysis showed that the X-31 has sufficient aileron roll control power that with the addition of differential canard as a yaw controller, the wind-axis roll accelerations will remain limited by yaw control authority. It was demonstrated, however, that pitch authority may actually limit the maximum roll rate which can be sustained. A drop model flight test demonstrated that coordinated, wind axis rolls could be performed with roll rates as high as 50 deg/sec (full scale equivalent) at 50 deg angle of attack. Another drop model test was conducted to assess the effect of vertical tail reduction, and an analysis of using differential canard deflection to stabilize the tailless X-31 was performed. The results of six-degree-of-freedom, non-linear simulation tests were correlated with the drop model flights. Simulation studies then showed that the tailless X-31 could be controlled at angles of attack at or above 20 deg using differential canard as the only yaw controller.

Whiting, Matthew Robert↗

Effects of Ice Particle Size Vertical Inhomogeneity on the Passive Remote Sensing of Ice Clouds

The solar reflectance bi-spectral (SRBS) and infrared split-window (IRSpW) methods are two of the most popular techniques for passive ice cloud property retrievals from multispectral imagers. Ice clouds are usually assumed to be vertically homogeneous in global operational algorithms based on these methods, although significant vertical variations of ice particle size are typically observed in ice clouds. In this Study we investigate uncertainties in retrieved optical thickness, effective particle size, and ice water path introduced by a homogeneous cloud assumption in both the SRBS and IRSpW methods, and focus on whether the assumption can lead to significant discrepancies between the two methods. The study simulates the upwelling spectral radiance associated with vertically structured clouds and passes the results through representative SRBS and IRSpW retrieval algorithms. Cloud optical thickness is limited to values for which IRSpW retrievals are possible (optical thickness less than about 7). When the ice cloud is optically thin and yet has a significant ice particle size vertical variation, it is found that both methods tend to underestimate the effective radius and ice water path. The reason for the underestimation is the nonlinear dependence of ice particle scattering properties (extinction and single scattering albedo) on the effective radius. Because the nonlinearity effect is stronger in the IRSpW than the SRBS method, the IRSpW-based IWP tends to be smaller than the SRBS counterpart. When the ice cloud is moderately optically thick, the IRSpW method is relatively insensitive to cloud vertical structure and effective radius retrieval is weighted toward smaller ice particle size, while the weighting function makes the SRBS method more sensitive to the ice particle size in the upper portion of the cloud. As a result, when ice particle size increases monotonically toward cloud base, the two methods are in qualitative agreement; in the event that ice particle size decreases toward cloud base, the effective radius and ice water path retrievals based on the SRBS method are substantially larger than those from the IRSpW. The main findings of this Study Suggest that the homogenous cloud assumption can affect the SRBS and IRSpW methods to different extents and, consequently, can lead to significantly different retrievals. Therefore caution should be taken when comparing and combining the ice cloud property retrievals from these two methods.

Zhang, Zhibo↗

Evaluating the design of an earth radiation budget instrument with system simulations. Part 2: Minimization of instantaneous sampling errors for CERES-I

Much of the new record of broadband earth radiation budget satellite measurements to be obtained during the late 1990s and early twenty-first century will come from the dual-radiometer Clouds and Earth's Radiant Energy System Instrument (CERES-I) flown aboard sun-synchronous polar orbiters. Simulation studies conducted in this work for an early afternoon satellite orbit indicate that spatial root-mean-square (rms) sampling errors of instantaneous CERES-I shortwave flux estimates will range from about 8.5 to 14.0 W/m on a 2.5 deg latitude and longitude grid resolution. Rms errors in longwave flux estimates are only about 20% as large and range from 1.5 to 3.5 W/sq m. These results are based on an optimal cross-track scanner design that includes 50% footprint overlap to eliminate gaps in the top-of-the-atmosphere coverage, and a 'smallest' footprint size to increase the ratio in the number of observations lying within to the number of observations lying on grid area boundaries. Total instantaneous measurement error also depends on the variability of anisotropic reflectance and emission patterns and on retrieval methods used to generate target area fluxes. Three retrieval procedures from both CERES-I scanners (cross-track and rotating azimuth plane) are used. (1) The baseline Earth Radiaton Budget Experiment (ERBE) procedure, which assumes that errors due to the use of mean angular dependence models (ADMs) in the radiance-to-flux inversion process nearly cancel when averaged over grid areas. (2) To estimate N, instantaneous ADMs are estimated from the multiangular, collocated observations of the two scanners. These observed models replace the mean models in computation of satellite flux estimates. (3) The scene flux approach, conducts separate target-area retrievals for each ERBE scene category and combines their results using area weighting by scene type. The ERBE retrieval performs best when the simulated radiance field departs from the ERBE mean models by less than 10%. For larger perturbations, both the scene flux and collocation methods produce less error than the ERBE retrieval. The scene flux technique is preferable, however, because it involves fewer restrictive assumptions.

Stowe, Larry↗

Quantifying System Strength From Grid-Forming Resources Using Frequency Scan Approach: Preprint

Current industry practices for quantifying the system strength contribution from grid-forming (GFM) resources to ensure stability of power systems dominated by inverter-based resources (IBRs) are primarily based on iterative electromagnetic transient (EMT) time-domain simulation studies. While feasible, these approaches are resource-intensive, lack scalability and intuition, and might not evaluate the system strength contribution over the entire frequency range of interest. This paper introduces a novel, frequency-domain approach to quantify system strength support provided by a GFM resource using frequency scans. The proposed method uses transfer functions from the grid voltage magnitude (V) and phase (?), respectively, to the reactive (Q) and active power (P) output of a GFM resource for quantifying its contribution to system strength. These transfer functions provide a direct measure of the ability of a GFM resource to behave as a stiff voltage source behind a reactance over a specified frequency range, enabling robust quantification of its system strength contribution. The key innovation of this work is the development of a frequency domain system strength metric called the dynamic short-circuit ratio (dSCR) that is suitable for IBR-dominated power systems and is directly related with the familiar short circuit ratio (SCR) metric. The new metric, dSCR, enables the assessment of system strength contributions from both synchronous machines and converter-based GFM resources using a unified benchmark, which is not possible with the traditional SCR metric. The paper also demonstrates how impedance scans could identify if an unstable condition observed during weak grid conditions is a result of the lack active or reactive power support or both. By leveraging the proposed frequency-domain dSCR metric for quantifying system strength contribution from GFM IBRs, the paper demonstrates targeted mitigation strategies for weak grid instabilities without resorting to repeated, time-consuming time-domain simulations. The result is a scalable and efficient approach to remediate stability challenges in power systems with high shares of IBRs and accelerating the integration of GFM technologies for system strength support in power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DSO+T: Integrated System Simulation (DSO+T Study: Volume 2)

This report summarizes an integrated co-simulation model used by the Distribution System Operator with Transactive (DSO+T) study to represent an electrical generation, delivery, and end-load systems for the purposes of assessing the viability and value proposition of transactive energy coordination of flexible assets versus a business-as-usual case. The integrated co-simulation model includes the bulk generation and transmission system, including the day-ahead and real-time scheduling and dispatch of thermal generators. Forty distribution system operators were modelled in detail, including tens of thousands of residential and commercial buildings and their flexible end-loads. These included HVAC systems, residential water heaters, electric vehicles, and stationary, behind-the-meter, batteries. Both wholesale market and end-load results for the business-as-usual case are presented and compared to actual ERCOT system data to assess the accuracy and representativeness of the resulting model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Open Boundary Particle-in-Cell Simulation of Dipolarization Front Propagation

First results are presented from an ongoing open boundary 2-1/2D particle-in-cell simulation study of dipolarization front (DF) propagation in Earth's magnetotail. At this stage, this study is focused on the compression, or pileup, region preceding the DF current sheet. We find that the earthward acceleration of the plasma in this region is in general agreement with a recent DF force balance model. A gyrophase bunched reflected ion population at the leading edge of the pileup region is reflected by a normal electric field in the pileup region itself, rather than through an interaction with the current sheet. We discuss plasma wave activity at the leading edge of the pileup region that may be driven by gradients, or by reflected ions, or both; the mode has not been identified. The waves oscillate near but above the ion cyclotron frequency with wavelength several ion inertial lengths. We show that the waves oscillate primarily in the perpendicular magnetic field components, do not propagate along the background magnetic field, are right handed elliptically (close to circularly) polarized, exist in a region of high electron and ion beta, and are stationary in the plasma frame moving earthward. We discuss the possibility that the waves are present in plasma sheet data, but have not, thus far, been discovered.

dipolarization front↗

Communication Research in Aviation and Space Operations: Symptoms and Strategies of Crew Coordination

The day-to-day operators of today's aerospace systems work under increasing pressures to accomplish more with less. They work in operational systems which are complex, technology-based, and high-risk; in which incidents and accidents have far-reaching and costly consequences. For these and other reasons, there is concern that the safety net formerly built upon redundant systems and abundant resources may become overburdened. Although we know that human ingenuity can overcome incredible odds, human nature can also fail in unpredictable ways. Over the last 20 years, a large percentage of aviation accidents and incidents have been attributed to human errors rather than hardware or environmental factors alone. A class of errors have been identified which are not due to a lack of individual, technical competencies. Rather, they are due to the failure of teams to utilize readily available resources or information in a timely fashion. These insights began a training revolution in the aviation industry called Cockpit Resource Management, which later became known as Crew Resource Management (CRM) as its concepts and applications extended to teams beyond the flightdeck. Then, as now, communication has been a cornerstone in CRM training since crew coordination and resource management largely resides within information transfer processes--both within flightcrews, and between flightcrews and the ground operations teams that support them. The research I will describe takes its roots in CRM history as we began to study communication processes in order to discover symptoms of crew coordination problems, as well as strategies of effective crew management. On the one hand, communication is often the means or the tool by which team members manage their resources, solve problems, maintain situational awareness and procedural discipline. Conversely, it is the lack of planning and resource management, loss of vigilance and situational awareness, and non-standard communications that are implicated in accidents and incidents. NASA/Ames Crew Factors researchers have been developing a model of effective crew coordination in order to understand the sources of performance breakdowns, and to develop effective solutions and interventions. Because communication is a primary mechanism by which information is received and transmitted, and because it is observable behavior, we focus on these group processes in order to identify patterns of communication that distinguish effective from less effective crew performance. Since a prime objective is to develop training recommendations for enhancing communication skills, we interpret our findings in the context of relevant task and environmental conditions, role and procedural constraints, and the normal real-time parameters of flight operations. Another research objective is to consider how communication and coordination can be enhanced through design. For example, flight deck and hardware design as well as procedural and software design may greatly influence the efficiency with which crews communicate and coordinate their work. In addition, teams and tasks may be designed, organized, and trained so that team interactions with each other are based upon appropriately shared knowledge, procedures and situation awareness. In short, we are interested in enhancing communication practices through (1) the training of specific communication skills, and (2) the design of equipment, tasks, procedures, and teams that optimize smooth, unambiguous communication processes. Two examples of communication research will be described; one in aviation and one in space operations. The first example is a high-fidelity full mission simulation study which investigates the affect of flightdeck automation on crew coordination and communication (contrasting crew performance in the DC-9 vs. MD88). Additional information is contained in the original extended abstract.

Kanki, Barbara G.↗

UAS Air Traffic Controller Acceptability Study-2: Effects of Communications Delays and Winds in Simulation

This study evaluated the effects of Communications Delays and Winds on Air Traffic Controller ratings of acceptability of horizontal miss distances (HMDs) for encounters between UAS and manned aircraft in a simulation of the Dallas-Ft. Worth East-side airspace. Fourteen encounters per hour were staged in the presence of moderate background traffic. Seven recently retired controllers with experience at DFW served as subjects. Guidance provided to the UAS pilots for maintaining a given HMD was provided by information from self-separation algorithms displayed on the Multi-Aircraft Simulation System. Winds tested did not affect the acceptability ratings. Communications delays tested included 0, 400, 1200, and 1800 msec. For longer communications delays, there were changes in strategy and communications flow that were observed and reported by the controllers. The aim of this work is to provide useful information for guiding future rules and regulations applicable to flying UAS in the NAS.

Comstock, James R., Jr.↗

Extremum seeking for optimal control problems with unknown time-varying systems and unknown objective functions

We consider the problem of optimal feedback control of an unknown, noisy, time-varying, dynamic system that is initialized repeatedly. Examples include a robotic manipulator which must perform the same motion, such as assisting a human, repeatedly and accelerating cavities in particle accelerators which are turned on for a fraction of a second with given initial conditions and vary slowly due to temperature fluctuations. In this paper, we present an approach that applies to systems of practical interest. The method presented here is model independent; does not require knowledge of the objective function; is robust to measurement noise; is applicable for any set of initial conditions; is applicable to simultaneously controlling an arbitrary number of parameters; and may be implemented with a broad range of continuous or discontinuous functions such as sine or square waves. For systems with convex cost functions we prove that our algorithm will produce controllers that approach the minimal cost. For linear systems we reproduce the cost minimizing linear quadratic regulator optimal controller that could have been designed analytically had the system and cost function been known. We demonstrate the effectiveness of the algorithm with simulation studies of noisy and time-varying systems.

42 ENGINEERING↗

Estimation of conditional cumulative incidence functions under generalized semiparametric regression models with missing covariates, with application to analysis of biomarker correlates in vaccine trials

Herein, this article presents generalized semiparametric regression models for conditional cumulative incidence functions with competing risks data when covariates are missing by sampling design or happenstance. A doubly robust augmented inverse probability weighted (AIPW) complete-case approach to estimation and inference is investigated. This approach modifies IPW complete-case estimating equations by exploiting the key features in the relationship between the missing covariates and the phase-one data to improve efficiency. An iterative numerical procedure is derived to solve the nonlinear estimating equations. The asymptotic properties of the proposed estimators are established. A simulation study examining the finite-sample performances of the proposed estimators shows that the AIPW estimators are more efficient than the IPW estimators. The developed method is applied to the RV144 HIV-1 vaccine efficacy trial to investigate vaccine-induced IgG binding antibodies to HIV-1 as correlates of acquisition of HIV-1 infection while taking account of whether the HIV-1 sequences are near or far from the HIV-1 sequences represented in the vaccine construct.

97 MATHEMATICS AND COMPUTING↗

Joint Modeling of Wind Speed and Wind Direction Through a Conditional Approach

Atmospheric near surface wind speed and wind direction play an important role in many applications, ranging from air quality modeling, building design, wind turbine placement to climate change research. It is therefore crucial to accurately estimate the joint probability distribution of wind speed and direction. In this work, we develop a conditional approach to model these two variables, where the joint distribution is decomposed into the product of the marginal distribution of wind direction and the conditional distribution of wind speed given wind direction. To accommodate the circular nature of wind direction, a von Mises mixture model is used; the conditional wind speed distribution is modeled as a directional dependent Weibull distribution via a two-stage estimation procedure, consisting of a directional binned Weibull parameter estimation, followed by a harmonic regression to estimate the dependence of the Weibull parameters on wind direction. A Monte Carlo simulation study indicates that our method outperforms two other approaches in estimation efficiency: one that utilizes periodic spline quantile regression and another that generates data from the commonly used Abe-Ley distribution for cylindrical data. We illustrate our method by using the output from a regional climate model to investigate how the joint distribution of wind speed and direction may change under some future climate scenarios. Our method indicates significant changes in the variation of wind speed with respect to some directions.

17 WIND ENERGY↗

Modeling interval trendlines: Symbolic singular spectrum analysis for interval time series

Abstract In this article we propose an extension of singular spectrum analysis for interval‐valued time series. The proposed methods can be used to decompose and forecast the dynamics governing a set‐valued stochastic process. The resulting components on which the interval time series is decomposed can be understood as interval trendlines, cycles, or noise. Forecasting can be conducted through a linear recurrent method, and we devised generalizations of the decomposition method for the multivariate setting. The performance of the proposed methods is showcased in a simulation study. We apply the proposed methods so to track the dynamics governing the Argentina Stock Market (MERVAL) in real time, in a case study over a period of turbulence that led to discussions of the government of Argentina with the International Monetary Fund.

de Carvalho, Miguel↗

Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches

Abstract In complex systems with multiple variables monitored at high‐frequency, variables are not only temporally autocorrelated, but they may also be nonlinearly related or exhibit nonstationarity as the inputs or operation changes. One approach to handling such variables is to detrend them prior to monitoring and then apply control charts that assume independence and stationarity to the residuals. Monitoring controlled systems is even more challenging because the control strategy seeks to maintain variables at prespecified mean levels, and to compensate, correlations among variables may change, making monitoring the covariance essential. In this paper, a vector autoregressive model (VAR) is compared with a multivariate random forest (MRF) and a neural network (NN) for detrending multivariate time series prior to monitoring the covariance of the residuals using a multivariate exponentially weighted moving average (MEWMA) control chart. Machine learning models have an advantage when the data's structure is unknown or may change. We design a novel simulation study with nonlinear, nonstationary, and autocorrelated data to compare the different detrending models and subsequent covariance monitoring. The machine learning models have superior performance for nonlinear and strongly autocorrelated data and similar performance for linear data. An illustration with data from a reverse osmosis process is given.

Weix, Derek↗

Bayesian D‐Optimal Designs for Gaussian Process Surrogate Models

Computer experiments often employ space-filling strategies to create surrogate models with strong predictive performance. The impact of model parameter estimation for Gaussian process surrogates, however, is often overlooked. Obtaining a better initial estimate of the covariance lengthscale parameter, θ, can greatly improve the resulting Gaussian process fit through more effective sequential acquisitions during active learning. In this work, we propose a novel initial design maximizing the Bayesian D-optimality criterion of the Gaussian process lengthscale parameter. Previously published results have shown the emphasis on lengthscale estimation to be promising, but relied on an empirically driven design creation process. Our Bayesian D-optimal designs are rooted in information theory and lead to more informative sequential acquisitions by improving lengthscale estimation. In many cases, these gains eventually result in better surrogates than those seeded with space-filling initial designs. Furthermore, Bayesian D-optimal designs can be tailored to either isotropic or anisotropic covariance structures, and the Bayesian framework enables the inclusion of prior knowledge in the design process, offering greater flexibility and adaptability. Through several simulation studies, we demonstrate the advantages of Bayesian D-optimal designs in terms of both lengthscale estimation accuracy and predictive performance during active learning.

Bayesian experimental design↗

Characterizing climate pathways using feature importance on echo state networks

The 2022 National Defense Strategy of the United States listed climate change as a serious threat to national security. Climate intervention methods, such as stratospheric aerosol injection, have been proposed as mitigation strategies, but the downstream effects of such actions on a complex climate system are not well understood. The development of algorithmic techniques for quantifying relationships between source and impact variables related to a climate event (i.e., a climate pathway) would help inform policy decisions. Data-driven deep learning models have become powerful tools for modeling highly nonlinear relationships and may provide a route to characterize climate variable relationships. In this paper, we explore the use of an echo state network (ESN) for characterizing climate pathways. ESNs are a computationally efficient neural network variation designed for temporal data, and recent work proposes ESNs as a useful tool for forecasting spatiotemporal climate data. However, ESNs are noninterpretable black-box models along with other neural networks. The lack of model transparency poses a hurdle for understanding variable relationships. We address this issue by developing feature importance methods for ESNs in the context of spatiotemporal data to quantify variable relationships captured by the model. We conduct a simulation study to assess and compare the feature importance techniques, and we demonstrate the approach on reanalysis climate data. In the climate application, we consider a time period that includes the 1991 volcanic eruption of Mount Pinatubo. This event was a significant stratospheric aerosol injection, which acts as a proxy for an anthropogenic stratospheric aerosol injection. Furthermore, we are able to use the proposed approach to characterize relationships between pathway variables associated with this event that agree with relationships previously identified by climate scientists.

black-box models↗