Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Constraints on methane emissions in North America from future geostationary remote-sensing measurements

The success of future geostationary (GEO) satellite observation missions depends on our ability to design instruments that address their key scientific objectives. Here, an Observation System Simulation Experiment (OSSE) is performed to quantify the constraints on methane (CH 4 ) emissions in North America obtained from shortwave infrared (SWIR), thermal infrared (TIR), and multi-spectral (SWIR+TIR) measurements in geostationary orbit and from future SWIR low-Earth orbit (LEO) measurements. Furthermore, we used an efficient stochastic algorithm to compute the information content of the inverted emissions at high spatial resolution (0.5° × 0.7°) in a variational framework using the GEOS-Chem chemistry-transport model and its adjoint. Our results show that at sub-weekly timescales, SWIR measurements in GEO orbit can constrain about twice as many independent flux patterns than in LEO orbit, with a degree of freedom for signal (DOF) for the inversion of 266 and 115, respectively. Comparisons between TIR GEO and SWIR LEO configurations reveal that poor boundary layer sensitivities for the TIR measurements cannot be compensated for by the high spatiotemporal sampling of a GEO orbit. The benefit of a multi-spectral instrument compared to current SWIR products in a GEO context is shown for sub-weekly timescale constraints, with an increase in the DOF of about 50 % for a 3-day inversion. Our results further suggest that both the SWIR and multi-spectral measurements on GEO orbits could almost fully resolve CH 4 fluxes at a spatial resolution of at least 100 km × 100 km over source hotspots (emissions > 4 × 10 5 kg day -1 ). The sensitivity of the optimized emission scaling factors to typical errors in boundary and initial conditions can reach 30 and 50 % for the SWIR GEO or SWIR LEO configurations, respectively, while it is smaller than 5 % in the case of a multi-spectral GEO system. Our results demonstrate that multi-spectral measurements from a geostationary satellite platform would address the need for higher spatiotemporal constraints on CH 4 emissions while greatly mitigating the impact of inherent uncertainties in source inversion methods on the inferred fluxes.

54 ENVIRONMENTAL SCIENCES↗

Probing non-Gaussian stochastic gravitational wave backgrounds with LISA

The stochastic gravitational wave background (SGWB) contains a wealth of information on astrophysical and cosmological processes. A major challenge of upcoming years will be to extract the information contained in this background and to disentangle the contributions of different sources. In this paper we provide the formalism to extract, from the correlation of three signals in the Laser Interferometer Space Antenna (LISA), information about the tensor three-point function, which characterizes the non-Gaussian properties of the SGWB. This observable can be crucial to discriminate whether a SGWB has a primordial or astrophysical origin. Compared to the two-point function, the SGWB three-point function has a richer dependence on the gravitational wave momenta and chiralities. It can be used therefore as a powerful discriminator between different models. For the first time we provide the response functions of LISA to a general SGWB three-point function. As examples, we study in full detail the cases of an equilateral and squeezed SGWB bispectra, and provide the explicit form of the response functions, ready to be convoluted with any theoretical prediction of the bispectrum to obtain the observable signal. We further derive the optimal estimator to compute the signal-to-noise ratio. Our formalism covers general shapes of non-Gaussianity, and can be extended straightaway to other detector geometries. Finally, we provide a short overview of models of the early universe that can give rise to a non-Gaussian SGWB.

79 ASTRONOMY AND ASTROPHYSICS↗

Recommended DSMC Collision Model Parameters for Planetary Entry

Hybrid simulation frameworks combining Computational Fluid Dynamics (CFD) and Direct Simulation Monte Carlo (DSMC) are frequently employed to efficiently perform high-fidelity simulations of environments consisting of both continuum and rarified flow. DSMC is a stochastic, particle-based method which solves the fundamental Boltzmann equation and is therefore necessary for high-Knudsen flow where continuum-based assumptions governing CFD break down. However, the DSMC methodology is generally computationally inefficient to model the continuum regime. In a CFD/DSMC hybrid approach, obtaining an accurate, high-fidelity solution hinges on the consistent treatment of transport properties and the thermo-chemical models employed within the two solvers. In principle, in regions where CFD and DSMC are both employed, the same gas mixture under the same conditions should have the same properties, regardless of simulation type. Observed differences should be due to non-equilibrium processes, rather than differences in physical models. The goal of this work is to provide a comprehensive DSMC transport database encompassing the vast majority of known gas species encountered during Earth or other planetary atmospheric entry. This goal is largely possible due to recently performed ab initio quantum chemistry calculations. Combined with other high-fidelity data, the planned database will consist of collision integral data for over 200 neutral and ionized species and over 20000 binary collisions. From these collision integrals, Nelder-Mead optimization is used to compute collision-specific Variable Soft Sphere (VSS) collision model parameters, fitted from 300 K to 20000 K. Initial comparisons of transport properties of relevant equilibrium gas mixtures show great agreement between CFD and DSMC-derived results. The completed database can be readily applied to model binary collisions of any gas mixture containing the included species over the specified temperature range, making it a valuable tool for future planetary probe modeling efforts. An example is shown below in Fig. 1. Equilibrium mixture transport properties for a 35-species mixture composed originally of 10% air and 90% pyrolysis species of a carbon-phenolic ablator material [4] are computed using both fitted VSS Parameters and the original CFD collision integral values. Deviations in computed properties between the two approaches are less than 5% for the entire temperature range.

M. R. Gosma↗

A Holistic DSMC Transport Database for Re-Entry and Ablation Modeling

Hybrid simulation frameworks combining Computational Fluid Dynamics (CFD) and Direct Simulation Monte Carlo (DSMC) are frequently employed to efficiently perform high-fidelity solutions of environments containing combined continuum/rarified flow. The use of DSMC, a stochastic, particle-based method, is necessary for high-Knudsen flow where continuum-based assumptions governing CFD break down. However, the DSMC methodology is generally very computationally inefficient to model the continuum regime. In a CFD/DSMC hybrid approach, obtaining an accurate, high-fidelity solution hinges on the consistent treatment of transport properties and the used thermo-chemical models employed within the two solvers. In principle, in regions where CFD and DSMC are both employed, the same gas mixture under the same conditions should have the same properties, regardless of simulation type. Observed differences should be due to non-equilibrium processes, rather than differences in physical models. While the transport models governing CFD and DSMC simulations are starkly different, they can effectively be linked via their use of reduced Chapman-Enskog collision integrals. In CFD, these integrals are typically stored as fitted polynomial expressions and used to directly compute gas transport properties via mixing rules or the full Chapman-Enskog formulation. In DSMC, they can be used to derive the collision parameters needed for the phenomenological collision cross-section models that govern particle interactions, via a Nelder-Mead optimization scheme. The goal of this work is to provide a unified DSMC transport database encompassing the vast majority of known gas species encountered during atmospheric entry, on Earth or any other Solar body. This goal is largely possible due to recently performed ab-initio quantum chemistry calculations. Combined with other high-fidelity literature sources, the planned database will consist of collision integral data for over 200 neutral and ionized species and over 17000 binary collisions. From these collision integrals, Nelder-Mead optimization is used to compute Variable Soft Sphere (VSS) collision model parameters for DSMC, fitted from 300 K to 20000 K. Initial comparisons of transport properties of relevant equilibrium gas mixtures show great agreement between CFD and DSMC-derived results. The completed database will be able to be readily applied to model binary collisions of any gas mixture containing the included species over the specified temperature range, making it a valuable tool for future planetary probe modeling efforts. An example is shown below. Equilibrium mixture transport properties for a 19-species Titan atmospheric model [4] are computed using both fitted VSS parameters and the original CFD collision integral values. Deviations in computed properties between the two approaches is less than 5% for the entire temperature range.

M R Gosma↗

Accelerated basis adaptation in homogeneous chaos spaces

Polynomial chaos expansions (PCE) provide an efficient approach to uncertainty quantification (UQ) and have been adapted to diverse applications across the spectrum of science and engineering. For situations involving large stochastic parameterizations, the curse of dimensionality renders PCE-based methods computationally prohibitive. A basis adaptation approach for PCE was proposed by Tipireddy and Ghanem (2014) which transforms the input random variables through an isometry such that sufficient probabilistic characterization of specific quantities of interest (QoI) is concentrated in an algebraic manifold embedded in the linear span of the dominant transformed variables. While quite versatile, that original version of the PCE basis adaptation exhibited slow convergence for a number of problems of practical significance. In the present paper, we propose two novel methods to accelerate the convergence of the original basis adaptation approach, thus expanding its reach while also providing insight into its performance. In the first method, information gained from a pilot PCE representation is used to correct the mean and Gaussian coefficients in the adapted space. By taking advantages of probabilistic information in higher dimensional adaptation gleaned from an initial adaptation, the second method updates the rotation matrix used to identify the dominant transformed variables. In this manner, the new rotation matrix concentrates even more probabilistic information in its first few dimensions. These two method can be combined to achieve even better performance, the combined method is referred to as sequentially optimized adaptation method. Here, the methods are demonstrated on an analytical test function and a model of a space structure with several sub-components and a non-smooth quantity of interest representing the maximum acceleration over time. Both methods achieve accelerated convergence of the basis adaptation approach with negligible additional costs.

Accelerated convergence↗

Raptor

Raptor is an efficient Python-based tool for predicting the formation and morphology of stochastic lack of fusion defects in metal AM processes. A major obstacle for the qualification and certification of additively manufactured parts in critical applications continues to be performance variability caused in part by porosity-related defects. High-fidelity process models that could predict these defect features are currently too computationally expensive for component-level analysis. To address this, Raptor employs a high-performance geometric method to model the dynamic melt pool rather than relying on computationally intensive thermal fluid dynamics. This allows Raptor to rapidly identify regions of unmelted material that correspond to lack of fusion pores. The efficiency of this approach significantly reduces the time and resources needed for generating 3D defect predictions, which enables users to conduct large-scale parameter studies and evaluate how process variations affect part quality. The framework offers operational flexibility; users can execute simulations through a simple command line interface or integrate core functions as a library within larger computational workflows. Simulation outputs include 3D porosity maps for visualization and tools for quantitative morphological analysis. These results are suitable for direct comparison with experimental characterization data from methods such as X-ray computed tomography and can be used for statistical process optimization.

Subraveti, Vamsi [Vanderbilt Univ., Nashville, TN ↗

Emergency Asset Positioning for Resilient Transmission Grid Operation

In this paper we study a problem of hurricane emergency preparedness via placement of emergency storage assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency storage assets placed prior to an extreme event.

emergency preparedness↗

Emergency Generation Asset Positioning for Resilient Transmission Grid Operation: Preprint

In this paper we study a problem of hurricane emergency preparedness via placement of emergency generation assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency generation assets placed prior to an extreme event.

emergency preparedness↗

Emergency Asset Positioning for Resilient Transmission Grid Operation

In this paper we study a problem of hurricane emergency preparedness via placement of emergency generation assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency generation assets placed prior to an extreme event.

emergency preparedness↗

Coupled land surface–subsurface hydrogeophysical inverse modeling to estimate soil organic carbon content and explore associated hydrological and thermal dynamics in the Arctic tundra

Quantitative characterization of soil organic carbon (OC) content is essential due to its significant impacts on surface–subsurface hydrological–thermal processes and microbial decomposition of OC, which both in turn are important for predicting carbon–climate feedbacks. While such quantification is particularly important in the vulnerable organic-rich Arctic region, it is challenging to achieve due to the general limitations of conventional core sampling and analysis methods, and to the extremely dynamic nature of hydrological–thermal processes associated with annual freeze–thaw events. In this study, we develop and test an inversion scheme that can flexibly use single or multiple datasets – including soil liquid water content, temperature and electrical resistivity tomography (ERT) data – to estimate the vertical distribution of OC content. Our approach relies on the fact that OC content strongly influences soil hydrological–thermal parameters and, therefore, indirectly controls the spatiotemporal dynamics of soil liquid water content, temperature and their correlated electrical resistivity. We employ the Community Land Model to simulate nonisothermal surface–subsurface hydrological dynamics from the bedrock to the top of canopy, with consideration of land surface processes (e.g., solar radiation balance, evapotranspiration, snow accumulation and melting) and ice–liquid water phase transitions. For inversion, we combine a deterministic and an adaptive Markov chain Monte Carlo (MCMC) optimization algorithm to estimate a posteriori distributions of desired model parameters. For hydrological–thermal-to-geophysical variable transformation, the simulated subsurface temperature, liquid water content and ice content are explicitly linked to soil electrical resistivity via petrophysical and geophysical models. We validate the developed scheme using different numerical experiments and evaluate the influence of measurement errors and benefit of joint inversion on the estimation of OC and other parameters. We also quantify the propagation of uncertainty from the estimated parameters to prediction of hydrological–thermal responses. We find that, compared to inversion of single dataset (temperature, liquid water content or apparent resistivity), joint inversion of these datasets significantly reduces parameter uncertainty. We find that the joint inversion approach is able to estimate OC and sand content within the shallow active layer (top 0.3 m of soil) with high reliability. Due to the small variations of temperature and moisture within the shallow permafrost (here at about 0.6 m depth), the approach is unable to estimate OC with confidence. However, if the soil porosity is functionally related to the OC and mineral content, which is often observed in organic-rich Arctic soil, the uncertainty of OC estimate at this depth remarkably decreases. Our study documents the value of the new surface–subsurface, deterministic–stochastic inversion approach, as well as the benefit of including multiple types of data to estimate OC and associated hydrological–thermal dynamics.

58 GEOSCIENCES↗

Efficient Interdependent Systems Recovery Modeling with DeepONets

Modeling the recovery of interdependent critical infrastructure is a key component of quantifying and optimizing societal resilience to disruptive events. However, simulating the recovery of large-scale interdependent systems under random disruptive events is computationally expensive. Therefore, we propose the application of Deep Operator Networks (DeepONets) in this paper to accelerate the recovery modeling of interdependent systems. DeepONets are ML architectures which identify mathematical operators from data. The form of governing equations DeepONets identify and the governing equation of interdependent systems recovery model are similar. Therefore, we hypothesize that DeepONets can efficiently model the interdependent systems recovery with little training data. We applied DeepONets to a simple case of four interdependent systems with sixteen states. DeepONets, overall, performed satisfactorily in predicting the recovery of these interdependent systems for out of training sample data when compared to reference results.

97 MATHEMATICS AND COMPUTING↗

Two-Stage Distributionally Robust Conic Linear Programming over 1-Wasserstein Balls

Here, this paper studies two-stage distributionally robust conic linear programming under constraint uncertainty over type-1 Wasserstein balls. We present optimality conditions for the dual of the worst-case expectation problem, which characterizes worst-case uncertain parameters for its inner maximization problem. This condition offers an alternative proof, a counterexample, and an extension to previous works. Additionally, the condition highlights the potential advantage of a specific distance metric for out-of-sample performance, as exemplified in a numerical study on a facility location problem with demand uncertainty. Furthermore, cutting-plane-based algorithms, equipped with a unified scenario generation framework, are proposed for addressing both unbounded support and second-stage dual feasible regions, with a finite convergence proof under less stringent assumptions.

Wasserstein↗

LA17-V-InverseRadTransportProblem-PD2Kb. Final Project Report

In the inverse radiation transport problem, a radiation signal emanating from an unknown object is used to reconstruct geometric and material parameters of the object , e.g., the mass of special nuclear material (SNM), the isotopic composition of the SNM (e.g., the enrichment of 235U), the thickness of shielding, etc. The inverse radiation transport problem is one of the most fundamental and important in the emergency response mission, and has been addressed in previous NA-22 and NA-42/84 investments by using derivative-free optimization methods. Our project was aimed at (i) consolidating previous work by applying polynomial chaos expansion (PCE) for reducing significantly the number of forward model simulations required by derivative-free optimization methods; (ii) developing a general-purpose framework and stand-alone software for solving the inverse radiation transport problem by applying a new “predictive modeling” methodology (predictive modeling of coupled multi-physics systems, PM_CMPS) which enables the fusing of experimental and computational information; and (iii) developing several benchmarks (for unscattered gamma rays) for demonstrating the quantification of non-Gaussian features (e.g., skewness and kurtosis, which characterize asymmetries and long tails) of response distributions by deterministically and efficiently propagating parameter uncertainties (covariances and higher-order moments, where available) using high-order sensitivities computed by the recently developed comprehensive adjoint sensitivity analysis methodology (C-ASAM). With regard to (i), application of PCE, the most significant accomplishment of this project was an implementation of PCE into INVERSE that significantly reduced computation time for the DiffeRential Evolution Adaptive Metropolis (DREAM) and Differential Evolution (DE) methods. For inverse transport problems with measurements of neutron leakage, neutron multiplication, and neutron-induced gamma-rays, the solution times for the DREAM and DE methods were reduced by factors of 30-300, reducing run times from hours to minutes while maintaining the same accuracy as the standard (non-PCE) DREAM and DE. Speedups were further improved by exploring sparse grid quadrature sets using the Toolkit for Adaptive Stochastic Modeling and Non-Intrusive ApproximatioN (Tasmanian) toolset. An initial exploration of sparse grids indicated that further speedups factors of 5-10 are obtainable. The implementation of PCE in INVERSE is not in a form that users can easily access. With regard to (ii), solving the inverse problem using a predictive modeling paradigm, the most significant accomplishment of this project were the derivation and implementation of adjoint-based second derivatives in neutron and photon transport theory. There are two codes that compute these derivatives. SENSPG computes them for uncollided gamma rays and SENSMG computes them for neutron leakage. SENSMG is open-source code available on github. Other significant accomplishments included a stand-alone code, MULTI-PRED, that implements the predictive modeling paradigm, along with a detailed manual. The code was implemented in the existing INVERSE code for inverse problems, but a head-to-head comparison of inverse methods was not achieved. We also derived and implemented the capability to compute sensitivities for multiplicity measurements into the SENSMG code, and this capability was used in a data assimilation application, but it was not used for solving inverse problems. With regard to (iii), developing benchmarks to demonstrate the importance of high-order sensitivity and uncertainty analysis, the most significant accomplishment of this project were two test problems that showed how important second-order sensitivities are.

07 ISOTOPE AND RADIATION SOURCES↗

Path-space variational inference for non-equilibrium coarse-grained systems

In this paper we discuss information-theoretic tools for obtaining optimized coarse-grained molecular models for both equilibrium and non-equilibrium molecular simulations. The latter are ubiquitous in physicochemical and biological applications, where they are typically associated with coupling mechanisms, multi-physics and/or boundary conditions. In general the non-equilibrium steady states are not known explicitly as they do not necessarily have a Gibbs structure. The presented approach can compare microscopic behavior of molecular systems to parametric and non-parametric coarse-grained models using the relative entropy between distributions on the path space and setting up a corresponding path-space variational inference problem. The methods can become entirely data-driven when the microscopic dynamics are replaced with corresponding correlated data in the form of time series. Furthermore, we present connections and generalizations of force matching methods in coarse-graining with path-space information methods. We demonstrate the enhanced transferability of information-based parameterizations to different observables, at a specific thermodynamic point, due to information inequalities. We discuss methodological connections between information-based coarse-graining of molecular systems and variational inference methods primarily developed in the machine learning community. However, we note that the work presented here addresses variational inference for correlated time series due to the focus on dynamics. The applicability of the proposed methods is demonstrated on high-dimensional stochastic processes given by overdamped and driven Langevin dynamics of interacting particles.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Understanding the interplay between pilot fuel mixing and auto-ignition chemistry in hydrogen-enriched environment

The diesel-piloted dual-fuel compression ignition combustion strategy is well-suited to accelerate the decarbonization of transportation by adopting hydrogen as a renewable energy carrier into the existing internal combustion engine with minimal engine modifications. Despite the simplicity of engine modification, many questions remain unanswered regarding the optimal pilot injection strategy for reliable ignition with minimum pilot fuel consumption. The present study uses a single-cylinder heavy-duty optical engine to explore the phenomenology and underlying mechanisms governing the pilot fuel ignition and the subsequent combustion of a premixed hydrogen-air charge. The engine is operated in a dual-fuel mode with hydrogen premixed into the engine intake charge with a direct pilot injection of n-heptane as a diesel pilot fuel surrogate. Optical diagnostics used to visualize in-cylinder combustion phenomena include high-speed IR imaging of the pilot fuel spray evolution as well as high-speed HCHO* and OH* chemiluminescence as indicators of low-temperature and high-temperature heat release, respectively. Three pilot injection strategies are compared to explore the effects of pilot fuel mass, injection pressure, and injection duration on the probability and repeatability of successful ignition. The thermodynamic and imaging data analysis supported by zero-dimensional chemical kinetics simulations revealed a complex interplay between the physical and chemical processes governing the pilot fuel ignition process in a hydrogen containing charge. Hydrogen strongly inhibits the ignition of pilot fuel mixtures and therefore requires longer injection duration to create zones with sufficiently high pilot fuel concentration for successful ignition. Results show that ignition typically tends to rely on stochastic pockets with high pilot fuel concentration, which results in poor repeatability of combustion and frequent misfiring. In conclusion, this work has improved the understanding on how the unique chemical properties of hydrogen pose a challenge for maximization of hydrogen’s energy share in hydrogen dual-fuel engines and highlights a potential mitigation pathway.

33 ADVANCED PROPULSION SYSTEMS↗

Effect of 3D magnetic perturbations on divertor conditions and detachment in tokamak and stellarator

Enhanced perpendicular heat and momentum transport induces parallel pressure loss leading to divertor detachment, which can be produced by the increase of density in 2D tokamaks. However, in the 3D configurations such as tokamaks with 3D fields and stellarators, the fraction of perpendicular transport can be higher even in a lower density regime, which could lead to the early transition to detachment without passing through the high-recycling regime. 3D fields applied to the limiter tokamak plasmas produce edge stochastic layers close to the last closed flux surface (LCFS), which can allow for enhanced perpendicular transport and indeed the absence of high recycling regime and early detachment have been observed in TEXTOR and Tore Supra. However, in the X-point divertor tokamaks with the applied 3D fields, the parallel transport is still dominant and the detachment facilitation has not been observed yet. Rather, 3D fields affected detachment adversely under certain conditions, either by preventing detachment onset as seen in DIII-D or by re-attaching the existing detached plasma as shown in NSTX. The possible way for strong 3D effects to induce access to the early detachment in divertor tokamaks appears to be via significant perpendicular loss of parallel momentum by frictional force for the counter-streaming flows between neighboring flow channels in the divertor. In principle, the adjacent lobes in the 3D divertor tokamak may generate the counter-streaming flow channels. However, an EMC3-EIRENE simulation for ITER H-mode plasmas demonstrated that screened RMP leads to significantly reduced counter-flows near the divertor target, therefore the momentum loss effect leading to detachment facilitation is expected to be small. This is consistent with the observation in LHD, which showed screening (amplification) of RMP fields in the attachment (stable detachment) case. In conclusion, work for optimal parameter window for best divertor operation scenario is needed particularly for the 3D divertor tokamak configuration.

3D effects on divertor↗

Hybridizing Machine Learning and Physically-based Earth System Models to Improve Prediction of Multivariate Extreme Events (AI Exploration of Wildland Fire Prediction)

Focal Areas: This project responds to two focal areas identified in the DOE Call for AI4ESP White Papers: 1) Predictive modeling through the use of artificial intelligence (AI) techniques, and 2) insights gleaned from complex data using explainable AI and big data analytics. Science Challenge: Large wildland fires (hereafter wildfires) appearing as high-impact compound climate extreme events are closely related to hydroclimate and water cycle extremes that modulate surface fuel supply and combustibility. These compound events have multivariate climatic features (e.g., temperature, precipitation, relative humidity, wind, lightning) and societal drivers (e.g., forest management, land use change, human caused ignitions). Meanwhile, they induce strong feedbacks to the coupled atmosphere, biosphere, and hydrosphere by perturbing regional and global radiation budget as well as ecological, biogeochemical, and water cycles across multiple spatiotemporal scales. The nonlinear interactions between these natural and anthropogenic components of the Earth system are too complex to be completely and adequately represented in today’s Earth system models (ESMs). The inherent stochastic nature of fire activity at all scales further increases the difficulty of its prediction using ESMs that are usually developed from deterministic equations and parameterizations. Besides, concurrence of long-term (decadal to interdecadal) global climate change and fire regime shifts overlapping with short-term (intraseasonal to interannual) variations of regional fire weather and burning activity confound predictability of these compound extreme events. We propose to address the above scientific challenges by using machine learning (ML)-based data-driven modeling techniques to integrate observations and physically-based ESMs’ simulations in a computationally efficient hybrid prediction system. This prediction system is supposed to characterize the wildfire’s sensitivity to climate and exogenous drivers at high resolution (~ 0.25°) on subseasonal to seasonal (S2S) timescales providing improved predictability and explainability. We will use the system to help identify: (1) What are the computational elements of a hybrid system needed to predict compound climate extreme events such as global wildfires? (2) What are the key drivers (either natural or anthropogenic) that modulate short-term variations of multivariate fire weather and burning activity over different regions? How can one take advantage of those driver-response relationships to improve the predictability of large wildfires on S2S time scales? (3) What are the underlying physical mechanisms and sources of improved predictability? Which ML techniques are optimal in revealing and adapting these mechanisms?

54 ENVIRONMENTAL SCIENCES↗

Application of Sparse Identification of Nonlinear Dynamics for Physics-Informed Learning

Advances in machine learning and deep neural networks has enabled complex engineering tasks like image recognition, anomaly detection, regression, and multi-objective optimization, to name but a few. The complexity of the algorithm architecture, e.g., the number of hidden layers in a deep neural network, typically grows with the complexity of the problems they are required to solve, leaving little room for interpreting (or explaining) the path that results in a specific solution. This drawback is particularly relevant for autonomous aerospace and aviation systems, where certifications require a complete understanding of the algorithm behavior in all possible scenarios. Including physics knowledge in such data-driven tools may improve the interpretability of the algorithms, thus enhancing model validation against events with low probability but relevant for system certification. Such events include, for example, spacecraft or aircraft sub-system failures, for which data may not be available in the training phase. This paper investigates a recent physics-informed learning algorithm for identification of system dynamics, and shows how the governing equations of a system can be extracted from data using sparse regression. The learned relationships can be utilized as a surrogate model which, unlike typical data-driven surrogate models, relies on the learned underlying dynamics of the system rather than large number of fitting parameters. The work shows that the algorithm can reconstruct the differential equations underlying the observed dynamics using a single trajectory when no uncertainty is involved. However, the training set size must increase when dealing with stochastic systems, e.g., nonlinear dynamics with random initial conditions.

Corbetta, Matteo↗