SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Focal Area(s) The proposed white paper focuses on focal areas 2 and 3, and intends to build a pipeline to automate the detection of unresolved processes based on model errors and assist subsequent modeling solutions.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Abstract Bimodality in precipitation frequency distributions is often evident in atmospheric models, but rarely in observations. This study i) proposes a metric to objectively quantify the bimodality in precipitation distributions, ii) evaluates model simulations contributed to the Coupled Model Intercomparison Project (CMIP) phase 5 (CMIP5), phase 6 (CMIP6), and the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains (DYAMOND) project by comparing them to satellite-based and reanalysis precipitation products, and iii) investigates possible origins of bimodal precipitation distributions. Our results reveal that about 83% (20 out of 24) of CMIP5 and 70% (21 out of 30) of CMIP6 models used in this study exhibit bimodal distributions. The few DYAMOND models that use a deep convective parameterization also show bimodal distributions, while most DYAMOND models do not. Predictably, the bimodality originates from the separation of precipitation process between resolved grid-scale and parameterized subgrid-scale. However, in a larger number of models bimodality arises from the parameterized subgrid-scale convective precipitation alone.
Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in developing parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In recent years, machine learning has been successful in extracting complex patterns from high-resolution spatio-temporal data, leading to improved parameterization models, and ultimately better coarse grid prediction. However, the inability to satisfy known physics and poor generalization hinders the application of these models for real-world problems. In this work, we put forth a frame invariant closure approach to improve the accuracy and generalizability of deep learning-based subgrid scale closure models by embedding physical symmetries directly into the structure of the neural network. Specifically, we utilized specialized layers within the convolutional neural network in such a way that desired constraints are theoretically guaranteed without the need for any regularization terms. We demonstrate our framework for a two-dimensional decaying turbulence test case mostly characterized by the forward enstrophy cascade. We show that our frame invariant SGS model (i) accurately predicts the subgrid scale source term, (ii) respects the physical symmetries such as translation, Galilean, and rotation invariance, and (iii) is numerically stable when implemented in coarse-grid simulation with generalization to different initial conditions and Reynolds number. This work opens up a possibility of connecting physics-based theories and data-driven modeling paradigms, and thus represents a promising step towards the development of physically consistent data-driven turbulence closure models.
In the past couple of years, there has been a proliferation in the use of machine learning approaches to represent subgrid-scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid-scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parametrizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parametrization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parametrization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid-scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parametrizations for future prediction. Moreover, we demonstrate that these data-driven parametrization models can handle the non-Gaussian statistics of subgrid-scale processes, and effectively improve the accuracy of outer data assimilation workflow loops in a modular nonintrusive way.
Abstract Climate models are essential to understand and project climate change, yet long‐standing biases and uncertainties in their projections remain. This is largely associated with the representation of subgrid‐scale processes, particularly clouds and convection. Deep learning can learn these subgrid‐scale processes from computationally expensive storm‐resolving models while retaining many features at a fraction of computational cost. Yet, climate simulations with embedded neural network parameterizations are still challenging and highly depend on the deep learning solution. This is likely associated with spurious non‐physical correlations learned by the neural networks due to the complexity of the physical dynamical system. Here, we show that the combination of causality with deep learning helps removing spurious correlations and optimizing the neural network algorithm. To resolve this, we apply a causal discovery method to unveil causal drivers in the set of input predictors of atmospheric subgrid‐scale processes of a superparameterized climate model in which deep convection is explicitly resolved. The resulting causally‐informed neural networks are coupled to the climate model, hence, replacing the superparameterization and radiation scheme. We show that the climate simulations with causally‐informed neural network parameterizations retain many convection‐related properties and accurately generate the climate of the original high‐resolution climate model, while retaining similar generalization capabilities to unseen climates compared to the non‐causal approach. The combination of causal discovery and deep learning is a new and promising approach that leads to stable and more trustworthy climate simulations and paves the way toward more physically‐based causal deep learning approaches also in other scientific disciplines.
High-Reynolds number homogeneous isotropic turbulence (HIT) is fully described within the Navier–Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as large eddy simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field defined over a spatial grid with the mean-spacing correspondent to the resolved scale. This classic Eulerian LES depends on assumptions about effects of subgrid scales on the resolved scales. Here, we take an alternative approach and design LES heuristics stated in terms of Lagrangian particles moving with the flow. Our Lagrangian LES, thus L-LES, is described by equations generalizing the weakly compressible smoothed particle hydrodynamics formulation with extended parametric and functional freedom, which is then resolved via Machine Learning training on Lagrangian data from direct numerical simulations of the NS equations. The L-LES model includes physics-informed parameterization and functional form, by combining physics-based parameters and physics-inspired Neural Networks to describe the evolution of turbulence within the resolved range of scales. The subgrid-scale contributions are modeled separately with physical constraints to account for the effects from unresolved scales. We build the resulting model under the differentiable programming framework to facilitate efficient training. We experiment with loss functions of different types, including physics-informed ones accounting for statistics of Lagrangian particles. We show that our L-LES model is capable of reproducing Eulerian and unique Lagrangian turbulence structures and statistics over a range of turbulent Mach numbers.
Abstract Atmospheric gravity waves can play a significant role on atmospheric chemistry through temperature fluctuations. A recent modeling study introduced a method to implement subgrid‐scale orographic gravity‐wave‐induced temperature perturbations in the Whole Atmosphere Community Climate Model (WACCM). The model with a wave‐induced temperature parameterization was able to reproduce for example, the influence of mountain wave events on atmospheric chemistry, as highlighted in previous literature. Here we extend the subgrid‐scale wave‐induced temperature parameterization to also include non‐orographic gravity waves arising from frontal activity and convection. We explore the impact of these waves on middle atmosphere chemistry, particularly focusing on reactions that are strongly sensitive to temperature. The non‐orographic gravity waves increase the variability of chemical reaction rates, especially in the lower mesosphere. As an example, we show that this, in turn, leads to increases in the daytime ozone variability. To demonstrate another impact, we briefly investigate the role of non‐orographic gravity waves in cirrus cloud formation in this model. Consistent with findings from the previous study focusing on orographic gravity waves, non‐orographic waves also enhance homogeneous nucleation and increase cirrus clouds. The updated method used enables the global chemistry‐climate model to account for both orographic and non‐orographic gravity‐wave‐induced subgrid‐scale dynamical perturbations in a consistent manner.
Due to a lack of observations, it is a big challenge to quantify the momentum flux transported from the troposphere into the lower stratosphere by gravity waves generated by convection. This limits our understanding of the dynamics of general circulation in the stratosphere and the realism of simulations of the Quasi Biennial Oscillation. In the past decade, some general circulation models have linked the momentum flux to the latent heating from subgrid scale convective precipitation with some success. However, there is still a large uncertainty in the sources of subgrid scale convection in these models. This study applies the links between the momentum flux and convective latent heating directly to the convective precipitation derived from 16 years of TRMM precipitation radar observations in the tropics and subtropics. The total and directional momentum flux at 100 hPa are derived at individual convective pixels by using the TRMM Spectrum Latent Heating product and large-scale wind profiles from the ERA-Interim dataset. For the first time, we are able to estimate the geographical distribution of momentum flux at 100 hPa in tropics and subtropics from the observed convective sources. The diurnal, seasonal, and interannual variations of the derived momentum flux are presented and discussed. These results could provide a reference to validate the dynamic coupling between the tropical troposphere and the stratosphere in the general circulation models.
In climate predictions, clouds are the leading source of uncertainty. This is partly because, to simulate the fluid dynamics of climate over the entire globe, a large grid spacing must be used, so clouds are a subgrid-scale parametrization rather than a resolved feature. Here, a framework is investigated with finer grid spacing of O(1) or O(10)km so that some clouds are not subgrid-scale; instead, clouds evolve on the numerical grid. This cloud evolution is achieved using stochastic modeling. Hence, the framework is idealized in the sense that the full fluid dynamics of cloud circulations is still not resolved, and simplified vertical structures are used. Nevertheless, the fluid dynamics model includes evolving clouds that interactively adjust in size, shape, lifetime, and regional coverage. In addition, different cloud types are included with different roles in the climate system, including deep convective clouds and also boundary-layer clouds such as shallow cumulus and stratocumulus clouds. Other basic aspects of the idealized climate system are planetary-scale circulations (e.g., Walker circulation) and radiation. With these ingredients (evolving clouds, planetary-scale circulations, and radiation), the framework has the potential for idealized investigations of climate change with interactive cloud–radiative feedback of individual clouds. Here, the formulation of the model equations is presented, and numerical simulations are shown to illustrate the model dynamics and climate change.
Abstract A stochastic horizontal subgrid‐scale mixing scheme is evaluated in ensemble simulations of a tropical oceanic deep convection case using a horizontal grid spacing (Δ h ) of 3 km. The stochastic scheme, which perturbs the horizontal mixing coefficient according to a prescribed spatiotemporal autocorrelation scale, is found to generally increase mesoscale organization and convective intensity relative to a non‐stochastic control simulation. Perturbations applied at relatively short autocorrelation scales induce differences relative to the control that are more systematic than those from perturbations applied at relatively long scales that yield more variable outcomes. A simulation with mixing enhanced by a constant factor of 4 significantly increases mesoscale organization and convective intensity, while turning off horizontal subgrid‐scale mixing decreases both. Total rainfall is modulated by a combination of mesoscale organization, areal coverage of convection, and convective intensity. The stochastic simulations tend to behave more similarly to the constant enhanced mixing simulation owing to greater impacts from enhanced mixing as compared to reduced mixing. The impacts of stochastic mixing are robust, ascertained by comparing the stochastic mixing ensembles with a non‐stochastic mixing ensemble that has grid‐scale noise added to the initial thermodynamic field. Compared to radar observations and a higher resolution Δ h = 1 km simulation, stochastic mixing seemingly degrades the simulation performance. These results imply that stochastic mixing produces non‐negligible impacts on convective system properties and evolution but does not lead to an improved representation of convective cloud characteristics in the case studied here.
Large-scale river models are being refined over coastal regions to improve the scientific understanding of coastal processes, hazards and responses to climate change. However, coarse mesh resolutions and approximations in physical representations of tidal rivers limit the performance of such models at resolving the complex flow dynamics near the river-ocean interface, resulting in inaccurate simulations of flood inundation. In this research, we propose a machine learning (ML) framework based on the state-of-the-art physics-informed neural network (PINN) to simulate the downscaled flow at the subgrid scale. First, we demonstrate that PINN is able to assimilate observations of various types and solve the one-dimensional (1-D) Saint-Venant equations (SVE) directly. We perform the flow simulations over a floodplain and along an open channel in several synthetic case studies. The PINN performance is evaluated against analytical solutions and numerical models. Our results indicate that the PINN solutions of water depth have satisfactory accuracy with limited observations assimilated. In the case of flood wave propagation induced by storm surge and tide, a new neural network architecture is proposed based on Fourier feature embeddings that seamlessly encodes the periodic tidal boundary condition in the PINN's formulation. Furthermore, we show that the PINN-based downscaling can produce more reasonable subgrid solutions of the along-channel water depth by assimilating observational data. The PINN solution outperforms the simple linear interpolation in resolving the topography and dynamic flow regimes at the subgrid scale. This study provides a promising path towards improving emulation capabilities in large-scale models to characterize fine-scale coastal processes.
We present high-fidelity large-eddy-simulation (LES) modeling approaches for the turbulent atmospheric boundary layer (ABL) flows. Wind energy is a prime example of an application driven by ABL. Generation of electrical energy from farms of wind turbines at night in the stable ABL is a particularly interesting situation. In this report, we consider the well-known GEWEX (Global Energy and Water Cycle Experiment) Atmospheric Boundary Layer Study (GABLS) stably stratified benchmark LES case. We use a high-order spectral element code Nek5000/RS, which is supported under the DOE's Exascale Computing Project (ECP) Center for Efficient Exascale Discretizations (CEED) project, targeting application simulations on various acceleration-device based exascale computing platforms. In our earlier ANL report, we demonstrated our newly developed subgrid-scale (SGS) models based on high-pass filter (HPF), mean-field eddy viscosity (MFEV), and Smagorinsky (SMG) with no-slip and traction boundary conditions, provided with low-order statistics, convergence and turbulent structure analysis. In this report, we extend the range of our SGS modeling approaches in the context of the mean-field eddy viscosity (MFEV), to include the solution of an SGS turbulent kinetic energy equation (TKE). We demonstrate the model fidelity of Nek5000/RS in comparison to that of AMR-Wind, a block-structured second-order finite-volume code with adaptive-mesh-refinement capabilities, with which we studied scaling performance for both codes in comparison on DOE's leadership computing platforms.
Accurate prediction of precipitation intensity is crucial for both human and natural systems, especially in a warming climate more prone to extreme precipitation. Yet, climate models fail to accurately predict precipitation intensity, particularly extremes. One missing piece of information in traditional climate model parameterizations is subgrid-scale cloud structure and organization, which affects precipitation intensity and stochasticity at coarse resolution. Here, using global storm-resolving simulations and machine learning, we show that, by implicitly learning subgrid organization, we can accurately predict precipitation variability and stochasticity with a low-dimensional set of latent variables. Using a neural network to parameterize coarse-grained precipitation, we find that the overall behavior of precipitation is reasonably predictable using large-scale quantities only; however, the neural network cannot predict the variability of precipitation (R 2 ~ 0.45) and underestimates precipitation extremes. The performance is significantly improved when the network is informed by our organization metric, correctly predicting precipitation extremes and spatial variability (R 2 ~ 0.9). The organization metric is implicitly learned by training the algorithm on a high-resolution precipitable water field, encoding the degree of subgrid organization. The organization metric shows large hysteresis, emphasizing the role of memory created by subgrid-scale structures. We demonstrate that this organization metric can be predicted as a simple memory process from information available at the previous time steps. These findings stress the role of organization and memory in accurate prediction of precipitation intensity and extremes and the necessity of parameterizing subgrid-scale convective organization in climate models to better project future changes of water cycle and extremes.
Representation of unresolved cloud processes has been one of the most challenging problems in numerical modeling of the atmosphere. During the last decades, considerable efforts have been spent to better represent the collective effects of those processes in terms of resolved scales (see Arakawa 2004 for a review). Still, the progress on this problem has been unacceptably slow as pointed out by Randall et al. (2003). The large part of the difficulty is inherent in the artificial separation of atmospheric processes into the explicitly simulated resolved scales and the highly parameterized subgrid scales. Arakawa (2004) and Arakawa et al. (2011) suggested two plausible approaches to eliminate the problem of artificial separation ofatmospheric processes: “parameterize everything” and “resolve everything”.
Representation of unresolved cloud processes has been one of the most challenging problems in numerical modeling of the atmosphere. During the last decades, considerable efforts have been spent to better represent the collective effects of those processes in terms of resolved scales (see Arakawa 2004 for a review). Still, the progress on this problem has been unacceptably slow as pointed out by Randall et al. (2003). The large part of the difficulty is inherent in the artificial separation of atmospheric processes into the explicitly simulated resolved scales and the highly parameterized subgrid scales. Arakawa (2004) and Arakawa et al. (2011) suggested two plausible approaches to eliminate the problem of artificial separation of atmospheric processes: “parameterize everything” and “resolve everything”.
Abstract Turbulent fluctuations of scalar and velocity fields are critical for cloud microphysical processes, e.g., droplet activation and size distribution evolution, and can therefore influence cloud radiative forcing and precipitation formation. Lagrangian and Eulerian water vapor, temperature, and supersaturation statistics are investigated in direct numerical simulations (DNS) of turbulent Rayleigh–Bénard convection in the Pi Convection Cloud Chamber to provide a foundation for parameterizing subgrid-scale fluctuations in atmospheric models. A subgrid model for water vapor and temperature variances and covariance and supersaturation variance is proposed, valid for both clear and cloudy conditions. Evaluation of phase change contributions through an a priori test using DNS data shows good performance of the model. Supersaturation is a nonlinear function of temperature and water vapor, and relative external fluxes of water vapor and heat (e.g., during entrainment-mixing and phase change) influence turbulent supersaturation fluctuations. Although supersaturation has autocorrelation and structure functions similar to the independent scalars (temperature and water vapor), the autocorrelation time scale of supersaturation differs. Relative scalar fluxes in DNS without cloud make supersaturation PDFs less skewed than the adiabatic case, where they are highly negatively skewed. However, droplet condensation changes the PDF shape response: it becomes positively skewed for the adiabatic case and negatively skewed when the sidewall relative fluxes are large. Condensation also increases correlations between water vapor and temperature in the presence of relative scalar fluxes but decreases correlations for the adiabatic case. These changes in correlation suppress supersaturation variability for the nonadiabatic cases and increase it for the adiabatic case. Implications of this work for subgrid microphysics modeling using a Lagrangian stochastic scheme are also discussed.