Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stokes equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

A Unified Multi-Scale Model for Pore-Scale Flow Simulations in Soils

Pore-scale simulations have received increasing interest in subsurface sciences to provide mechanistic insights into the macroscopic phenomena of water flow and reactive transport processes. The application of the pore scale simulations to soils and sediments is, however, challenged because of the characterization limitation that often only allows partial resolution of pore structure and geometry. A significant proportion of the pore space in soils and sediments is below the spatial resolution, forming a mixed media of pore and porous domains. Here we reported a unified multi-scale model (UMSM) that can be used to simulate water flow and transport in mixed media of pore and porous domains under both saturated and unsaturated conditions. The approach modifies the classic Navier-Stokes equation by adding a Darcy term to describe fluid momentum and uses a generalized mass balance equation for saturated and unsaturated conditions. By properly defining physical parameters, the UMSM can be applied in both pore and porous domains. This paper describes the set of equations for the UMSM, a series of validation cases under saturated or unsaturated conditions, and a real soil case for the application of the approach.

computational fluid dynamics↗

Computational Fluid Dynamics Modeling of The Dalles Project: Effects of Spill Flow Distribution Between the Washington Shore and the Tailrace Spillwall

The U.S. Army Corps of Engineers-Portland District (CENWP) has ongoing work to improve the survival of juvenile salmonids (smolt) migrating past The Dalles Dam. As part of that effort, a spillwall was constructed to improve juvenile egress through the tailrace downstream of the stilling basin. The spillwall was designed to improve smolt survival by decreasing smolt retention time in the spillway tailrace and the exposure to predators on the spillway shelf. The spillwall guides spillway flows, and hence smolt, more quickly into the thalweg. In this study, an existing computational fluid dynamics (CFD) model was modified and used to characterize tailrace hydraulics between the new spillwall and the Washington shore for six different total river flows. The effect of spillway flow distribution was simulated for three spill patterns at the lowest total river flow. The commercial CFD solver, STAR-CD version 4.1, was used to solve the unsteady Reynolds-averaged Navier-Stokes equations together with the k-epsilon turbulence model. Free surface motion was simulated using the volume-of-fluid (VOF) technique. The model results were used in two ways. First, results graphics were provided to CENWP and regional fisheries agency representatives for use and comparison to the same flow conditions at a reduced-scale physical model. The CFD results were very similar in flow pattern to that produced by the reduced-scale physical model but these graphics provided a quantitative view of velocity distribution. During the physical model work, an additional spill pattern was tested. Subsequently, that spill pattern was also simulated in the numerical model. The CFD streamlines showed that the hydraulic conditions were likely to be beneficial to fish egress at the higher total river flows (120 kcfs and greater, uniform flow distribution). At the lowest flow case, 90 kcfs, it was necessary to use a non-uniform distribution. Of the three distributions tested, splitting the flow evenly between Bay 7 and Bay 8 had hydraulics deemed most beneficial for egress by CENWP fisheries biologists and regional fishery agency representatives. The numerical and physical model results were very similar, building confidence in both hydraulic tools.

13 HYDRO ENERGY↗

Digital Rock Studies of Tight Porous Media

This technical report summarizes some recently developed approaches to studies of rock properties at a pore scale. Digital rock approach is complementary to laboratory and field studies. It can be especially helpful in situations where experimental data are uncertain, or are difficult or impossible to obtain. Digitized binary images of the pore geometries of natural rocks obtained by different imaging techniques are the input data. Computer-generated models of natural rocks can be used instead of images in a case where microtomography data are unavailable, or the resolution of the tools is insufficient to adequately characterize the features of interest. Simulations of creeping viscous flow in pores produce estimates of Darcy permeability. Maximal Inscribed Spheres calculations estimate two-phase fluid distribution in capillary equilibrium. A combination of both produce relative permeability curves. Computer-generated rock models were employed to study two-phase properties of fractured rocks, or tight sands with slit-like pores, too narrow to be characterized with micro-tomography. Various scenarios can simulate different fluid displacement mechanisms, from piston-like drainage to liquid dropout at the dew point. A finite differences discretization of Stokes equation is developed to simulate flow in the pore space of natural rocks. The numerical schemes are capable to handle both no-slip and slippage flows. An upscaling procedure estimates the permeability by subsampling a large data set. Capillary equilibrium and capillary pressure curves are efficiently estimated with the method of maximal inscribed spheres both an arbitrary contact angle. The algorithms can handle gigobytes of data on a desktop workstation. Customized QuickHull algorithms model natural rocks. Capillary pressure curves evaluated from computer-generated images mimic those obtained for microtomography data.

54 ENVIRONMENTAL SCIENCES↗

CFD-DEM Onset of Motion Analysis for Application to Bed Scour Risk Assessment

This CFD study with DEM was done as a part of the Federal Highway Administration’s (FHWA’s) effort to improve scour design procedures. The Computational Fluid Dynamics-Discrete Element Method (CFD-DEM) model, available in CD-Adapco’s StarCCM+ software, was used to simulate multiphase systems, mainly those which combine fluids and solids. In this method the motion of discrete solids is accounted for by DEM, which applies Newton's laws of motion to every particle. The flow of the fluid is determined by the local averaged Navier–Stokes equations that can be solved using the traditional CFD approach. The interactions between the fluid phase and solids phase are modeled by use of Newton's third law. The inter-particle contact forces are included in the equations of motion. Soft-particle formulation is used, which allows particles to overlap. In this study DEM was used to model separate sediment grains and spherical particles laying on the bed with the aim to analyze their movement due to flow conditions. Critical shear stress causing the incipient movement of the sediment was established and compared to the available experimental data. An example of scour around a cylindrical pier is considered. Various depths of the scoured bed and flow conditions were taken into account to gain a better understanding of the erosion forces existing around bridge foundations. The decay of these forces with increasing scour depth was quantified with a ‘decay function’, which shows that particles become increasingly less likely to be set in motion by flow forces as a scour hole increases in depth. Computational and experimental examples of the scoured bed around a cylindrical pier are presented.

97 MATHEMATICS AND COMPUTING↗

Final Report for ALCC Allocation: Predictive Simulation of Complex Flow in Wind Farms

This report documents work performed using ALCC computing resources granted under a proposal submitted in February 2016, with the resource allocation period spanning the period July 2016 through June 2017. The award allocation was 10.7 million processor-hours at the National Energy Research Scientific Computing Center. The simulations performed were in support of two projects: the Atmosphere to Electrons (A2e) project, supported by the DOE EERE office; and the Exascale Computing Project (ECP), supported by the DOE Office of Science. The project team for both efforts consists of staff scientists and postdocs from Sandia National Laboratories and the National Renewable Energy Laboratory. At the heart of these projects is the open-source computational-fluid-dynamics (CFD) code, Nalu. Nalu solves the low-Mach-number Navier-Stokes equations using an unstructured- grid discretization. Nalu leverages the open-source Trilinos solver library and the Sierra Toolkit (STK) for parallelization and I/O. This report documents baseline computational performance of the Nalu code on problems of direct relevance to the wind plant physics application - namely, Large Eddy Simulation (LES) of an atmospheric boundary layer (ABL) flow and wall-modeled LES of a flow past a static wind turbine rotor blade. Parallel performance of Nalu and its constituent solver routines residing in the Trilinos library has been assessed previously under various campaigns. However, both Nalu and Trilinos have been, and remain, in active development and resources have not been available previously to rigorously track code performance over time. With the initiation of the ECP, it is important to establish and document baseline code performance on the problems of interest. This will allow the project team to identify and target any deficiencies in performance, as well as highlight any performance bottlenecks as we exercise the code on a greater variety of platforms and at larger scales. The current study is rather modest in scale, examining performance on problem sizes of O(100 million) elements and core counts up to 8k cores. This will be expanded as more computational resources become available to the projects.

17 WIND ENERGY↗

Decrease time-to-solution through improved linear-system setup and solve

The goal of the ExaWind project is to enable predictive simulations of wind farms composed of many MW-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary code in the ExaWind project is Nalu, which is an unstructured-grid solver for the acoustically-incompressible Navier-Stokes equations, and mass continuity is maintained through pressure projection. The model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as re-initialization of matrices and re-computation of preconditioners is required at every time step We describe in this report our efforts to decrease the setup and solution time for the mass-continuity Poisson system with respect to the benchmark timing results reported in FY18 Q1. In particular, we investigate improving and evaluating two types of algebraic multigrid (AMG) preconditioners: Classical Ruge-Stfiben AMG (C-AMG) and smoothed-aggregation AMG (SA-AMG), which are implemented in the Hypre and Trilinos/MueLu software stacks, respectively. Preconditioner performance was optimized through existing capabilities and settings.

17 WIND ENERGY↗

Deploy threading in Nalu solver stack

The goal of the ExaWind project is to enable predictive simulations of wind farms composed of many MW-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary code in the ExaWind project is Nalu, which is an unstructured-grid solver for the acoustically-incompressible Navier-Stokes equations, and mass continuity is maintained through pressure projection. The model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as re-initialization of matrices and re-computation of preconditioners is required at every time step.

17 WIND ENERGY↗

Comparison of Heat Flux Predictions over the Blottner Cylinder and Sphere

The prediction of heat flux over a sphere in hypersonic flow is an interesting and challenging problem. When using solutions to the Navier-Stokes equations to predict the heat flux, a common source of numerical error is a phenomenon known as 'grid imprinting'. Rather than the axisymmetric heat flux profile expected for a spherical surface, the topology of the grid can be seen in the surface heat flux distribution. We will examine the origin of this phenomenon; specifically the regions of the grid that contribute most. Comparisons will be made between second order finite volume and Discontinuous Galerkin (DG) results — the DG results will range from 2 nd to 4 th order. The Dual Weighted Residual (DWR) framework is used to obtain local error estimates for the heat flux integrated over the surface with respect to the grid for the DG results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Deploy threading in Nalu solver stack

The goal of the ExaWind project is to enable predictive simulations of wind farms composed of many MW-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary code in the ExaWind project is Nalu, which is an unstructured-grid solver for the acousticallyincompressible Navier-Stokes equations, and mass continuity is maintained through pressure projection. The model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as re-initialization of matrices and re-computation of preconditioners is required at every time step In this Milestone, we examine the effect of threading on the solver stack performance against flat-MPI results obtained from previous milestones using Haswell performance data full-turbine simulations. Whereas the momentum equations are solved only with the Trilinos solvers, we investigate two algebraic-multigrid preconditioners for the continuity equations: Trilinos/Muelu and HYPRE/BoomerAMG. These two packages embody smoothed-aggregation and classical Ruge-Stiiben AMG methods, respectively. In our FY18 Q2 report, we described our efforts to improve setup and solve of the continuity equations under flat-MPI parallelism. While significant improvement was demonstrated in the solve phase, setup times remained larger than expected. Starting with the optimized settings described in the Q2 report, we explore here simulation performance where OpenMP threading is employed in the solver stack. For Trilinos, threading is acheived through the Kokkos abstraction where, whereas HYPRE/BoomerAMG employs straight OpenMP. We examined results for our mid-resolution baseline turbine simulation configuration (229M DOF). Simulations on 2048 Haswell cores explored the effect of decreasing the number of MPI ranks while increasing the number of threads. Both HYPRE and Trilinos exhibited similar overal solution times, and both showed dramatic increases in simulation time in the shift from MPI ranks to OpenMP threads. This increase is attributed to the large amount of work per MPI rank starting at the single-thread configuration. Decreasing MPI ranks, while increasing threads, may be increasing simulation time due to thread synchronization and start-up overhead contributing to the latency and serial time in the model. These result showed that an MPI+OpenMP parallel decomposition will be more effective as the amount per MPI rank computation per MPI rank decreases and the communication latency increases. This idea was demonstrated in a strong scaling study of our low-resolution baseline model (29M DOF) with the Trilinos-HYPRE configuration. While MPI-only results showed scaling improvement out to about 1536 cores, engaging threading carried scaling improvements out to 4128 cores — roughly 7000 DOF per core. This is an important result as improved strong scaling is needed for simulations to be executed over sufficiently long simulated durations (i.e., for many timesteps). In addition to threading work described above, the team examined solver-performance improvements by exploring communication-overhead in the HYPRE-GMRES implementation through a communicationoptimal- GMRE algorithm (CO-GMRES), and offloading compute-intensive solver actions to GPUs. To those ends, a HYPRE mini-app was allow us to easily test different solver approaches and HYPRE parameter settings without running the entire Nalu code. With GPU acceleration on the Summitdev supercomputer, a 20x speedup was achieved for the overall preconditioner and solver execution time for the mini-app. A study on Haswell processors showed that CO-GMRES provides benefits as one increases MPI ranks.

17 WIND ENERGY↗

Modeling of Water Film Formation on a Stay-Cable

With the increasing popularity of cable-stayed bridges in the past few decades, longer spans are being constructed using ever-longer stay cables. Under certain conditions, especially during construction, and wind and rain-wind events, the cables of cable-stayed bridges may undergo large amplitude vibrations. This type of vibration has been of concern to researchers and engineers because large amplitude vibration can induce excessive stresses and therefore threaten the safety and integrity of bridge structures. Figure 1-1 presents an example of a stay cable bridge structure, The Cooper River Bridge. Many countermeasures for the wind-rain induced vibrations have been developed to decrease the amplitude of the vibrations and consequently, the fatigue of the cables. One of the methods is to install helical fillets on the cable surface. A sketch of a cable with two fillets wrapped around it is shown in Figure 1-2. The main objective of the present study is to develop and test computational methodologies, with the use of computational fluid dynamics (CFD), that model the interaction of rain with stay cables including: the formation of water film, development of rainwater rivulets, and rivulet behavior under various conditions with and without wind. Interaction of water with cables with and without fillets is analyzed, and results are presented in this report. This study is divided into two parts. The first part of this study, Section 4, explores methods of modeling water film formation and flow on cables. A series of simulations using the Reynolds averaged Navier-Stokes equations turbulence model (RANS) and large eddy simulation (LES) model are performed to analyze water film formation and flow on a cable using the fluid film model in STARCCM+ [(b)1]. Various methods of setting up initial and boundary conditions are tested, especially boundary conditions for introducing rain into the domain. The second part of the study, Section 5, explores upper rivulet formation in the presence of wind, based on the findings from the first part of the study. In that section, LES simulation with the Volume Of Fluid model for the free surface is used. Also, various results for cases with and without water film on the cable are presented and compared.

42 ENGINEERING↗

Asynchronous Navier-Stokes Solver on 3D Unstructured Grids for the Exascale Era

This project has developed multiple fluid dynamics solvers for complex 3D flows using fully asynchronous distributed-memory task-parallel algorithms on top of the Charm++ runtime system. The algorithms solve the Euler or Navier-Stokes equations of compressible flows using unstructured tetrahedron meshes with optional solution-adaptive mesh-, and polynomial-order refinement. We have demonstrated excellent strong scaling up 50K compute cores and the benefits of Charm++’s automatic load balancing.

97 MATHEMATICS AND COMPUTING↗

Compare linear-system solver and preconditioner stacks with emphasis on GPU performance and propose phase-2 NGP solver development pathway

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind project are Nalu-Wind, which is an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, and OpenFAST, which is a whole-turbine simulation code. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. In this report we evaluated GPU-performance baselines for the linear solvers in the Trilinos and hypre solver stacks using two representative Nalu-Wind simulations: an atmospheric boundary layer precursor simulation on a structured mesh, and a fixed-wing simulation using unstructured overset meshes. Both strong-scaling and weak-scaling experiments were conducted on the OLCF supercomputer Summit and similar proxy clusters. We focused on the performance of multi-threaded Gauss-Seidel and two-stage Gauss-Seidel that are extensions of classical Gauss-Seidel; of one-reduce GMRES, a communication-reducing variant of the Krylov GMRES; and algebraic multigrid methods that incorporate the afore-mentioned methods. The team has established that AMG methods are capable of solving linear systems arising from the fixed-wing overset meshes on CPU, a critical intermediate result for ExaWind FY20 Q3 and Q4 milestones. For the fixed-wing strong-scaling study (model with 3M grid-points), the team identified that Nalu-Wind simulations with the new Trilinos and hypre solvers scale to modest GPU counts, maintaining above 70% efficiency up to 6 GPUs. However, there still remain significant bottlenecks to performance: matrix assembly (hypre), AMG setup (hypre and Trilinos) In the weak-scaling experiments (going from 0.4M to 211M gridpoints), it's shown that the solver apply phases are faster on GPUs, but that Nalu-Wind simulation times grow, primarily due to the multigrid-setup process. Finally, based on the report outcomes, we propose a linear solver path-forward for the remainder of the ExaWind project. Near term, the NREL team will continue their work on GPU-based linear-system assembly. They will also investigate how the use of alternatives to the NVIDIA UVM (unified virtual memory) paradigm affects performance. Longer term, the NREL team will evaluate algorithmic performance on other types of accelerators and merge their improvements back to the main hypre repository branch. Near term, the Trilinos team will address performance bottlenecks identified in this milestone, such as implementing a GPU-based segregated momentum solve and reusing matrix graphs across linear-system assembly phases. Longer term, the Trilinos team will do detailed analysis and optimization of multigrid setup.

17 WIND ENERGY↗

Demonstration and performance testing of extreme-resolution simulations with static meshes on Summit (CPU & GPU) for a parked-turbine configuration and an actuator-line (mid-fidelity model) wind farm configuration (ECP-Q4 FY2020 Milestone Report)

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind simulation environment are Nalu-Wind, an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, AMR-Wind, a block-structured-grid solver with adaptive mesh refinement capabilities, and OpenFAST, a wind-turbine structural dynamics solver. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and Helmholtz-type equations for transport of momentum and other scalars. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. The choice of overset-mesh methodology to model the moving and non-moving parts of the computational domain introduces constraint equations in the elliptic pressure-Poisson solver. The presence of constraints greatly affects the performance of algebraic multigrid preconditioners.

17 WIND ENERGY↗

Hydrodynamic instabilities and heat transfer characteristics in the duct flow of a fluid in the supercritical thermodynamic regime

The behavior of fluids at supercritical thermodynamic conditions is inherently complex due to large variations in thermodynamic and transport properties. Recent numerical and experimental investigations illustrate ongoing interest for these fluids, especially supercritical CO 2 and supercritical water, for a variety of applications. For example, supercritical water reactors (SCWR) operate in this extreme condition of high-pressure and temperature, resulting in highly dynamic flow fields and unexpected heat transfer regimes. The potential heat transfer benefits in this regime are directly associated with the extreme variations in thermodynamic and transport properties, which occur at, and above, the critical point. This work characterizes the hydrodynamic instabilities that arise for fluids at supercritical thermodynamic conditions when buoyancy forces are significant. Two specific configurations are considered, a natural convection cavity flow, and a mixed convection, heated, horizontal channel flow. Natural convection flow in a cavity is a classical configuration with expected behavior below the critical point. This configuration aids in characterizing the effect of the variable properties in the supercritical thermodynamic regime. Further, limited studies in the existing literature have been conducted for low-Reynolds and intermediate-Rayleigh numbers, mixed-convection channel flows for supercritical water, which is the focus of the channel flow configuration. To investigate the thermally driven hydrodynamic instabilities in this regime, a high-order fully-implicit numerical method is used. Such strong variations in thermophysical properties (in particular, density) are difficult to simulate and an altogether compressible framework is needed. Therefore, the compressible Navier-Stokes equations are solved without any additional assumptions. The fully implicit, high-order in space and time, reconstructed discontinuous Galerkin method as implemented within the multi-physics code called ALE3D (Arbitrary Lagrangian and Eulerian in 2D and 3D), developed at Lawrence Livermore National Laboratory (LLNL), is used. This fully implicit, L-stable method accurately captures the compressible nature of the ow in the limit of very low Mach number. It has been widely accepted that above the critical point, only one phase is observed. However, recent research has indicated the existence of the distinct gas-like and liquid-like regions separated by the Widom line, the locus of the maxima of the specific heat. Along the Widom line, density decreases 6-fold, viscosity drops by a factor of 2, while specific heat spikes by an order of magnitude. These variations, specifically in density and viscosity, produce a thick pseudo-interface and flow dynamics behavior akin to film boiling. A pseudo-film at the heated wall of the cavity and the horizontal channel is observed where buoyancy forces induce mixing through the specific configurations. Further the local Rayleigh and Richardson numbers provide maps of the flow field and the buoyancy forces driving the microscopic mixing. In the first chapter, I describe a background of supercritical fluid and the various applications. The second chapter focuses on the mathematical model and numerical method used for simulations, where a description of the equation of state for supercritical water is described. The third chapter focuses on the natural convection cavity with a heated bottom wall. In this cavity a gas-like and a liquid-like flow within the supercritical thermodynamic regime are observed. The fourth chapter focuses on a forced convection, horizontal channel, distinguishing between the gas-like, liquid-like, and mixed flow regimes. Mixed convection flow, with the addition of gravitational forces in the horizontal channel show the influence of variable properties on the hydrodynamic development, heat transfer, and rising instabilities. The last chapter of this research focuses on characterizing the unstable hydrodynamics through time-averaging processes and analysis of the movement of energy through the developing plumes.

42 ENGINEERING↗

Parameterization of arctic hydrometeor physics using new precipitation measurement technologies: Final Report

Predictions of precipitation are highly sensitive to the accuracy of parameterized growth and sedimentation processes, especially in remote regions such as the Arctic where observations are scarce. The goal of this study was to combine measurements of meteorological conditions and retrievals from passive and active remote sensors to provide refined parameterizations of precipitation properties and processes with a particular focus on the Arctic. To accomplish the project goals, new instrumentation was used from the Oliktok Point Mobile Facility and the Utqiagvik (Barrow) North Slope of Alaska ARM site focusing in particular on Multi-Angle Snowflake Camera (MASC) data. The MASC is the first device able to automatically photograph precipitation particles in free-fall from multiple angles while simultaneously measuring their fall speed. The MASC installed at the ARM Oliktok Point and Utqiagvik facilities was used to examine the nature of Arctic precipitation, taking particular advantage of the unique suite of precipitation, meteorological, and remote sensing instrumentation that is available at the high latitude sites. Combined with radiometer data we were able to explore the relationship between precipitation particle characteristics and the clouds where the snow is created. Ground-based wind measurements provided detailed data on turbulence. Further theoretical work explored the physical mechanisms controlling precipitation size distributions, the physics determining hydrometeor fallspeed, and the existence of general solutions to the Navier-Stokes equations for falling particles. Outreach work introduced hydrometeor classification to classrooms across the United States.

47 OTHER INSTRUMENTATION↗

Nalu-Wind and OpenFAST: A high-fidelity modeling and simulation environment for wind energy. Milestone ECP-Q2-FY19

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind project are Nalu-Wind, which is an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, and OpenFAST, which is a whole-turbine simulation code. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. This milestone represents the culmination of several parallel development activities towards the goal of establishing a full-physics simulation capability for modeling wind turbines operating in turbulent atmospheric inflow conditions. The demonstration simulation performed in this milestone is the first step towards the "ground truth" simulation and includes the following components: neutral atmospheric boundary layer inflow conditions generated using a precursor simulation, a hybrid RANS/LES simulation of the wall-resolved turbine geometry, hybridization of the turbulence equations using a blending function approach to transition from the atmospheric scales to the blade boundary layer scales near the turbine, fluid-structure interaction (FSI) that accounts for the complete set of blade deformations (bending, twisting and pitch motion, yaw and tower displacements) by coupling to a comprehensive turbine dynamics code (OpenFAST). The use of overset mesh methodology for the simulations in this milestone presents a significant deviation from the previous efforts where a sliding mesh approach was employed to model the rotation of the turbine blades. The choice of overset meshes was motivated by the need to handle arbitrarily large deformations of the blade and to allow for blade pitching in the presence of a controller and the ease of mesh generation compared to the sliding mesh approach. FSI and the new timestep algorithm used in the simulations were developed in partnership with the A2e High-Fidelity Modeling project. The individual physics components were verified and validated (V%V) through extensive code-to-code comparisons and with experiments where possible. The detailed V&V efforts provide confidence in the final simulation where these physics models were combined together even though no detailed experimental data is available to perform validation of the final configuration. Taken together, this milestone successfully demonstrated the most advanced simulation to date that has been performed with Nalu-Wind.

17 WIND ENERGY↗

High-order methods for wind turbine simulations and moving to next-generation platforms

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind project are Nalu-Wind, which is an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, and OpenFAST, which is a whole-turbine simulation code. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. This milestone represents an effort to increase the fidelity of Nalu-Wind at a fixed resolution through the implementation of a tensor-product based, matrix-free high order scheme. High order finite element methods have increased local work per datum communicated and have the potential to provide significantly more accurate solutions at a fixed number of degrees of freedom. Previous to this milestone, Nalu-Wind had an arbitrary order Control Volume Finite Element Method discretization as a solver option, but it required too much memory and was too slow to be of practical use. The work in this milestone addresses these issues by first implementing an implicit, high order solver that only partially assembles the global system. This reduces the memory footprint of the high-order scheme by orders of magnitude for higher polynomial orders. Second, a faster, tensor-product based method for evaluating the action of the left-hand side was implemented. This reduces the amount of computational work required by the scheme and dramatically enhanced the time-to-solution on example problems. Finally, this milestone is an evaluation of the value of high order methods in the wind application space. With the enhancements to memory and computational cost, accuracy vs. time-to-solution was evaluated for several resolutions on an under-resolved Taylor Green vortex test case. Results show that the high order scheme is cost-competitive with the production low-order schemes in Nalu-Wind, being moderately more expensive than the production edge-based vertex centered finite volume scheme. The evaluation of accuracy on the test case shows a potential benefit to high order at the highest resolution while not deteriorating accuracy on the lowest tested resolution. More work is needed to show value in the wind application, but positive strides have been made.

17 WIND ENERGY↗