Engineering Papers⌕ Search

Engineering topics

Sjogreen, Bjorn

Publications and source records attributed to Sjogreen, Bjorn.

At least 19 records

Acoustic Codes in 2D Spherical Coordinate

Finite-difference methods are widely used to simulate infrasound propagation in the atmosphere. Flexibility of finite-difference scheme allows implementation of highly heterogeneous media for sound propagation as well as complex source models for sound generation. While full 3-D finite-difference methods have been utilized for local infrasound propagation with pronounced topography, 2-D modeling approach has been preferred for regional and global propagation as full 3-D methods generally require enormous computational resources. Infrasound propagation is often simulated with a second-order finite difference scheme. This lowest-order finite-difference scheme is robust and straightforward to implement complex boundary conditions, but the solution includes large error with numerical dispersion and dissipation. This large numerical error may make the second-order finite-difference not optimal for long range infrasound propagation modeling as the numerical dispersion degrades the accuracy of the solution unacceptably. Here, we developed a high-order finite-difference solver for long-range infrasound simulation. The high-order scheme is particularly popular for linear wave modeling in aeroacoustics owing to its low-dispersive and low-dissipative behavior. We develop and evaluate a high-order finite difference scheme in 2-D axisymmetric coordinates. The axisymmetry allows to approximate 3-D spherical sound propagation and amplitude attenuation by a 2-D method. AC2Dr is developed to simulate infrasound propagation in realistic atmosphere, but can be used for linear acoustic waves in general materials with background flow. AC2Dr in an axisymmetric coordinates allows for spherical radiation of acoustic waves from compact sources.

Sjogreen, Bjorn↗

A New Class of AMG Interpolation Methods Based on Matrix-Matrix Multiplications

A new class of distance-two interpolation methods for algebraic multigrid (AMG) that can be formulated in terms of sparse matrix-matrix multiplications is presented and analyzed. Compared with similar distance-two prolongation operators, the proposed algorithms exhibit improved efficiency and portability to various computing platforms, since they allow one to easily exploit existing high-performance sparse matrix kernels. The new interpolation methods have been implemented in hypre, a widely used parallel multigrid solver library. With the proposed interpolations, the overall time of hypre's BoomerAMG setup can be considerably reduced, while sustaining equivalent, sometimes improved, convergence rates. Numerical results for a variety of test problems on parallel machines are presented that support the superiority of the proposed interpolation operators over the existing ones in hypre.

97 MATHEMATICS AND COMPUTING↗

EQSIM—A multidisciplinary framework for fault-to-structure earthquake simulations on exascale computers part I: Computational models and workflow

Computational simulations have become central to the seismic analysis and design of major infrastructure over the past several decades. Most major structures are now “proof tested” virtually through representative simulations of earthquake-induced response. More recently, with the advancement of high-performance computing (HPC) platforms and the associated massively parallel computational ecosystems, simulation is beginning to play a role in increased understanding and prediction of ground motions for earthquake hazard assessments. However, the computational requirements for regional-scale geophysics-based ground motion simulations are extreme, which has restricted the frequency resolution of direct simulations and limited the ability to perform the large number of simulations required to numerically explore the problem parametric space. In this article, recent developments toward an integrated, multidisciplinary earth science-engineering computational framework for the regional-scale simulation of both ground motions and resulting structural response are described with a particular emphasis on advancing simulations to frequencies relevant to engineered systems. This multidisciplinary computational development is being carried out as part of the US Department of Energy (DOE) Exascale Computing Project with the goal of achieving a computational framework poised to exploit emerging DOE exaflop computer platforms scheduled for the 2022–2023 timeframe.

58 GEOSCIENCES↗

Source Discretization Near Curvilinear Mesh Refinements in One Dimeions (Summer Internship Final Report)

Lawrence Livermore National Lab developed the seismic wave code SW4 for earthquake simulations, and has recently added the ability to specify mesh-refinement interfaces in the curvilinear mesh. The primary purpose of this is to allow for high resolution near the surface, with relatively fewer total points in the mesh leading to shorter computation time. Presently, the code does not allow for point-source forcing terms (commonly used in seismic simulations) to be located near these curvilinear mesh refinement interfaces. The goal of this internship was to investigate the discretization of point-source forcing terms in the seismic wave equation when the sources are located near the interfaces between two curvilinear meshes. Ultimately this will be incorporated into SW4 to allow for more realistic simulations to be carried out in this faster implementation.

97 MATHEMATICS AND COMPUTING↗

Entropy Stable Method for the Euler Equations Revisited: Central Differencing via Entropy Splitting and SBP

The two decades old high order central differencing via entropy splitting and summation-by-parts (SBP) difference boundary closure of Olsson & Oliger, Gerritsen & Olsson, and Yee et al. (15, 7, 37) is revisited. The objective of this paper is to prove for the first time that the entropy split scheme is an entropy stable method for central differencing with SBP operators for both periodic and non-periodic boundary conditions for nonlinear Euler equations. Standard high order spatial central differencing as well as high order central spatial DRP (dispersion relation preserving) spatial differencing is part of the entropy stable methodology framework. The proof is to replace the spatial derivatives by summation-by-parts (SBP) difference operators in the entropy split form of the equations using the physical entropy of the Euler equations. The numerical boundary closure follows directly from the SBP operator. No additional numerical boundary procedure is required. In contrast, Tadmor-type entropy conserving schemes (31) using mathematical entropies and more recently in (35], do not naturally come with a numerical boundary closure and a generalized SBP operator has to be developed (18). Long time integration of 2D and 3D test cases is included to show the comparison of this efficient entropy stable method with the Tadmor-type of entropy conservative methods. Studies also include the comparison among the three skew-symmetric splittings on their nonlinear stability and accuracy performance without added numerical dissipations for smooth flows. These are, namely, entropy splitting, Ducros et al. splitting and the Kennedy & Grubber splitting.

Sjogreen, Bjorn↗

High-Order Finite-Difference Nonlinear Filter Methods for Subsonic Turbulence Simulation with Stochastic Forcing

Numerical stability of high-order filter schemes developed by Yee & Sjogreen is tested on three-dimensional turbulence simulations with stochastic forcing and their performance is compared with that of TVD and WENO schemes. The best­ performing filter method employs an eighth-order central base scheme with the Kennedy & Gruber skew-symmetric splitting of the inviscid flux derivative, a wavelet-based local flow sensor, a nonlinear filter utilizing the dissipative portion of seventh-order \VENO scheme, and an explicit third - or fourth-order Runge­-Kutta time integration. We show that the filter scheme is more computational]y efficient and provides a wider spectral bandwidth compared to the seventh-order WENO scheme. The method also demonstrates robust long-time integration for moderately compressible turbulence. In contrast, the fifth- and seventh­ order WENO schemes show non-trivial evolution of the velocity and density power spectra. over a. few dozen dynamical times, where both TVD and filter schemes recover a so lid statistically stationary turbulent state

Kritsuk, Alexei G.↗

Entropy Stable Method for the Euler Equations Revisited: Central Differencing via Entropy Splitting and SBP

The two decades old high order central differencing via entropy splitting and summation-by-parts (SBP) difference boundary closure of Ols- son & Oliger (1994), Gerritsen & Olsson (1996), and Yee et al. (2000) is revisited. The entropy splitting is a form of skew-symmetric splitting of the nonlinear Euler flux derivatives. Central differencing applied to the entropy splitting form of the Euler flux derivatives together with SBP difference operators will, hereafter, be referred to as entropy split schemes. This study is prompted by the recent growing interest in numerical methods for which a discrete entropy conservation law holds, a discrete global entropy conservation can be proved and/or the numerical method possesses a stable entropy in the framework of SBP difference operators and L2-energy norm estimate. The objective of this paper is to recast the entropy split scheme as the re- cent definition of an entropy stable method for central differencing with SBP operators for both periodic and non-periodic boundary conditions for non- linear Euler equations. Standard high order spatial central differencing as well as high order central spatial DRP (dispersion relation preserving) spatial differencing is part of the entropy stable methodology framework. Long time integration of 2D and 3D test cases is included to show the comparison of this efficient entropy stable method with the Tadmor-type of entropy conservative methods. Studies also include the comparison among the three skew-symmetric splittings on their nonlinear stability and accuracy performance without added numerical dissipations for smooth flows. These are, namely, entropy splitting, Ducros et al. splitting and the Kennedy & Grub- ber splitting.

Sjogreen, Bjorn↗

Broadband (0–5 Hz) Fully Deterministic 3D Ground‐Motion Simulations of a Magnitude 7.0 Hayward Fault Earthquake: Comparison with Empirical Ground‐Motion Models and 3D Path and Site Effects from Source Normalized Intensities

We report on high‐performance computing (HPC) fully deterministic simulation of ground motions for a moment magnitude (⁠Mw⁠) 7.0 scenario earthquake on the Hayward fault resolved to 5 Hz using the SW4 finite‐difference code. We computed motions obeying physics‐based 3D wave propagation at a regional scale with an Mw 7.0 kinematic rupture model generated following Graves and Pitarka (2016). Both plane‐layered (1D) and 3D Earth models were considered, with 3D subsurface material properties and topography interpolated from a model of the U.S. Geological Survey (USGS). The resulting ground‐motion intensities cover a broader frequency range than typically considered in regional‐scale simulations, including higher frequencies relevant for engineering analysis of structures. Median intensities for sites across the domain are within the reported between‐event uncertainties (⁠τ⁠) of ground‐motion models (GMMs) across spectral periods 0.2–10 s (frequencies 0.1–5 Hz). The within‐event standard deviation ϕ of ground‐motion intensity measurement residuals range 0.2–0.5 natural log units with values consistently larger for the 3D model. Source‐normalized ratios of intensities (3D/1D) reveal patterns of path and site effects that are correlated with known geologic structure. These results demonstrate that earthquake simulations with fully deterministic wave propagation in 3D Earth models on HPC platforms produce broadband ground motions with median and within‐event aleatory variability consistent with empirical models. Systematic intensity variations for the 3D model caused by path and site effects suggest that these epistemic effects can be estimated and removed to reduce variation in site‐specific hazard estimates. This study motivates future work to evaluate the validity of the USGS 3D model and investigate the development of path and site corrections by running more scenarios.

Rodgers, Arthur J.↗

Numerical simulations of realistic grating compressors

Chirped pulse amplification (CPA), originally proposed by Strickland and Mourou, is a critical enabling technology for creating very short laser pulses with very high peak power. It consists of three optical components: a stretcher, an amplifier, and a compressor. An initial laser pulse of short duration and low energy content is first stretched out in time by the stretcher, resulting in a pulse with longer duration, low energy content, and very low peak power. The pulse is then amplified to increase its energy content without changing its duration in time. The amplified pulse is finally compressed in time in the compressor, resulting in a laser pulse with very short duration and very high peak power. The objective of this work is to develop numerical techniques that enable small-scale grating aberrations in the compressor to be analyzed through high performance computer simulations.

97 MATHEMATICS AND COMPUTING↗

SW4 final report for iCOE

The seismic simulation code SW4 was adapted to run on modern supercomputers. SW4 solves the elastic wave equation in second order formulation. It uses a fourth order accurate finite difference method with explicit time stepping. The approximation conserves energy perfectly, and is stable under a CFL restriction on the time step.

97 MATHEMATICS AND COMPUTING↗

Sierra Advances Resolution of Hayward Fault Earthquake Simulations

The character of strong earthquake shaking within a few kilometers of a fault is highly variable and poorly constrained by relatively few empirical recordings. Supercomputers enable simulation of earthquake motions to investigate the hazard and risk to buildings and infrastructure before damaging events occur. However, they require meter scale resolution to capture fine details in high frequency waves (5 - 10 Hz) on regional scales (~ 100 km).

58 GEOSCIENCES↗

Toward Exascale Earthquake Ground Motion Simulations for Near-Fault Engineering Analysis

Modernizing SW4 for massively parallel time-domain simulations of earthquake ground motions in 3D earth models increases resolution and provides ground motion estimates for critical infrastructure risk evaluations. Simulations of ground motions from large (M ≥ 7.0) earthquakes require domains on the order of 100 to500 km and spatial granularity on the order of 1 to5 m resulting in hundreds of billions of grid points. Surface-focused structured mesh refinement (SMR) allows for more constant grid point per wavelength scaling in typical Earth models, where wavespeeds increase with depth. In fact, MR allows for simulations to double the frequency content relative to a fixed grid calculation on a given resource. The authors report improvements to the SW4 algorithm developed while porting the code to the Cori Phase 2 (Intel Xeon Phi) systems at the National Energy Research Scientific Computing Center (NERSC) at Lawrence Berkeley National Laboratory. As a result, investigations of the performance of the innermost loop of the calculations found that reorganizing the order of operations can improve performance for massive problems.

58 GEOSCIENCES↗

High Order Accurate Finite Difference Modeling of Seismo-Acoustic Wave Propagation in a Moving Atmosphere and a Heterogeneous Earth Model Coupled Across a Realistic Topography

Here, we develop a numerical method for simultaneously simulating acoustic waves in a realistic moving atmosphere and seismic waves in a heterogeneous earth model, where the motions are coupled across a realistic topography. We model acoustic wave propagation by solving the linearized Euler equations of compressible fluid mechanics. The seismic waves are modeled by the elastic wave equation in a heterogeneous anisotropic material. The motion is coupled by imposing continuity of normal velocity and normal stresses across the topographic interface. Realistic topography is resolved on a curvilinear grid that follows the interface. The governing equations are discretized using high order accurate finite difference methods that satisfy the principle of summation by parts. We apply the energy method to derive the discrete interface conditions and to show that the coupled discretization is stable. The implementation is verified by numerical experiments, and we demonstrate a simulation of coupled wave propagation in a windy atmosphere and a realistic earth model with non-planar topography.

58 GEOSCIENCES↗

Running SW4 On New Commodity Technology Systems (CTS-1) Platform

We have recently been running earthquake ground motion simulations with SW4 on the new capacity computing systems, called the Commodity Technology Systems - 1 (CTS-1) at Lawrence Livermore National Laboratory (LLNL). SW4 is a fourth order time domain finite difference code developed by LLNL and distributed by the Computational Infrastructure for Geodynamics (CIG). SW4 simulates seismic wave propagation in complex three-dimensional Earth models including anelasticity and surface topography. We are modeling near-fault earthquake strong ground motions for the purposes of evaluating the response of engineered structures, such as nuclear power plants and other critical infrastructure. Engineering analysis of structures requires the inclusion of high frequencies which can cause damage, but are often difficult to include in simulations because of the need for large memory to model fine grid spacing on large domains.

58 GEOSCIENCES↗

Discretizing singular point sources in hyperbolic wave propagation problems

Here, we develop high order accurate source discretizations for hyperbolic wave propagation problems in first order formulation that are discretized by finite difference schemes. By studying the Fourier series expansions of the source discretization and the finite difference operator, we derive sufficient conditions for achieving design accuracy in the numerical solution. Only half of the conditions in Fourier space can be satisfied through moment conditions on the source discretization, and we develop smoothness conditions for satisfying the remaining accuracy conditions. The resulting source discretization has compact support in physical space, and is spread over as many grid points as the number of moment and smoothness conditions. In numerical experiments we demonstrate high order of accuracy in the numerical solution of the 1-D advection equation (both in the interior and near a boundary), the 3-D elastic wave equation, and the 3-D linearized Euler equations.

58 GEOSCIENCES↗

Wave propagation in anisotropic elastic materials and curvilinear coordinates using a summation-by-parts finite difference method

We develop a fourth order accurate finite difference method for solving the three-dimensional elastic wave equation in general heterogeneous anisotropic materials on curvilinear grids. The proposed method is an extension of the method for isotropic materials, previously described in the paper by Sjögreen and Petersson (2012) [11]. The method we proposed discretizes the anisotropic elastic wave equation in second order formulation, using a node centered finite difference method that satisfies the principle of summation by parts. The summation by parts technique results in a provably stable numerical method that is energy conserving. Also, we generalize and evaluate the super-grid far-field technique for truncating unbounded domains. Unlike the commonly used perfectly matched layers (PML), the super-grid technique is stable for general anisotropic material, because it is based on a coordinate stretching combined with an artificial dissipation. Moreover, the discretization satisfies an energy estimate, proving that the numerical approximation is stable. We demonstrate by numerical experiments that sufficiently wide super-grid layers result in very small artificial reflections. Applications of the proposed method are demonstrated by three-dimensional simulations of anisotropic wave propagation in crystals.

58 GEOSCIENCES↗

Serpentine: Finite Difference Methods for Wave Propagation in Second Order Formulation

Wave propagation phenomena are important in many DOE applications such as nuclear explosion monitoring, geophysical exploration, estimating ground motion hazards and damage due to earthquakes, non-destructive testing, underground facilities detection, and acoustic noise propagation. There are also future applications that would benefit from simulating wave propagation, such as geothermal energy applications and monitoring sites for carbon storage via seismic reflection techniques. In acoustics and seismology, it is of great interest to increase the frequency bandwidth in simulations. In seismic exploration, greater frequency resolution enables shorter wave lengths to be included in the simulations, allowing for better resolution in the seismic imaging. In nuclear explosion monitoring, higher frequency seismic waves are essential for accurate discrimination between explosions and earthquakes. When simulating earthquake induced motion of large structures, such as nuclear power plants or dams, increased frequency resolution is essential for realistic damage predictions. Another example is simulations of micro-seismic activity near geothermal energy plants. Here, hydro-fracturing induces many small earthquakes and the time scale of each event is proportional to the square root of the moment magnitude. As a result, the motion is dominated by higher frequencies for smaller seismic events. The above wave propagation problems are all governed by systems of hyperbolic partial differential equations in second order differential form, i.e., they contain second order partial derivatives of the dependent variables. Our general research theme in this project has been to develop numerical methods that directly discretize the wave equations in second order differential form. The obvious advantage of working with hyperbolic systems in second order differential form, as opposed to rewriting them as first order hyperbolic systems, is that the number of differential equations in the second order system is significantly smaller. Another issue with re-writing a second order system into first order form is that compatibility conditions often must be imposed on the first order form. These (Saint-Venant) conditions ensure that the solution of the first order system also satisfies the original second order system. However, such conditions can be difficult to enforce on the discretized equations, without introducing additional modeling errors. This project has previously developed robust and memory efficient algorithms for wave propagation including effects of curved boundaries, heterogeneous isotropic, and viscoelastic materials. Partially supported by internal funding from Lawrence Livermore National Laboratory, many of these methods have been implemented in the open source software WPP, which is geared towards 3-D seismic wave propagation applications. This code has shown excellent scaling on up to 32,768 processors and has enabled seismic wave calculations with up to 26 Billion grid points. The WPP calculations have resulted in several publications in the field of computational seismology, e.g.. All of our current methods are second order accurate in both space and time. The benefits of higher order accurate schemes for wave propagation have been known for a long time, but have mostly been developed for first order hyperbolic systems. For second order hyperbolic systems, it has not been known how to make finite difference schemes stable with free surface boundary conditions, heterogeneous material properties, and curvilinear coordinates. The importance of higher order accurate methods is not necessarily to make the numerical solution more accurate, but to reduce the computational cost for obtaining a solution within an acceptable error tolerance. This is because the accuracy in the solution can always be improved by reducing the grid size h. However, in practice, the available computational resources might not be large enough to solve the problem with a low order method.

15 GEOTHERMAL ENERGY↗

LLNL-Generated Content for the California Academy of Sciences, Morrison Planetarium Full-Dome Show: 'Earthquake'

The California Academy of Sciences (CAS) Morrison Planetarium is producing a 'full-dome' planetarium show on earthquakes and asked LLNL to produce content for the show. Specifically the show features numerical ground motion simulations of the M 7.9 1906 San Francisco and a possible future M 7.05 Hayward fault scenario earthquake. The show also features concepts of plate tectonics and mantle convection using images from LLNL's G3D global seismic tomography. This document describes the data that was provided to the CAS in support of production of the 'Earthquake' show. The CAS is located in Golden Gate Park, San Francisco and hosts over 1.6 million visitors. The Morrison Planetarium, within the CAS, is the largest all digital planetarium in the world. It features a 75-foot diameter spherical section projection screen tilted at a 30-degree angle. Six projectors cover the entire field of view and give a three-dimensional immersive experience. CAS shows strive to use scientifically accurate digital data in their productions. The show, entitled simply 'Earthquake', will debut on 26 May 2012. They are working on graphics and animations based on the same data sets for display on LLNL powerwalls and flat-screens as well as for public release.

58 GEOSCIENCES↗