Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Memory access optimization for particle operations in computational fluid dynamics-discrete element method simulations

Computational Fluid Dynamics - Discrete Element Method is used to model gas-solid systems in several applications in energy, pharmaceutical and petrochemical industries. Computational performance bottlenecks often limit the problem sizes that can be simulated at industrial scale. The data structures used to store several millions of particles in such large-scale simulations have a large memory footprint that does not fit into the processor cache hierarchies on current high-performance-computing platforms, leading to reduced computational performance. This paper specifically addresses this aspect of memory access bottlenecks in industrial scale simulations. The use of space-filling curves to improve memory access patterns is described and their impact on computational performance is quantified in both shared and distributed memory parallelization paradigms. The Morton space filling curve applied to uniform grids and k-dimensional tree partitions are used to reorder the particle data-structure thus improving spatial and temporal locality in memory. The performance impact of these techniques when applied to two benchmark problems, namely the homogeneous-cooling-system and a fluidized-bed, are presented. We report these optimization techniques lead to approximately two-fold performance improvement in particle focused operations such as neighbor-list creation and data-exchange, with ~ 1.5 times overall improvement in a fluidization simulation with 1.27 million particles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Atomic Edge-Guided Polyethylene Crystallization on Monolayer Two-Dimensional Materials

In this report we combine an advanced synthesis of two-dimensional (2D) materials (MoSe 2 ) having well-defined atomic edge configurations with ab initio and atomistic molecular dynamics (MD) simulations to study how atomic edges interact with polyethylene (HDPE) chains in a dilute solution assembly process. Our results reveal that Mo-terminated zigzag (Mo-ZZ) edges act as preferred nucleation sites and strongly interact with HDPE chains. The HDPE chains align in parallel with the Mo-ZZ edges and form arrays of lamellae that are perpendicular to the edges. Interestingly, atomic edge configurations are observed to dramatically change such interactions. The crystallization discrepancy at different edges was demonstrated on the same piece of MoSe 2 with different types of edges. The ab initio and MD simulations between n-alkane (n = 5 and 25), a segment of HDPE, and MoSe 2 suggest that the atomic structures of MoSe 2 can affect their interactions with n-alkane chains. Following the Mo-ZZ edge preferred nucleation principle, controlled long-range alignment of HDPE lamellae can be realized by creating multilayer MoSe 2 with parallel atomic steps. This research opens a pathway toward an atomic level understanding of polymer–2D nanomaterial interactions. It also bridges the gap between atomic-level and long-range mesoscopic structures and introduces a novel strategy for long-range structural control.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Testing predictions of electron scale turbulent pedestal transport in two DIII-D ELMy H-modes

In this study, we present linear and nonlinear gyrokinetic analyses in the pedestal region of two DIII-D ELMy H-mode discharges using the CGYRO code. The otherwise matched discharges employ different divertor configurations to investigate the impact of varying recycling and particle source on pedestal profiles. Linear gyrokinetic simulations find electrostatic ion-scale instabilities (ion temperature gradient and trapped electron modes, ITG-TEM) are present just inside the top of the pedestal with growth rates that are enhanced significantly by parallel velocity shear. In the sharp gradient region, E x B shearing rates are comparable or larger than ion scale growth rates, suggesting the suppression of ITG-TEM modes in this region. Instead, the electron temperature profiles are found to be correlated with and just above the electron temperature gradient (ETG) instability thresholds. Using gradients varied within experimental uncertainties, nonlinear electron-scale gyrokinetic simulations predict electron heat fluxes from ETG turbulence, that when added to neoclassical ion thermal transport simulated by NEO, account for 30-60% of the total experimental heat flux. In addition, the neoclassical electron particle flux is found to contribute significantly to the experimental fluxes inferred from SOLPS-ITER analysis. Additional nonlinear gyrokinetic simulations are run varying input gradients to develop a threshold-based reduced model for ETG transport, finding a relatively simple dependence on η e = L ne /L Te . Predictive transport simulations are used to validate this pedestal-specific ETG model, in conjunction with a model for neoclassical particle transport. In both discharges, the predicted electron temperatures are always overpredicted, indicative of the insufficient stiffness in the ETG pedestal model to account for all of the experimental electron thermal transport. In the case of the closed divertor discharge with lower particle source, the predicted electron density is close to the experiment, consistent with the magnitude of neoclassical particle transport in that discharge. However, the density profiles are overpredicted in the open divertor discharge (larger particle source), due to insufficient model transport. In conclusion, the implications for other mechanisms accounting for the remainder of transport in the sharp gradient region in the two discharges are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

On the Short-scale Spatial Variability of Electron Inflows in Electron-only Magnetic Reconnection in the Turbulent Magnetosheath Observed by MMS

We investigate the detailed properties of electron inflow in an electron-only reconnection event observed by the four Magnetospheric Multiscale (MMS) spacecraft in the Earth's turbulent magnetosheath downstream of the quasi-parallel bow shock. The lack of ion coupling was attributed to the small-scale sizes of the current sheets, and the observed bidirectional super-Alfvénic electron jets indicate that the MMS spacecraft crossed the reconnecting current sheet on both sides of an active X-line. Remarkably, the MMS spacecraft observed the presence of large asymmetries in the two electron inflows, with the inflows (normal to the current sheet) on the two sides of the reconnecting current layer differing by as much as a factor of four. Furthermore, even though the four MMS spacecraft were separated by less than seven electron skin depths, the degree of inflow asymmetry was significantly different at the different spacecraft. The asymmetry in the inflow speeds was larger with increasing distances downstream from the reconnection site, and the asymmetry was opposite on the two sides of the X-line. We compare the MMS observations with a 2D kinetic particle-in-cell (PIC) simulation and find that the asymmetry in the inflow speeds stems from in-plane currents generated via the combination of reconnection-mediated inflows and parallel flows along the magnetic separatrices in the presence of a large guide field.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

PeleLMeX: an AMR Low Mach Number Reactive Flow Simulation Code without level sub-cycling

PeleLMeX simulates chemically reacting low Mach number flows with block-structured adaptive mesh refinement (AMR). The code is built upon the AMReX library, which provides the underlying data structures and tools to manage and operate on them across massively parallel computing architectures. PeleLMeX algorithmic features are inherited from its predecessor PeleLM but key improvements allow representation of more complex physical processes. Together with its compressible flow counterpart PeleC, the thermo-chemistry library PelePhysics and the multi-physics library PeleMP, it forms the Pele suite of open-source reactive flow simulation codes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Clarifying the definition of ‘transonic’ screw dislocations

We report a number of recent Molecular Dynamics (MD) simulations have demonstrated that screw dislocations in face centred cubic (fcc) metals can achieve stable steady state motion above the lowest shear wave speed (v shear ) which is parallel to their direction of motion (often referred to as transonic motion). This is in direct contrast to classical continuum analyses which predict a divergence in the elastic energy of the host material at a crystal geometry dependent ‘critical’ velocity v crit . Within this work, we first demonstrate through analytic analyses that the elastic energy of the host material diverges at a dislocation velocity (v crit ) which is greater than v shear , i.e. v crit >v shear . We argue that it is this latter derived velocity (v crit ) which separates ‘subsonic’ and ‘supersonic’ regimes of dislocation motion in the analytic solution. In addition to our analyses, we also present a comprehensive suite of MD simulation results of steady state screw dislocation motion for a range of stresses and several cubic metals at both cryogenic and room temperatures. At room temperature, both our independent MD simulations and the earlier works find stable screw dislocation motion only below our derived v crit . Nonetheless, in real-world polycrystalline materials v crit cannot be interpreted as a hard limit for subsonic dislocation motion. In fact, at very low temperatures our MD simulations of Cu at 10 Kelvin confirm a recent claim in the literature that true ‘supersonic’ screw dislocations with dislocation velocities v>v crit are possible at very low temperatures.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

An Integrated High-performance Computing and Digital Real-time Simulation Testbed to Benchmark Closed-loop Load Shedding Algorithms in Power Systems

An integrated testbed using digital real-time simulator (DRTS) and a high-performance computing (HPC) cluster is presented here to compare speed and performance of computational schemes to mitigate time-critical issues in electric power systems. The first approach in this testbed validation is taken by running a set of closed-loop load shedding algorithms to compare and contrast two paradigms of arresting cascading failure propagation. Two algorithms involve solving DC and AC power flow model-based optimization problems to compute load shedding at different buses, while a model-based stochastic search using parallel computing provides a viable alternative. The algorithms are implemented in the DRTS-HPC testbed for the IEEE 14-bus benchmark transmission system. As a proof of the concept, simulation results are presented for implementation of closed-loop load-shedding algorithms for cascading failures in the DRTS-HPC testbed

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Effects of external magnetic fields on the multi-mode Rayleigh–Taylor instability

The magneto-Rayleigh–Taylor instability (mRTI) is a key process in inertial confinement fusion and is thought to be widespread in the interstellar medium, where it can concentrate plasma into discrete structures. We present resistive MHD simulations of the nonlinear evolution of multi-mode mRTI in both two and three dimensions, examining the effects of uniform external magnetic fields oriented either parallel or perpendicular to the initial interface. In both 2D and 3D, weak parallel fields enhance mixing-zone growth, whereas stronger fields suppress it. For perpendicular fields, growth is initially inhibited but becomes enhanced at later times. These behaviors arise from magnetic tension, which modifies flow anisotropy, buoyancy, drag, and vortex dynamics. The interplay of these mechanisms governs the distinct ways in which magnetic fields influence mRTI evolution.

Flow instabilities↗
DOE OSTI2021

Generalizable coordination of large multiscale workflows: challenges and learnings at scale

The advancement of machine learning techniques and the heterogeneous architectures of most current supercomputers are propelling the demand for large multiscale simulations that can automatically and autonomously couple diverse components and map them to relevant resources to solve complex problems at multiple scales. Nevertheless, despite the recent progress in workflow technologies, current capabilities are limited to coupling two scales. In the first-ever demonstration of using three scales of resolution, we present a scalable and generalizable framework that couples pairs of models using machine learning and in situ feedback. We expand upon the massively parallel Multiscale Machine-Learned Modeling Infrastructure (MuMMI), a recent, award-winning workflow, and generalize the framework beyond its original design. We discuss the challenges and learnings in executing a massive multiscale simulation campaign that utilized over 600,000 node hours on Summit and achieved more than 98% GPU occupancy for more than 83% of the time. We present innovations to enable several orders of magnitude scaling, including simultaneously coordinating 24,000 jobs, and managing several TBs of new data per day and over a billion files in total. Finally, we describe the generalizability of our framework and, with an upcoming open-source release, discuss how the presented framework may be used for new applications.

Bhatia, Harsh↗
DOE OSTI2024

Active Learning for Metamaterial Optimization on HPC and QC Integrated Systems

Active learning algorithms, integrating machine learning, quantum computing and optics simulation in an iterative loop, offer a promising approach to optimizing metamaterials. However, these algorithms can face difficulties in optimizing highly complex structures due to computational limitations. High-performance computing (HPC) and quantum computing (QC) integrated systems can address these issues by enabling parallel computing. In this study, we develop an active learning algorithm working on HPC-QC integrated systems. We evaluate the performance of optimization processes within active learning (i.e., training a machine learning model, problem-solving with quantum computing, and evaluating optical properties through wave-optics simulation) for highly complex metamaterial cases. Our results showcase that utilizing multiple cores on the integrated system can significantly reduce computational time, thereby enhancing the efficiency of optimization processes. Therefore, we expect that leveraging HPC-QC integrated systems helps effectively tackle large-scale optimization challenges in general.

Kim, Seongmin↗
DOE OSTI2021

A Segregated Approach for Modeling the Electrochemistry in the 3-D Microstructure of Li-Ion Batteries and Its Acceleration Using Block Preconditioners

Abstract Battery performance is strongly correlated with electrode microstructure. Electrode materials for lithium-ion batteries have complex microstructure geometries that require millions of degrees of freedom to solve the electrochemical system at the microstructure scale. A fast-iterative solver with an appropriate preconditioner is then required to simulate large representative volume in a reasonable time. In this work, a finite element electrochemical model is developed to resolve the concentration and potential within the electrode active materials and the electrolyte domains at the microstructure scale, with an emphasis on numerical stability and scaling performances. The block Gauss-Seidel (BGS) numerical method is implemented because the system of equations within the electrodes is coupled only through the nonlinear Butler–Volmer equation, which governs the electrochemical reaction at the interface between the domains. The best solution strategy found in this work consists of splitting the system into two blocks—one for the concentration and one for the potential field—and then performing block generalized minimal residual preconditioned with algebraic multigrid, using the FEniCS and the Portable, Extensible Toolkit for Scientific Computation libraries. Significant improvements in terms of time to solution (six times faster) and memory usage (halving) are achieved compared with the MUltifrontal Massively Parallel sparse direct Solver. Additionally, BGS experiences decent strong parallel scaling within the electrode domains. Last, the system of equations is modified to specifically address numerical instability induced by electrolyte depletion, which is particularly valuable for simulating fast-charge scenarios relevant for automotive application.

25 ENERGY STORAGE↗
DOE OSTI2020

Crystallographic orientation and spatially resolved damage in a dispersion-hardened Al alloy

The in-situ neutron diffraction technique, in combination with both the full-field crystal elasto-viscoplastic finite element model and microstructural characterization, was used to study the deformation-induced damage anisotropy in a commercial Al alloy, subjected to uniaxial tensile and cyclic loading. The simulations capture well the crystallographic-orientation-dependent lattice strain behavior. The hard grains, e.g. those orientated with the <111> and <422> orientations parallel with the uniaxial loading direction (LD), feature large Taylor factors and seem more prone to form damage-related band structures. Their effective elastic moduli decrease with the accumulation of damage, which are different from the soft grains orientated with the <200> orientation along the LD. Correlation between the distribution of voids and that of the residual lattice strain developed after failure may exist. The maximum tensile type residual lattice strain observed after failure may be resulted from the band structure formed in the hardest <111> grains. It was revealed that the band structure triggered by the hard particles could be one of sources of damage. In addition, while the specimen was obviously damaged, a fast stress relief was evidenced after unloading from the tension, especially at the beginning of unloading. Our present investigations provide a novel method for exploring the damage mechanisms of polycrystalline materials during plastic deformation.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Interfacial thermal conductance between multi-layer graphene sheets and solid/liquid octadecane: A molecular dynamics study

Mixtures of paraffin and carbon nanofillers have promising potential for thermal storage, as paraffin (the matrix) possesses high latent heat and the nanofillers compensate for the low thermal conductivity (TC) of paraffin. Understanding thermal transport in these materials is essential for practical applications, as weak thermal transport hinders fast charge/discharge of thermal energy. Here, we use non-equilibrium molecular dynamics (NEMD) simulations to study the interfacial thermal conductance (ITC) between graphene sheets and octadecane (C18H38) matrix under the limiting conditions of the sheets being parallel or perpendicular to the direction of the imposed heat flux. The findings show that the systems containing thin graphene layers exhibit higher values of ITC. This study captures the asymptotic saturation of thermal conductance for the liquid phase of the perpendicular structure. Besides, given the greater number of structured layers of paraffin upon phase change, the ITC for the solid paraffin-graphene system is higher than the conductance of the liquid paraffin-graphene interface. We use the Pearson correlation coefficients of the vibrational power spectrum (VPS) of interfacing materials to explain the orders of magnitude variations of the observed ITC.

25 ENERGY STORAGE↗
DOE OSTI2022

Isotropic-to-Nematic Transition in Salt-Free Polyelectrolyte Coacervates from Coarse-Grained Simulations

Recent interest in complex coacervation between oppositely charged polyelectrolytes (PEs) has been fueled by its relevance to biology in the context of membraneless organelle formation within living cells. For PEs with limited flexibility (such as double-stranded DNA), theoretical treatments and recent experiments have reported the emergence of liquid crystalline order (LCO) within the resulting coacervate phases. In this work, we study the underlying physics of this phenomenon using coarse-grained molecular dynamics simulations of symmetric semiflexible-semiflexible and asymmetric semiflexible-flexible coacervates. By comparing coacervates with the corresponding semidilute solutions of neutral polymers, we demonstrate that the presence of Coulomb interactions in coacervates facilitates orientational ordering, in agreement with theoretical predictions. Quantitative comparisons between our simulations and theory indicate that, for asymmetric nematic coacervates, the strong orientational ordering of stiff polyanions induces a weak ordering of the flexible polycations-an effect that was not anticipated by available theoretical studies. Simulations reveal that, for nematic coacervates, the preferred orientation of the PE chains at the liquid-liquid coacervate-supernatant interface is parallel, and the alignment of semiflexible PEs is homogeneous. The results presented here provide new molecular-level insights into the intracoacervate LCO and will help motivate further experimental and theoretical activities in this area.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Interfacial Inversion of Stealth Surfactants

Amphiphilic macromolecular surfactants segregate to liquid–liquid interfaces, thereby reducing the interfacial tension and free energy. Here, we investigated “stealth surfactants” in the form of core–shell bottlebrush polymers comprised of pH-responsive diblock copolymer side chains forming a hydrophilic core and a hydrophobic shell, enabling solubility in oil. At liquid–liquid interfaces, these polymers undergo a structural “inversion”, with hydrophilic blocks segregating into the aqueous phase and hydrophobic blocks residing in the oil phase. The reconfiguration kinetics and surfactant properties are influenced by multiple factors, including the molecular weights of the backbone and side chain components, the hydrophilic-to-hydrophobic balance of the side chains, and the pH of the aqueous phase. An observed nonmonotonic dependence of interfacial tension with time is attributed to a progressive structural inversion, where the projected area of the macromolecule onto the interface decreases. To validate this inversion hypothesis, interfacial properties were characterized by sum-frequency generation vibrational spectroscopy, which revealed configurational changes of the core–shell bottlebrush polymers at the fluid interface and revealed a pH-dependent interfacial coverage. Coarse-grained molecular dynamics simulations supported these experimental findings, showing that the pH-responsive core and hydrophobic shell assume a time-averaged configuration with orientations parallel and perpendicular to the plane of the interface, respectively. These findings open routes to design multistimuli-responsive polymeric surfactants and compatibilizers, expanding their potential applications in advanced interfacial systems.

Stealth surfactants↗
DOE OSTI2021

AENET–LAMMPS and AENET–TINKER : Interfaces for accurate and efficient molecular dynamics simulations with machine learning potentials

Machine-learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular dynamics and Monte Carlo simulations, an integration of the MLPs with sampling software is needed. Here, we develop two interfaces that link the atomic energy network (ænet) MLP package with the popular sampling packages TINKER and LAMMPS. The three packages, ænet, TINKER, and LAMMPS, are free and open-source software that enable, in combination, accurate simulations of large and complex systems with low computational cost that scales linearly with the number of atoms. Scaling tests show that the parallel efficiency of the ænet–TINKER interface is nearly optimal but is limited to shared-memory systems. The ænet–LAMMPS interface achieves excellent parallel efficiency on highly parallel distributed memory systems and benefits from the highly optimized neighbor list implemented in LAMMPS. We demonstrate the utility of the two MLP interfaces for two relevant example applications: the investigation of diffusion phenomena in liquid water and the equilibration of nanostructured amorphous battery materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗
DOE OSTI2023

Reassessing the MCNP Random Number Generator

Random number generators are integral components to Monte Carlo codes. They provide the pseudorandom number sequence used to actually sample the distributions of interest. As a result, they are one of the most important components to the software. The current recommended MCNP random number generator is a 63-bit linear congruential generator (LCG). This generator is quite fast, but it has some drawbacks. First, it only has a period of 2 63 . Due to the necessarily non-optimal usage of random numbers to ensure parallel reproducibility, this amount is too few to guarantee random number sequences are not reused in all configurations the code runs under. As simulation size increases, users will need to be aware of the limitations of the generator and tune configuration variables to best suit their simulations, or they will need to assume that reuse is not negatively affecting their answers. Neither of these are optimal. Second, small LCGs are fairly weak in bit generation quality, and this can have an unknown impact on the quality of the simulation. This paper is an investigation into whether or not more modern random number generators can supersede the current ones. The goal is to find a generator that is similar or superior in speed to the LCGs, has a state space large enough to make strong guarantees about random number reuse, and passes all modern random number test suites. If such a generator is found, it would eliminate the need for the user to even be aware of the limitations of the random number generator and would simplify the use of the code. This paper will be broken into several parts. Sec. 2 will discuss the evolution of the random number generator within the MCNP code. Sec. 3 will go over what a Monte Carlo code needs from a generator to be reproducible and portable and how the current generator behaves in that light. Sec. 4 goes through how each generator was tested. Finally, Sec. 5 will discuss improvements that could be made to the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗