Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Task Based Approach for Co-Scheduling Ensemble Workloads on Heterogeneous Nodes

Scientific workflows consist of multiple, connected applications, with data and results flowing from one to another in a pipeline. Traditionally, such workflows are executed in sequential order, storing intermediate data in storage disks. Co-scheduling application workflows concurrently on the same compute nodes would greatly reduce the cost of moving data to/from storage and allow real-time analysis of intermediate results. Nevertheless, most parallel programming runtimes do not allow seamless integration of various applications in a scientific workflow, in part due to the complexity of managing data and resources. The situation is even more complicated for heterogeneous systems. In this work we extend the Minos Computing Library (MCL) runtime to accelerate pipe-lined and parallel workloads where multiple applications are running in the same system. MCL’s asynchronous task library and runtime dynamically manages resources to allow co-scheduling of multiple processes sharing heterogeneous resources. In addition, we design a custom ex- tension of the Open Compute Language (OpenCL) to enable multiple processes to share device memory. We enable MCL to coordinate these shared buffers to allow for easy, fast data sharing between applications. Using malleable micro-benchmarks and two application workflows that combine scientific simulation and AI-based analysis, we show that our method outperforms traditional approaches.

Index Terms—Parallel systems, Scheduling and Task ↗
DOE OSTI2022

Simulation of the Impact of Point Defects and Edge Dislocations on X-Ray Diffraction in Hexagonal (Ni,Co) 1+2 x Ti 1– x O 3 Thin Films

In this work, a computer code for simulating high-resolution X-ray diffraction (XRD) data from disordered crystals with arbitrary spatial composition and local lattice parameters is developed. Simulated patterns are compared with the experimental data collected on a single phase, highly crystalline (Ni 0.42 Co 0.58 ) 2.22 Ti 0.39 O 3 solid-solution thin film exhibiting a large number of subsidiary minima. As a case study, the edge dislocations in hexagonal (Ni,Co) 3 O 3 thin films with Burgers vector parallel and perpendicular to the a-axis and c-axis, respectively, are modeled. No peak profiles are assumed and thus issues related to profile fitting are avoided. Both macroscopic features, such as film thickness, and atomic-scale structure, such as dislocations, are simultaneously modeled. Simulations are run on a desktop machine. Commonly applied database-based phase identification routines can result in wrong phase identification, unless intensities are properly modeled. Modeling tools of diffractometer manufacturers are compared with the present approach. An example of how simulated reciprocal lattice patterns can be used to choose relevant measurement geometries in defected thin films is given.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Neural Networks for Nuclear Reactions in MAESTROeX

We demonstrate the use of neural networks to accelerate the reaction steps in the MAESTROeX stellar hydrodynamics code. A traditional MAESTROeX simulation uses a stiff ODE integrator for the reactions; here, we employ a ResNet architecture and describe details relating to the architecture, training, and validation of our networks. Our customized approach includes options for the form of the loss functions, a demonstration that the use of parallel neural networks leads to increased accuracy, and a description of a perturbational approach in the training step that robustifies the model. We test our approach on millimeter-scale flames using a single-step, 3-isotope network describing the first stages of carbon fusion occurring in Type Ia supernovae. We train the neural networks using simulation data from a standard MAESTROeX simulation, and show that the resulting model can be effectively applied to different flame configurations. This work lays the groundwork for more complex networks, and iterative time-integration strategies that can leverage the efficiency of the neural networks.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Comparison of Biotite Elastic Properties Recovered by Spherical Nanoindentations and Atomistic Simulations — Influence of Nano-Scale Defects in Phyllosilicates

Phyllosilicate minerals, due to their sheets structure and morphology, are known to cause anisotropy in bulk rock properties and make the bulk rock more compliant. Accurately characterizing the micromechanical behavior of phyllosilicate minerals from laboratory observations, which eventually translates to the bulk rock behavior, is still challenging due to their fine-grained nature. Recent advances in atomistic simulations open the possibility of theoretically investigating such mineral mechanical behavior. We compare the elastic properties of biotites recovered by spherical nanoindentation with those predicted from density functional theory (DFT) simulations to investigate to what extent theoretical predictions reproduce actual phyllosilicate properties. Spherical nanoindentation was conducted using schist rocks from Poorman Formation, South Dakota, USA, to recover continuous indentation stress-strain curves. Loading in the layer-normal orientation shows an average indentation modulus (M) of about 35 GPa, while loading in the layer-parallel orientation gives a higher average of about 95 GPa. To facilitate comparison, the elastic stiffness constants (cij) determined from DFT were converted to indentation modulus (M) using solutions proposed in this study. The majority of the nanoindentation modulus results are below the values inferred from the simulation results representing ideal defect-free minerals. We suggest that crystal defects present at the nano-scale, potentially ripplocations, are the dominant cause of the lower indentation modulus recovered from nanoindentation compared to those inferred from DFT simulations. Results highlight the importance of acknowledging the defects that exist down to the nano-scale as it modifies the mechanical properties of phyllosilicates compared to its pure defect-free form.

58 GEOSCIENCES↗
DOE OSTI2023

A numerical solver for investigating the space charge effect on the electric field in liquid argon time projection chambers

This paper reports the development of a numerical solver aimed to simulate the interaction between the space charge (i.e. ions) distribution and the electric field in liquid argon time projection chamber (LArTPC) detectors. The ion transport equation is solved by a time-accurate, cell-centered finite volume method and the electric potential equation by a continuous finite element method. The electric potential equation updates the electric field which provides the drift velocity to the ion transport equation. The ion transport equation updates the space charge density distribution which appears as the source term in the electric potential equation. The interaction between the space charge distribution and the electric field is numerically simulated within each physical time step. The convective velocity in the ion transport equation can include the background flow velocity in addition to the electric drift velocity. The numerical solver has been parallelized using the Message Passing Interface (MPI) library. Numerical tests show and verify the capability and accuracy of the current numerical solver. It is planned that the developed numerical solver, together with a Computational Fluid Dynamics (CFD) package which provides the flow velocity field, can be used to investigate the space charge effect on the electric field in large-scale particle detectors.

42 ENGINEERING↗
DOE OSTI2023

Efficient phase-space generation for hadron collider event simulation

We present a simple yet efficient algorithm for phase-space integration at hadron colliders. Individual mappings consist of a single t-channel combined with any number of s-channel decays, and are constructed using diagrammatic information. The factorial growth in the number of channels is tamed by providing an option to limit the number of s-channel topologies. We provide a publicly available, parallelized code in C++ and test its performance in typical LHC scenarios.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

A 1D coupled transport/cold plasma wave model for parallel ponderomotive density modification near RF actuators

The plasma density profile close to RF actuators plays a vital role in the efficiency of power coupling from the antenna to the core plasma of fusion devices. Nonlinear interactions can be significant when considering the interaction of applied RF power and the tenuous SOL plasma, and the inclusion of this region in computational analysis is essential to providing robust predictive simulations of plasma response to RF application. Of particular interest is the observed density modification during RF operation. Here we present a self consistent description of the nonlinear ponderomotive force in the antenna near field region, via coupling a 1D field aligned transport model with a 1D cold plasma wave model. Results are presented, which show a parallel electric field of 300 Vm -1 drove a density reduction of ~ 20% over 25 RF periods.

Barnett, Rhea↗
DOE OSTI2022

Enabling Modular Autonomous Feedback‐Loops in Materials Science through Hierarchical Experimental Laboratory Automation and Orchestration

Abstract Materials acceleration platforms (MAPs) operate on the paradigm of integrating combinatorial synthesis, high‐throughput characterization, automatic analysis, and machine learning. Within a MAP, one or multiple autonomous feedback loops may aim to optimize materials for certain functional properties or to generate new insights. The scope of a given experiment campaign is defined by the range of experiment and analysis actions that are integrated into the experiment framework. Herein, the authors present a method for integrating many actions within a hierarchical experimental laboratory automation and orchestration (HELAO) framework. They demonstrate the capability of orchestrating distributed research instruments that can incorporate data from experiments, simulations, and databases. HELAO interfaces laboratory hardware and software distributed across several computers and operating systems for executing experiments, data analysis, provenance tracking, and autonomous planning. Parallelization is an effective approach for accelerating knowledge generation provided that multiple instruments can be effectively coordinated, which the authors demonstrate with parallel electrochemistry experiments orchestrated by HELAO. Efficient implementation of autonomous research strategies requires device sharing, asynchronous multithreading, and full integration of data management in experimental orchestration, which to the best of the authors’ knowledge, is demonstrated for the first time herein.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Implementing a neural network interatomic model with performance portability for emerging exascale architectures

The two main thrusts of computational science are increasingly accurate predictions and faster calculations; to this end, the zeitgeist in molecular dynamics (MD) simulations is pursuing machine learned and data driven interatomic models, e.g. neural network potentials, and novel hardware architectures, e.g. GPUs. Current implementations of neural network potentials are orders of magnitude slower than traditional interatomic models and while looming exascale computing offers the ability to run large, accurate simulations with these models, achieving portable performance for MD with new and varied exascale hardware requires rethinking traditional algorithms, using novel data structures, and library solutions. We re-implement a neural network interatomic model in CabanaMD, an MD proxy application, built on libraries developed for performance portability. Our implementation shows significantly improved thread scaling in this complex kernel as compared to a current LAMMPS implementation, across both strong and weak scaling. Our single-source solution enables simulations up to 20 million atoms on a single CPU node and 4 million atoms with improved performance on a single GPU. Furthermore, we also explore parallelism and data layout choices (using flexible data structures called AoSoAs) and their effect on performance, seeing up to ~50% and ~5% improvements in performance on a GPU by choosing the right level of parallelism and data layout respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Smoother Surfaces Enhance Diffusion of Nanorods in Entangled Polymer Melts

Coarse-grained molecular dynamics simulations are used to study the diffusion of thin nanorods in entangled polymer melts for varying nanorod length and roughness. While prior studies observed a nanorod parallel diffusion constant scaling inversely with rod length D ∥ ~ l –1 , here, we show that this scaling is not universal and depends sensitively on the nanorod surface roughness. We observe D ∥ ~ l –k , where k < 1 and decreases with decreasing surface roughness. The weaker scaling is driven by the non-Gaussian diffusion of nanorods due to the emergence of an intermittent hopping process that becomes more pronounced with decreasing roughness at the monomer scale. Analysis shows that the mean hop size grows for smoother rods but shows little to no variation with rod length. The mean hopping frequency shows no dependence on either rod length or roughness, suggesting it originates from the polymer melt environment. Further, our results show that the small-scale features of the nanorod surface strongly influence the large-scale and long-time transport of nanorods in polymer matrices, creating new material design opportunities for precisely engineered nanocomposites.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2022

Two-dimensional parametric design of short pulse laser driven iron opacity experiments

High intensity short pulse lasers are commonly used to create high temperature and high density plasmas. These plasmas are used to study fundamental properties such as the equation of state and opacity. The targets often use small-diameter, thin buried layers of the materials of interest, surrounded by a tamper of low atomic number material such as plastic. Computational modeling is used to design and interpret experiments with short pulse lasers. Most of the modeling to date has assumed one-dimensional plane-parallel geometry. In this paper, the effects of radial gradients in the irradiation of thin planar targets are studied with one- and two-dimensional radiation/hydrodynamic simulations. It is found that the main effect of radial gradients is the averaging of plasma conditions and x-ray emission over the pattern of irradiation. Additionally, differences between one- and two-dimensional simulations arise because the plasma conditions and x-ray emission are, in general, nonlinear functions of the temperature of the plasma and thereby also nonlinear functions of the irradiation intensity. The differences increase with the ratio of the buried layer radius to the laser spot radius. The root mean square difference in the inferred iron L-shell opacity is less than 30% when the ratio is less than 1.0 and about 70% when the ratio is 1.5.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Polar liquids at charged interfaces: A dipolar shell theory

The structure of polar liquids and electrolytic solutions, such as water and aqueous electrolytes, at interfaces underlies numerous phenomena in physics, chemistry, biology, and engineering. In this work, we develop a continuum theory that captures the essential features of dielectric screening by polar liquids at charged interfaces, including decaying spatial oscillations in charge and mass, starting from the molecular properties of the solvent. The theory predicts an anisotropic dielectric tensor of interfacial polar liquids previously studied in molecular dynamics simulations. We explore the effect of the interfacial polar liquid properties on the capacitance of the electrode/electrolyte interface and on hydration forces between two plane-parallel polarized surfaces. In the linear response approximation, we obtain simple formulas for the characteristic decay lengths of molecular and ionic profiles at the interface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

The JOREK non-linear extended MHD code and applications to large-scale instabilities and their control in magnetically confined fusion plasmas

JOREK is a massively parallel fully implicit non-linear extended magneto-hydrodynamic (MHD) code for realistic tokamak X-point plasmas. It has become a widely used versatile simulation code for studying large-scale plasma instabilities and their control and is continuously developed in an international community with strong involvements in the European fusion research programme and ITER organization. This article gives a comprehensive overview of the physics models implemented, numerical methods applied for solving the equations and physics studies performed with the code. A dedicated section highlights some of the verification work done for the code. A hierarchy of different physics models is available including a free boundary and resistive wall extension and hybrid kinetic-fluid models. The code allows for flux-surface aligned iso-parametric finite element grids in single and double X-point plasmas which can be extended to the true physical walls and uses a robust fully implicit time stepping. Particular focus is laid on plasma edge and scrape-off layer (SOL) physics as well as disruption related phenomena. Among the key results obtained with JOREK regarding plasma edge and SOL, are deep insights into the dynamics of edge localized modes (ELMs), ELM cycles, and ELM control by resonant magnetic perturbations, pellet injection, as well as by vertical magnetic kicks. Also ELM free regimes, detachment physics, the generation and transport of impurities during an ELM, and electrostatic turbulence in the pedestal region are investigated. Regarding disruptions, the focus is on the dynamics of the thermal quench (TQ) and current quench triggered by massive gas injection and shattered pellet injection, runaway electron (RE) dynamics as well as the RE interaction with MHD modes, and vertical displacement events. Also the seeding and suppression of tearing modes (TMs), the dynamics of naturally occurring TQs triggered by locked modes, and radiative collapses are being studied.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Using Direct Laboratory Measurements of Electron Temperature Anisotropy to Identify the Heating Mechanism in Electron-Only Guide Field Magnetic Reconnection

Anisotropic electron heating during electron-only magnetic reconnection with a large guide magnetic field is directly measured in a laboratory plasma through in situ measurements of electron velocity distribution functions. Electron heating preferentially parallel to the magnetic field is localized to one separatrix, and anisotropies of 1.5 are measured. The mechanism for electron energization is identified as the parallel reconnection electric field because of the anisotropic nature of the heating and spatial localization. These characteristics are reproduced in a 2D particle-in-cell simulation and are also consistent with numerous magnetosheath observations. A measured increase in the perpendicular temperature along both separatrices is not reproduced by our 2D simulations. Here, this work has implications for energy partition studies in magnetosheath and laboratory reconnection.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

JADE

JADE provides a simple, flexible interface to submit jobs to an HPC. JADE is an HPC workflow management system that enables researchers to run simulations efficiently. It provides a simple, flexible interface to define jobs, as well as dependencies between jobs, and then dispatch them to an HPC with maximized parallelization. It also provides detailed error reporting and resource utilization statistics to aid in debugging problems.

Thom, Daniel↗
DOE OSTI2025

Scaling Field-Theoretic Simulation for Multicomponent Mixtures with Neural Operators

Multicomponent polymer mixtures are ubiquitous in biological self-organization but are notoriously difficult to study computationally. Plagued by both slow single molecule relaxation times and slow equilibration within dense mixtures, molecular dynamics simulations are typically infeasible at the spatial scales required to study the stability of mesophase structure. Polymer field theories offer an attractive alternative, but analytical calculations are only tractable for mean-field theories and nearby perturbations, constraints that become especially problematic for fluctuation-induced effects such as coacervation. Here, we show that a recently developed technique for obtaining numerical solutions to partial differential equations based on operator learning, neural operators, lends itself to a highly scalable training strategy by parallelizing per-species operator maps. We illustrate the efficacy of our approach on six-component mixtures with randomly selected compositions and that it significantly outperforms the state-of-the-art pseudospectral integrators for field-theoretic simulations, especially as polymer lengths become long.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Uncovering grain and subgrain microstructure at the scale of additive manufacturing melt tracks with a scalable cellular automaton solidification model

Metal additive manufacturing, characterized by rapid solidification, yields refined grains with a distinctive cellular subgrain microstructure that plays a pivotal role in determining material properties. Due to the significant computational expense demanded to simulate the required physics with submicron spatial resolution, their numerical simulations have been limited to proof-of-concept studies to either 2D or small subregions of a melt pool. In this study, an open-source, scalable, solidification code, muMatScale, based on the cellular automaton method, has been developed to predict the grain and the underlying subgrain microstructure over an entire melt pool. The model incorporates flexible parallelization schemes, utilizing MPI and OpenMP GPU Offloading, in addition to appropriate multi-physics specific to non-equilibrium rapid solidification in AM. The impact of nucleation parameters on grain microstructures was investigated with a focus on grain size variations and morphology transitions. With selected nucleation parameters, the simulation predicted the grain size, subgrain morphology, crystallographic orientation, and microsegregation aligned with experimental measurements. The model demonstrates that epitaxial grain growth is a dominant factor at the melt pool boundary, influencing grain size variation under different grain sizes in the build plate while maintaining consistent primary dendrite arm spacing under identical thermal conditions. Here, the highly efficient numerical model enables large-scale simulations with a spatial resolution of 100 nm or less, unveiling unprecedented insights into thermal and solutal diffusion driven grain growth, and the subgrains with microsegregation within grains in 3D across scales. muMatScale will enable the linking of submicron length-scale microstructure to part-level material behavior by investigating fundamental solidification problems at the intercellular scale in many-track and many-layer builds.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Fast and Accurate Core Analysis by the Full-Immersion Pressure-Pulse Decay: Part 1—Theory

Summary Core-scale measurements are considered the ground truth that oil and gas or electric utility companies use to predict the migration of fluids such as oil, natural gas, carbon dioxide, or brine deep underground during their extraction or injection operations. To provide a greater understanding of petrophysical properties of low-permeability geologic formations such as shales and tight gas sandstones, this study introduces a novel core-analysis procedure. The technique follows conventional pressure-pulse-decay permeametry, where the pressure in an inlet chamber adjacent to a cylindrical core plug undergoes a rapid pressurization, the system is shut in, and the pressure reaches a new equilibrium. However, unlike a standard unidirectional pressure-pulse decay, the full-immersion pressure-pulse decay (Hannon 2019) applies a pressure disturbance to the entire outer surface area of the sample. This article covers the numerical simulator designed to model flow through an anisotropic porous sample in this scenario. The model assumes distinct but uniform permeabilities along the radial and axial directions of the cylindrical plug sample. When extracting a plug vertically (or perpendicular to bedding), the permeability along the radial direction associates with the horizontal permeability (i.e., parallel to bedding), whereas in the axial direction, flow occurs perpendicular to bedding (a vertical permeability). Investigations of these model outputs demonstrate an approximately 20-fold decrease in time to complete a full-immersion experiment compared with conventional pressure-pulse decay. Furthermore, the pressure-decay curves resulting from the full-immersion method have slightly different shapes than those resulting from other unidimensional transient methods. These differences begin to demonstrate that, under achievable experimental conditions, the analysis of pressure data from one full-immersion test could enable the simultaneous estimation of the apparent permeabilities parallel and perpendicular to bedding of a cylindrical sample in addition to its porosity. A follow-up article finalizes the proof of this capability with a parameter-estimation procedure and presents experimental verification through a proof-of-concept study. Described in greater detail in that article, the parameter estimator requires multiple forward simulations to analyze the data, which behooves minimizing the compute time for each simulation. By using an alternating direction implicit time-marching scheme and a structured but variably spaced grid, the numerical simulator built for this purpose provides a forward model output with suitable accuracy in approximately 0.5 seconds.

Energy & Fuels↗