Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluation of intracoronary hemodynamics identifies perturbations in vorticity

Coronary artery disease (CAD) is highly prevalent and associated with adverse events. Challenges have emerged in the treatment of intermediate coronary artery stenoses. These lesions are often interrogated with fractional flow reserve (FFR) testing to determine if a stenosis is likely to be causative for ischemia in a cardiac territory. This invasive test requires insertion of a pressure wire into a coronary vessel. Recently computational fluid dynamics (CFD) has been used to noninvasively assess fractional flow reserve in vessels reconstructed from medical imaging data. However, many of these simulations are unable to provide additional information about intravascular hemodynamics, including velocity, endothelial shear stress (ESS), and vorticity. We hypothesized that vorticity, which has demonstrated utility in the assessment of ventricular and aortic diseases, would also be an important hemodynamic factor in CAD. Three-dimensional (3D), patient-specific coronary artery geometries that included all vessels >1 mm in diameter were created from angiography data obtained from 10 patients who underwent diagnostic angiography and FFR testing (n = 9). A massively parallel CFD solver (HARVEY) was used to calculate coronary hemodynamic parameters including pressure, velocity, ESS, and vorticity. These simulations were validated by comparing velocity flow fields from simulation to both velocities derived from in vitro particle image velocimetry and to invasively acquired pressure wire-based data from clinical testing. There was strong agreement between findings from CFD simulations and particle image velocimetry experimental testing (p < 0.01). CFD-FFR was also highly correlated with invasively measured FFR (ρ = 0.77, p = 0.01) with an average error of 5.9 ± 0.1%. CFD-FFR also had a strong inverse correlation with the vorticity (ρ = -0.86, p = 0.001). Simulations to determine the effect of the coronary stenosis on intravascular hemodynamics demonstrated significant differences in velocity and vorticity (both p < 0.05). Further evaluation of an angiographically normal appearing non-FFR coronary vessel in patients with CAD also demonstrated differences in vorticity when compared with FFR vessels (p < 0.05). The use of highly accurate 3D CFD-derived intravascular hemodynamics provides additional information beyond pressure measurements that can be used to calculate FFR. Vorticity is one parameter that is modified by a coronary stenosis and appears to be abnormal in angiographically normal vessels in patients with CAD, highlighting a possible use-case in preventative screening for early coronary disease.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗
DOE OSTI2025

Performance Portability Evaluation of Fluid-Structure Interaction Simulations on Heterogeneous Platforms

The rapid proliferation of heterogeneous programming languages and multi-vendor hardware has underscored the critical need to evaluate the performance portability of scientific applications. In this work, we present the systematic porting and optimization of a massively parallel fluid-structure interaction code across multiple heterogeneous programming frameworks for deployment on leadership-class supercomputers from major vendors. Our analysis focuses on at-scale performance for simulations involving hundreds of millions of deformable cells, executed on a combination of CPUs and GPUs spanning thousands of nodes on exascale machines. We benchmark the performance of each implementation, highlighting the trade-offs inherent in adopting diverse programming models. Key insights regarding the portability of CUDA on multi-vendor platforms, the superior multi-core CPU performance from SYCL, and architectural considerations on performance optimization are distilled from our experience, offering guidance to other users of high performance computing based on our findings.

Martin, Aristotle [Duke University]↗
DOE OSTI2024

thevenin: An Equivalent Circuit Modeling Package [SWR-24-132]

This package is a wrapper for the well-known Thevenin equivalent circuit model for simulating battery behavior with a focus on ease of use. The model is comprised of a single series resistor followed by any number of parallel RC pairs. The package includes an intuitive "experiment" interface, which simplifies the programming of constant or dynamic current, voltage, and/or power-driven loads, making it ideal for a wide range of applications, from basic tests to complex simulations. It also supports state-of-charge (SOC) and temperature-dependent properties, allowing the model to be more easily calibrated against real cells.

Randall, Corey↗
DOE OSTI2023

Molecular dynamics study of primary damage in the near-surface region in nickel

In this work, we carried out a large-scale molecular dynamics (MD) simulation to elucidate the effect of the free surface on the defect production of displacement cascades in pure nickel. These MD simulations were performed both in the bulk and near-surface regions with primary knock-on atom (PKA) energies of E PKA = 1, 5, or 10 keV and at temperatures T = 300, 425, or 525 K. Additionally, for every (T, E PKA ), near-surface cascade simulations were performed as a function of depth. In the near-surface simulations, assuming isotropic neutron fluence, the PKAs were initiated in random directions, including toward and parallel to the free surface. For both the near-surface and bulk cascades, the effect of E PKA and T on the defect production is similar. In both cases, the defect production increases with E PKA , but the temperature has minimal effect. However, the production and clustering of vacancies are higher for near-surface cascades, and they decrease with increasing depth. In contrast, the production and clustering of self-interstitial atoms are lower and increase with depth. Eventually, the production and clustering of both defect types approach bulk cascade-like behavior, and the depth at which this occurs increases with E PKA , but is independent of temperature.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Immortal rays: Rethinking random ray neutron transport on GPU architectures

The Random Ray Method (TRRM) is a recently developed adaptation of the Method of Characteristics for neutral particle transport simulations. TRRM has demonstrated excellent performance on 3D nuclear reactor benchmark problems using CPU-based compute systems. When porting to GPU-based systems, however, new performance challenges arise that are unique to processors targeting massive fine-grained parallelism. For smaller problems, or for large problems that are domain decomposed across many computational nodes, the problem size per node has insufficient parallelism to saturate GPU node resources, thus greatly limiting speedup. In this study, we report on a newly developed “immortal ray” variant of TRRM. Here, the immortal ray technique exposes significantly more fine-grained parallelism by fundamentally reformulating the numerical details of ray discretization, resulting in performance tradeoffs with significant overall benefit on GPUs. For very small 2D simulation problems we found the new immortal ray variant allowed for up to a 4.4x speedup when run on a single GPU. For larger 3D simulation problems we found the new variant improved strong scaling by 3x when run on the Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

3-regular three-XORSAT planted solutions benchmark of classical and quantum heuristic optimizers

With current semiconductor technology reaching its physical limits, special-purpose hardware has emerged as an option to tackle specific computing-intensive challenges. Optimization in the form of solving quadratic unconstrained binary optimization problems, or equivalently Ising spin glasses, has been the focus of several new dedicated hardware platforms. These platforms come in many different flavors, from highly-efficient hardware implementations on digital-logic of established algorithms to proposals of analog hardware implementing new algorithms. In this work, we use a mapping of a specific class of linear equations whose solutions can be found efficiently, to a hard constraint satisfaction problem (three-regular three-XORSAT, or an Ising spin glass) with a 'golf-course' shaped energy landscape, to benchmark several of these different approaches. We perform a scaling and prefactor analysis of the performance of Fujitsu's digital annealer unit (DAU), the D-Wave advantage quantum annealer, a virtual MemComputing machine, Toshiba's simulated bifurcation machine (SBM), the SATonGPU algorithm from Bernaschi et al, and our implementation of parallel tempering. We identify the SATonGPU and DAU as currently having the smallest scaling exponent for this benchmark, with SATonGPU having a small scaling advantage and in addition having by far the smallest prefactor thanks to its use of massive parallelism. Furthermore, our work provides an objective assessment and a snapshot of the promise and limitations of dedicated optimization hardware relative to a particular class of optimization problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Coherent electronic-vibrational dynamics in deuterium bromide probed via attosecond transient-absorption spectroscopy

Ultrafast laser excitation can trigger multiplex coherent dynamics in molecules. Here, we report attosecond transient-absorption experiments addressing simultaneous probing of electronic and vibrational dynamics in a prototype molecule, deuterium bromide (DBr), following its strong-field ionization. Electronic and vibrational coherences in the ionic X$^2\Pi_{3/2}$ and X$^2\Pi_{1/2}$ states are characterized in the Br-$3d$ core-level absorption spectra via quantum beats with 12.6-fs and 19.9-fs periodicities, respectively. Polarization scans reveal that the phase of the electronic quantum beats depends on the probe direction, experimentally showing that the coherent electronic motion corresponds to the oscillation of the hole density along the ionization-field direction. The vibrational quantum beats are found to maintain a relatively constant amplitude, whereas the electronic quantum beats exhibit a partial decrease in time. Quantum wave-packet simulations show that the decoherence effect from the vibrational motion is insignificant because of the parallel relation between the X$^2\Pi_{3/2}$ and X$^2\Pi_{1/2}$ potentials. Finally, a comparison between the DBr and HBr results suggests that rotation motion is responsible for the decoherence since it leads to initial alignment prepared by the strong-field ionization.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2022

Optimal, centralized dynamic curbside parking space zoning

In this paper we formulate a dynamic mixed integer program for optimally zoning curbside parking spaces subject to transportation policy-inspired constraints and regularization terms. First, we illustrate how given some objective of curb zoning valuation as a function of zone type (paid parking, bus stop, etc.), dynamically rezoning involves unrolling this optimization program over a fixed time horizon. Second, we implement two different solution methods given an example curb zoning valuation. In the first method, we solve long horizon dynamic zoning problems via approximate dynamic programming. In the second method, we employ Dantzig-Wolfe decomposition to break-up the mixed-integer program into a master problem and several sub-problems that can be solved in parallel. This speeds up the computational solve-time of the MIP considerably. We present simulation results and comparisons of the different employed techniques on vehicle arrival-rate data obtained for a neighborhood in downtown Seattle, Washington, USA.

Nazir, Mohammad Nawaf↗
DOE OSTI2023

ORNL/grit

Grit is a software library designed specifically for conducting particle-based Lagrangian simulations with CPU/GPUperformance portability. This library allows researchers and engineers to perform a wide range of simulations, including multiphase flow, and more. Grit employs Message Passing Interface (MPI) for distributed memory parallelism and Kokkos programming model for on-node shared memory parallelism with performance portability across different architectures of GPUs and multi-core/manycore CPUs.

Ge, Wenjun [Oak Ridge National Laboratory (ORNL), ↗
DOE OSTI2020

Hydration Mechanisms in Nanoparticle Interaction and Surface Energetics

Work on the project advanced molecular level understanding, prediction and control of nanoscale hydration in salt solutions under electric stimuli or ionic patterning. Permeation of nanoporous electrodes at preset voltage underlies the function of ultracapacitors. Transitory regulation of wetting in nanoporous media by electric field spans an array of applications in materials, energy storage, and separation sciences. The physically related modulation of nanoparticle solubility by surface charges can significantly extend the range of the nanomaterial applications, improve processing techniques, and potentially alleviate environmental concerns. Pore/solution equilibria, and activated kinetics of liquid gating by nanoconfined electrolytes are challenging problems at the forefront of experimental and theoretical research. Addressing these problems from a molecular perspective required the development of state-of-the-art simulation algorithms in statistical mechanics to capture complex processes in open systems under electric control. Parallel studies of wetting and dispersibility of polar and ionizing particles aim to uncover predictive relations between electrowetting, chemical functionalization, and geometry of nanomaterial particles. By nonequilibrium dynamic modeling, we elucidated electrolyte flow in nanochanels and associated electrokinetic energy conversion. Research on the program provided training opportunities for the next generation of scientists in computational chemistry. Insights, and methods from the project implicate broad segment of researchers in energy and nanosciences, materials and surface chemistry.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

SST-GPU: A Scalable SST GPU Component for Performance Modeling and Profiling

Programmable accelerators have become commonplace in modern computing systems. Advances in programming models and the availability of unprecedented amounts of data have created a space for massively parallel accelerators capable of maintaining context for thousands of concurrent threads resident on-chip. These threads are grouped and interleaved on a cycle-by-cycle basis among several massively parallel computing cores. One path for the design of future supercomputers relies on an ability to model the performance of these massively parallel cores at scale. The SST framework has been proven to scale up to run simulations containing tens of thousands of nodes. A previous report described the initial integration of the open-source, execution-driven GPU simulator, GPGPU-Sim, into the SST framework. This report discusses the results of the integration and how to use the new GPU component in SST. It also provides examples of what it can be used to analyze and a correlation study showing how closely the execution matches that of a Nvidia V100 GPU when running kernels and mini-apps.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation

This Final Scientific and Technical Report summarizes work performed under the Phase IIA SBIR project “Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation” (DE-SC0020906) from August 2023 through August 2025. The objective of the Phase IIA effort was to mature and harden capabilities developed during Phase II, with the goal of enabling practical interoperability between Coreform’s isogeometric analysis (IGA) technologies and the Multiphysics Object-Oriented Simulation Environment (MOOSE), while improving robustness, performance, and scalability for complex, nuclear-relevant geometries. Over the course of Phase IIA, the project established and validated an extraction-based interoperability pathway between Coreform tools and MOOSE. A combined mesh and matrix format was defined collaboratively with MOOSE developers and integrated into the solver, enabling standard MOOSE workflows to operate on data exported from Coreform’s IGA and Flex Representation Method (FRM) pipelines. Early demonstrations validated architectural compatibility using linear solid mechanics problems, while later efforts focused on benchmark testing and external use. By the end of the project period, engineers at BWXT were able to independently set up and execute a simulation using the Coreform–MOOSE workflow and provide direct feedback that informed further refinement. In parallel, substantial effort was devoted to improving the robustness of trimmed U-spline construction for complex CAD geometries. A growing test suite of nuclear-relevant models was compiled through collaboration with multiple stakeholders and used to drive extensive bug fixing and reliability improvements. These efforts resulted in improved robustness and performance, including the addition of fallback capabilities that enhance reliability when the underlying commercial CAD kernel fails. Performance-oriented work progressed later in the project, with the development and demonstration of methods to decompose complex geometries into structured subregions and updated data representations to support more efficient solver processing. Additionally, extensive enhancements to threadsafe parallel data structures and trimming operations established a foundation for scalable processing of large assemblies. Collaboration with Sandia National Laboratories on the SGM geometric modeling kernel advanced to a functioning interface test case, positioning the workflow for future kernel integration. Overall, the Phase IIA effort successfully transitioned the project from architectural proof-of-concept to externally exercised, solver-integrated capability, while clarifying remaining technical challenges related to standardization, performance optimization, and kernel integration.

42 ENGINEERING↗
DOE OSTI2022

GIGA-Lens: Fast Bayesian Inference for Strong Gravitational Lens Modeling

We present GIGA-Lens: a gradient-informed, GPU-accelerated Bayesian framework for modeling strong gravitational lensing systems, implemented in TensorFlow and JAX. The three components, optimization using multistart gradient descent, posterior covariance estimation with variational inference, and sampling via Hamiltonian Monte Carlo, all take advantage of gradient information through automatic differentiation and massive parallelization on graphics processing units (GPUs). We test our pipeline on a large set of simulated systems and demonstrate in detail its high level of performance. The average time to model a single system on four Nvidia A100 GPUs is 105 s. The robustness, speed, and scalability offered by this framework make it possible to model the large number of strong lenses found in current surveys and present a very promising prospect for the modeling of ${ \mathcal O }({10}^{5})$ lensing systems expected to be discovered in the era of the Vera C. Rubin Observatory, Euclid, and the Nancy Grace Roman Space Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Long-term variability in immersion-mode marine ice-nucleating particles from climate model simulations and observations

Abstract. Ice-nucleating particles (INPs) in the Southern Ocean (SO) atmosphere have significant impacts on cloud radiative and microphysical properties. Yet, INP prediction skill in climate models remains poorly understood, in part because of the lack of long-term measurements. Here we show, for the first time, how model-simulated INP concentrations compare with year-round INP measurements during the Macquarie Island Cloud Radiation Experiment (MICRE) campaign from 2017–2018. We simulate immersion-mode INP concentrations using the Energy Exascale Earth System Model version 1 (E3SMv1) by combining simulated aerosols with recently developed deterministic INP parameterizations and the native classical nucleation theory (CNT) for mineral dust in E3SMv1. Because MICRE did not collect aerosol measurements of super-micron particles, which are more effective ice nucleators, we evaluate the model's aerosol fields at other high-latitude sites using long-term in situ observations of dust and sea spray aerosol. We find that the model underestimates dust and overestimates sea spray aerosol concentrations by 1 to 2 orders of magnitude for most of the high-latitude sites in the Southern Hemisphere. We next compare predicted INP concentrations with concentrations of INPs collected on filter samples (typically for 2 or 3 d) and processed offline using the Colorado State University ice spectrometer (IS) in immersion freezing mode. We find that when deterministic parameterizations for both dust and sea spray INPs are used, simulated INPs are within a factor of 10 of observed INPs more than 60 % of the time during summer. Our results also indicate that the E3SM's current treatment of mineral dust immersion freezing in the SO is impacted by compensating biases – an underprediction of dust amount was compensated by an overprediction of its effectiveness as INPs. We also perform idealized droplet freezing experiments to quantify the implications of the time-dependent behavior assumed by the E3SM's CNT-parameterization and compare with the ice spectrometer observations. We find that the E3SM CNT 10 s diagnostic used in this study is a reasonable approximation of the exact formulation of CNT, when applied to ice spectrometer measurements in low-INP conditions similar to Macquarie Island. However, the linearized 10 s diagnostic underestimates the exact formula by an order of magnitude or more in places with high-INP conditions like the Sahara. Overall, our findings suggest that it is important to correct the biases in E3SM's simulated dust life cycle and update E3SM's INP parameterizations. INP prediction errors of 2 to 3 orders of magnitude can have considerable impacts on the simulated cloud and radiative properties in global climate models. On comparing INP concentrations during MICRE against ship-based campaigns, Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS) and Antarctic Circumnavigation Expedition (ACE), we find that INPs from the latter are significantly higher only in regions closer to Macquarie Island. This alludes to the fact that physical, chemical and biological processes affecting INP concentrations as stimulated by the island could be partly responsible for the high INP concentrations observed at Macquarie Island during the MICRE campaign. Therefore, improvements to both aerosol simulation and INP parameterizations are required to adequately simulate INPs and their cloud impacts in E3SM. It will be helpful to include a parallel measurement of the size-resolved aerosol composition and explore opportunities for long-term measurement platforms in future field campaigns studying INP sources in remote marine regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A Modeling Tool to Analyze the Performance of Industrial Cooling Towers

Energy efficiency and energy savings have become an important factor as industries look for ways to save energy and minimize their energy consumption while reducing their carbon footprint. Cooling towers are utilized significantly in industries for either serving chillers or process cooling. Depending on the size of the cooling tower, it can use a surprising amount of energy and water, which is why it is crucial to make sure that the facility has optimized their cooling tower.A modeling tool has been developed to perform a thorough analysis of a cooling tower and its various operations to ensure that the facility has optimized its cooling tower. This model analyzes an annual base case in comparison with the revised case of a cooling tower operation. This modeling tool simulates 8,760 hourly calculations for fan power for various fan controls, water consumption, and pumping energy consumption and demand based on the user’s location and its corresponding Typical Meteorological Year 3 (TMY3) weather data. This model is capable to simulate up to five cooling tower cells as one large tower utilizing one pump or parallel pumping. The successful validated cooling tower model should assist industry to save energy at their facility through their cooling tower, whether they use it for process cooling or heating, ventilation and air conditioning (HVAC) applications. The entering/leaving water temperatures based on a monthly operating schedule or a wet-bulb temperature schedule will be used as inputs, and the model can calculate savings in energy for various conditions including variable-frequency drive (VFD) on the fan/pump, drift eliminators, number of cycles of concentration, reduced water flow rate, etc.

Hooper, Josh↗
DOE OSTI2021

PRISMS-Fatigue computational framework for fatigue analysis in polycrystalline metals and alloys

Abstract The PRISMS-Fatigue open-source framework for simulation-based analysis of microstructural influences on fatigue resistance for polycrystalline metals and alloys is presented here. The framework uses the crystal plasticity finite element method as its microstructure analysis tool and provides a highly efficient, scalable, flexible, and easy-to-use ICME community platform. The PRISMS-Fatigue framework is linked to different open-source software to instantiate microstructures, compute the material response, and assess fatigue indicator parameters. The performance of PRISMS-Fatigue is benchmarked against a similar framework implemented using ABAQUS. Results indicate that the multilevel parallelism scheme of PRISMS-Fatigue is more efficient and scalable than ABAQUS for large-scale fatigue simulations. The performance and flexibility of this framework is demonstrated with various examples that assess the driving force for fatigue crack formation of microstructures with different crystallographic textures, grain morphologies, and grain numbers, and under different multiaxial strain states, strain magnitudes, and boundary conditions.

Chemistry↗
DOE OSTI2023

PyFLEXTRKR: a flexible feature tracking Python software for convective cloud analysis

Abstract. This paper describes the new open-source framework PyFLEXTRKR (Python FLEXible object TRacKeR), a flexible atmospheric feature tracking software package with specific capabilities to track convective clouds from a variety of observations and model simulations. This software can track any atmospheric 2D objects and handle merging and splitting explicitly. The package has a collection of multi-object identification algorithms, scalable parallelization options, and has been optimized for large datasets including global high-resolution data. We demonstrate applications of PyFLEXTRKR on tracking individual deep convective cells and mesoscale convective systems from observations and model simulations ranging from large-eddy resolving (∼100s m) to mesoscale (∼10s km) resolutions. Visualization, post-processing, and statistical analysis tools are included in the package. New Lagrangian analyses of convective clouds produced by PyFLEXTRKR applicable to a wide range of datasets and scales facilitate advanced model evaluation and development efforts as well as scientific discovery.

54 ENVIRONMENTAL SCIENCES↗