SEARCH · Engineering Papers

Results for “parallel and distributed computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,123 records · Page 63

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Scalable multilevel Monte Carlo methods exploiting parallel redistribution on coarse levels

Here, we study an element agglomeration coarsening strategy that requires data redistribution at coarse levels when the number of coarse elements becomes smaller than the number of MPI processes used on the finest level. The overall procedure generates coarse elements (general unstructured unions of fine grid elements) within the framework of element-based algebraic multigrid methods (or AMGe) studied previously. The AMGe-generated coarse spaces have the ability to exhibit approximation properties of the same order as the fine-level spaces since by construction they contain the piecewise polynomials of the same order as on the fine level. These approximation properties are key for the successful use of AMGe in multilevel solvers for nonlinear partial differential equations as well as for multilevel Monte Carlo (MLMC) simulations. The ability to coarsen without being constrained by the number of MPI processes, as described in the present paper, allows to improve the scalability of these solvers as well as the overall MLMC method. The paper illustrates this latter fact with detailed scalability study of MLMC simulations applied to model Darcy equations with a stochastic log-normal permeability field.

AMGe↗

DOE OSTI2021

Scalable Pattern Matching in Metadata Graphs via Constraint Checking

Pattern matching is a fundamental tool for answering complex graph queries. Unfortunately, existing solutions have limited capabilities: They do not scale to process large graphs and/or support only a restricted set of search templates or usage scenarios. Moreover, the algorithms at the core of the existing techniques are not suitable for today’s graph processing infrastructures relying on horizontal scalability and shared-nothing clusters, as most of these algorithms are inherently sequential and difficult to parallelize. In this article we present an algorithmic pipeline that bases pattern matching on constraint checking. The key intuition is that each vertex and edge participating in a match has to meet a set of constraints implicitly specified by the search template. These constraints can be verified independently and typically are less expensive to compute than searching the full template. The pipeline we propose generates these constraints and iterates over them to eliminate all the vertices and edges that do not participate in any match, thus reducing the background graph to a subgraph that is the union of all template matches—the complete set of all vertices and edges that participate in at least one match. Additional analysis can be performed on this annotated, reduced graph, such as full match enumeration, match counting, or computing vertex/edge centrality. Furthermore, a vertex-centric formulation for constraint checking algorithms exists, and this makes it possible to harness existing high-performance, vertex-centric graph processing frameworks. This technique (i) enables highly scalable pattern matching in metadata (labeled) graphs; (ii) supports arbitrary patterns with 100% precision; (iii) enables tradeoffs between precision and time-to-solution, while always selects all vertices and edges that participate in matches, thus offering 100% recall; and (iv) supports a set of popular data analytics scenarios. We implement our approach on top of HavoqGT, an open-source asynchronous graph processing framework, and demonstrate its advantages through strong and weak scaling experiments on massive scale real-world (up to 257 billion edges) and synthetic (up to 4.4 trillion edges) labeled graphs, respectively, and at scales (1,024 nodes / 36,864 cores), orders of magnitude larger than used in the past for similar problems. This article serves two purposes: First, it synthesises the knowledge accumulated during a long-term project. Second, it presents new system features, usage scenarios, optimizations, and comparisons with related work that strengthen the confidence that pattern matching based on iterative pruning via constraint checking is an effective and scalable approach in practice. The new contributions include the following: (i) We demonstrate the ability of the constraint checking approach to efficiently support two additional search scenarios that often emerge in practice, interactive incremental search and exploratory search. (ii) We empirically compare our solution with two additional state-of-the-art systems, Arabsque and TriAD. (iii) We show the ability of our solution to accommodate a more diverse range of datasets with varying properties, e.g., scale, skewness, label distribution, and match frequency. (iv) We introduce or extend a number of system features (e.g., work aggregation, load balancing, and the ability to cap the generated traffic) and design optimizations and demonstrate their advantages with respect to improving performance and scalability. (v) We present bottleneck analysis and insights into artifacts that influence performance. (vi) We present a theoretical complexity argument that motivates the performance gains we observe.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Reassessing the MCNP Random Number Generator

Random number generators are integral components to Monte Carlo codes. They provide the pseudorandom number sequence used to actually sample the distributions of interest. As a result, they are one of the most important components to the software. The current recommended MCNP random number generator is a 63-bit linear congruential generator (LCG). This generator is quite fast, but it has some drawbacks. First, it only has a period of 2 63 . Due to the necessarily non-optimal usage of random numbers to ensure parallel reproducibility, this amount is too few to guarantee random number sequences are not reused in all configurations the code runs under. As simulation size increases, users will need to be aware of the limitations of the generator and tune configuration variables to best suit their simulations, or they will need to assume that reuse is not negatively affecting their answers. Neither of these are optimal. Second, small LCGs are fairly weak in bit generation quality, and this can have an unknown impact on the quality of the simulation. This paper is an investigation into whether or not more modern random number generators can supersede the current ones. The goal is to find a generator that is similar or superior in speed to the LCGs, has a state space large enough to make strong guarantees about random number reuse, and passes all modern random number test suites. If such a generator is found, it would eliminate the need for the user to even be aware of the limitations of the random number generator and would simplify the use of the code. This paper will be broken into several parts. Sec. 2 will discuss the evolution of the random number generator within the MCNP code. Sec. 3 will go over what a Monte Carlo code needs from a generator to be reproducible and portable and how the current generator behaves in that light. Sec. 4 goes through how each generator was tested. Finally, Sec. 5 will discuss improvements that could be made to the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

CyDER: A Cyber Physical Co-simulation Platform for Distributed Energy Resources in Smartgrids

The CyDER project aimed at developing an open-source, modular and scalable co-simulation platform for power grids with large shares of Distributed Energy Resources (DERs). The project partners are the Lawrence Berkeley National Lab (LBNL), Lawrence Livermore National Lab (LLNL), PG&E, SolarCity, and ChargePoint. The prime recipient is LBNL; SolarCity and ChargePoint were partners for the project’s first two years. Increased DER integration introduces a number of challenges in power grid operation including a more dynamic interaction between the transmission grid and distribution grids, and increased modeling complexity. Although specialized software exists to precisely model different components of the power system, it is far from trivial to integrate all various models and perform a holistic simulation. Instead of replicating all models in a common simulation program, a commonly accepted approach to tackle this model diversity is to couple third-party simulators and models through a co-simulation platform that coordinates information exchange among the various components. Following this line of research, this project’s objective was to develop a co-simulation platform based on a widely accepted industrial standard called Functional Mockup Interface (FMI). Within this process, the project developed models compliant with the FMI standard, called Functional Mockup Units (FMUs), and used them to perform various operational and planning power system analyses. Relying and building upon an industrial standard is the main differentiation of this project compared with previous or parallel efforts in the co-simulation area. Particular emphasis was put on delivering software utilities to facilitate setting up and running co-simulations by end-users. Furthermore, a strong aspect of this project is demonstrating that co-simulation techniques can be used to perform Hardware-in-the-Loop (HIL) simulations that couple software components (e.g., simulated models) with hardware components (e.g., real devices such PV systems and batteries). The long-term goal of CyDER project is to help establish FMI as a powerful standard for co-simulation and promote adoption by electric utilities and other interested stakeholders. The main accomplishments of the project include the development of several FMUs including distribution and transmission grid models, PV inverters with Volt/Var/Watt controllers, batteries, and predictive optimal controllers. Additionally, a unique software package was developed, called SimulatorToFMU, which is capable of exporting any Python-driven simulator or Python script as an FMU. This is an important contribution towards establishing FMI as one of the main co-simulation standards, because more and more third-party programs for sub-system modeling and simulation are delivered with Python APIs. The CyDER platform was used to perform PV hosting capacity analyses in real utility feeders with and without smart inverter controls, battery storage, and EV charging. Smart inverter controls include conventional Volt/Var/Watt controls for reactive power support and active power curtailment, but also predictive controls that optimize the charging and discharging profile of the battery connected on the DC side in order to minimize the customer’s economic benefit. Finally, an important result of this project is delivering an experimental setup that consists of residential-scale PV inverters with battery storage, a real-time grid simulator with an ideal voltage source as grid emulator, and micro Phasor Measurement Units (PMUs). All these components and additional software modules are coupled to one another using the FMI standard and can be co-simulated with the CyDER platform.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Collaborative Research: Advancing Arctic Climate Projection Capability at Seasonal to Decadal Scales (Final Technical Report)

The Regional Arctic System Model (RASM) at process resolving configurations has been used to (i) advance understanding of physical processes and feedbacks involved in Arctic amplification and (ii) understand and potentially reduce uncertainty in prediction of arctic climate change at seasonal to decadal scales. RASM consists the atmosphere (Weather and Research Forecasting model, WRF), ocean (Parallel Ocean Program, POP), sea ice (CICE), land hydrology (Variable Infiltration Capacity model, VIC), river routing scheme (RVIC), marine biogeochemistry components and the coupling framework (CPL7). Its domain is pan-Arctic, with the atmosphere and land components configured on a 50-km or 25-km grid and four configurations of the ocean and sea ice components: 1/12°(~9.3km) or 1/48°(~2.4km) and 45 or 60 vertical layers. These RASM configurations have been motivated by the emerging exascale capability for high performance computing to improve model fidelity. The dynamical downscaling of reanalysis allows comparison of RASM results with observations in place and time to: (i) advance system level understanding of physical processes and coupling involved in an event, (ii) optimize model parameter space, (iii) diagnose and reduce model biases and (iv) produce realistic and consistent across all the components initial conditions for predictions and predictability studies, which are all unique capabilities not available in global Earth System Models (ESMs). An evaluation of RASM 1.0 (Cassano et al. 2017) revealed that it had a cold bias over the oceans and a warm bias over land areas due largely to cloud and radiation biases in the model, with too little cloud cover simulated over land and too much cloud cover simulated over sub-polar oceans. This study has motivated an upgrade to WRF version 3.7.1 in RASM and allowed for the inclusion of the radiative impact of convective clouds. A variety of atmospheric physics parameterizations were evaluated against observations (e.g. data from the Arctic Clouds in Summer Experiment (ACSE); Sedlar et al. 2020) to identify an optimal suite of WRF physics options in RASM. The RASM with the optimized WRF physics were used to study the impact of strong mesoscale winds over the ocean around the southern tip of Greenland (DuVivier and Cassano 2016) and their impact on oceanic convection (DuVivier et al. 2017a). Data from the PolarWinds field campaign were used to evaluate WRF boundary layer physics and resolution impacts on the simulation of a Greenland barrier wind event (DuVivier et al. 2017b). The RVIC streamflow routing model has been implemented in RASM to realistically represent high-resolution streamflow processes (Hamman et al. 2017) and to couple the land buoyancy fluxes to the ocean. The RASM-RVIC high-resolution data set of all coastal freshwater fluxes for the Arctic drainage basin and surrounding areas for 1979-2014 was published as a separate product (https://doi.org/10.5281/zenodo.293037). The fidelity of atmospheric momentum transfer to and the response of polar marine Ekman layer in RASM and Community Earth System Model (CESM) was investigated by Roberts et al. (2015). The increased frequency of oceanic flux exchange in CESM, following the RASM guidance, caused a considerable increase in the median inertial ice speed across the Southern Ocean and parts of the Arctic. A comprehensive evaluation of the RASM1.0 atmosphere-ocean-sea ice-land interface was completed by Brunke et al. (2018). RASM was also demonstrated for its capability to simulate extreme events in agreement with observations in space and time (Lee et al. submitted). In particular, the development of three open water events, known as polynyas, have been simulated north of Greenland in February of 2011, 2017 and 2018, in agreement with satellite observations for the past four decades. The optimized RASM sea ice results have been favorably evaluated against satellite observations and a subset of eleven CMIP6 models (Watts et al. submitted). In a complementary project, Jin et al. (2018) have shown that RASM with higher-resolution and new sea-ice processes contributed to lower model errors in sea-ice conditions, concentrations of nutrients and ice algae, in comparison to results from the coarse-resolution (1°) CESM. In two other complementary studies, RASM results were used (i) to explain areas of concentrated use by bowhead whales, the seasonal progression in the use, and the physical environment within those areas (Citta et al. 2015) and (ii) for a synthesis of fall bowhead whales distribution and migration in the Bering-Chukchi-Beaufort (BCB) Sea to investigate whale movements and feeding to the local ocean hydrography and currents (Citta et al. 2018). However, the multi-decadal output from the CESM Large Ensemble yielded unrealistic forcing. Instead, the shorter NCEP CFSv2 9-month forecasts were successfully tested and afforded an increased ensemble size (~30) to demonstrate gains of dynamical downscaling at sub-seasonal to intra-annual time scales. The improved model physics and coupling among RASM model components have yielded more realistic representation of the sea ice cover and consistent across all model components initial conditions. Consequently, RASM demonstrates significant gains compared to simulation of sea ice in the NCEP reanalysis. In addition, RASM 6-month ensemble forecasts yield very realistic sea ice distribution, which demonstrates both significant gains of dynamical downscaling and the continued impact of the initial conditions on forecasts out to 6 months (https://nps.edu/web/rasm/predictions). A follow up study using RASM for dynamical downscaling of the more realistic CESM initialized Decadal Prediction Large Ensemble output is currently ongoing as part of the DOE RGMA HiLAT-RASM project.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2000

Stereo Imaging Velocimetry of Mixing Driven by Buoyancy Induced Flow Fields

Mixing of two fluids generated by steady and particularly g-jitter acceleration is fundamental towards the understanding of transport phenomena in a microgravity environment. We propose to carry out flight and ground-based experiments to quantify flow fields due to g-jitter type of accelerations using Stereo Imaging Velocimetry (SIV), and measure the concentration field using laser fluorescence. The understanding of the effects of g-jitter on transport phenomena is of great practical interest to the microgravity community and impacts the design of experiments for the Space Shuttle as well as the International Space Station. The aim of our proposed research is to provide quantitative data to the community on the effects of g-jitter on flow fields due to mixing induced by buoyancy forces. The fundamental phenomenon of mixing occurs in a broad range of materials processing encompassing the growth of opto-electronic materials and semiconductors, (by directional freezing and physical vapor transport), to solution and protein crystal growth. In materials processing of these systems, crystal homogeneity, which is affected by the solutal field distribution, is one of the major issues. The understanding of fluid mixing driven by buoyancy forces, besides its importance as a topic in fundamental science, can contribute towards the understanding of how solutal fields behave under various body forces. The body forces of interest are steady acceleration and g-jitter acceleration as in a Space Shuttle environment or the International Space Station. Since control of the body force is important, the flight experiment will be carried out on a tunable microgravity vibration isolation mount, which will permit us to precisely input the desired forcing function to simulate a range of body forces. To that end, we propose to design a flight experiment that can only be carried out under microgravity conditions to fully exploit the effects of various body forces on fluid mixing. Recent flight experiments, by the P.I. through collaboration with the Canadian Space Agency (STS-85, August 1997), aimed at determining the stability of the interface between two miscible liquids inside an enclosure show that a long liquid column (5 cm) under microgravity isolation conditions can be stable, i.e. the interface remains sharp and vertical over a short time scale; thus transport occurs by molecular mass diffusion. On the other hand, when the two liquids were excited from a controlled vibration source (Microgravity Vibration Isolation Mount) two to four mode large amplitude quasi-stationary waves were observed. The data was limited to CCD recording of the dynamics of the interface between the two fluids. We propose to carry out flight experiments to quantify the dynamics of the flow field using Stereo Imaging Velocimetry and measure the concentration field using laser fluorescence. The results will serve as a basis to understand effects of g-jitter on transport phenomena, in this case mass diffusion. As the measurement of the kinematics of the flow field will shed light on the instability mechanism. The research will allow measurement of the flow field in microgravity environment to prove two hypotheses: (1) Maxwell's hypothesis: finite convection always exists in diffusing systems, and (2) Quasi-stationary waves inside a bounded enclosure in a microgravity environment is generated by Kelvin-Helmholtz instability; resonance of the interface which produces incipient mixing is due to Rayleigh-Taylor instability. The first hypothesis can be used as a benchmark experiment to illustrate diffusive mixing. The second hypothesis will lead to the understanding of g-jitter effects on buoyancy driven flow fields which occur in many situations involving materials processing, and other basic fluid physics phenomena. In addition, the second hypothesis will also provide insight in how Rayleigh-Taylor and Kelvin-Helmholtz instabilities propagate concentration fronts during mixing. Measurement of the flow field using SIV is important because it is the flow field which causes instability at the interface between the two fluids. Mixing driven by buoyancy induced flow fields will be addressed both experimentally and computationally. The experimental effort will address the kinematics of mixing: stretching, transport and chaos. Quantification of the mechanisms of mixing will consists of measuring the flow field using the SIV system at Glenn and capturing the dynamics of the interface, to measure mass transport, using a CCD camera. These experiments will be carried out within the framework of Earth's gravity and g-jitter microgravity acceleration as in a Space Shuttle environment or the International Space Station. The g-jitter will be induced and controlled using a tunable vibration isolation platform to isolate against vibration as well as input periodic and random vibration to the system. The parametric range of the microgravity experiment will be extended from the experiments on STS-85 to investigate higher mode quasi-stationary waves (8 to 12), as well as resonance regions which leads to chaos and turbulence. Ground-based experiments will focus on effects of vibration on stably stratified fluid layers in order to scale for possible scenarios in a microgravity environment. These vibrations will be subjected perpendicular to the concentration field on the ground since the parallel case can only be carried out in a microgravity environment. The concept of dynamical similarity will be applied to tune the experiments as closely as possible to a Space Shuttle environment or the International Space Station. The computational effort will take advantage of the Computational Laboratory at Glenn to corroborate the experimental findings with predictions of the dynamics of the flow field using the codes FLUENT (finite difference based) and FIDAP (finite element based). We will investigate two important cases, single-fluid model to address dilute systems with negligible jump in viscosity and the more general two-fluid model which accounts for finite jump in viscosity. Apart from its microgravity relevance, this experiment is well suited to study dynamics in nonlinear systems.

Duval, W. M. B.↗

DOE OSTI2021

Digital Twin Model for Advanced Manufacture of a Rotating Detonation Engine Injector

A digital twin material model (DTMM) of an additive manufacturing (AM) process was created to advance the state of the art in rotating detonation engine (RDE) injector design. Current RDE injectors are designed with large pressure drops, enabling a stable and repeatable combustion process. However, this comes at the cost of system efficiency. For the technology to transition to commercial fossil-based power generation, it is important to develop injectors with reduced flow losses. Low-loss injectors are difficult to design and manufacture with conventional manufacturing techniques. AM enables new design options, but the AM manufacturing process must be thoroughly understood to result in a robust design. A DTMM provides the necessary insight by defining the cause-effect relationships between process parameters, microstructure features, and properties. Therefore, a DTMM to support the design and manufacturing process was developed and applied to the design of a new additively manufactured low-loss injector. The injector combustion behavior was characterized through hot-fire tests, and mechanical performance was compared to the DTMM predictions. The two project goals were the successful development of the DTMM and the demonstration of an improved RDE injector design. The RDE injector design and DTMM developments occurred on parallel but dependent paths. The injector was designed to reduce pressure drop by increasing the cross-sectional flow area ratio between the injector air passages and the combustor annulus. This resulted in less structural material, raising the concern that thin members would be susceptible to high-cycle fatigue (HCF) under the periodic loading inherent to an RDE. It was most important for the DTMM to predict behavior in these features; therefore, the injector design concept guided the material thicknesses used in fatigue tests. The DTMM development started by manufacturing a series of coupons over the range of possible AM process variations. A design-of-experiment approach was used to select which process variable combinations gave the most efficient coverage relevant to the injector design space. The microstructure in each of these coupons was characterized, and then computational methods were used to create a numerical model of the correlation between process variables and microstructure. Next, a set of HCF samples were tested to calibrate existing models that map microstructure to HCF performance. Together, these two links formed the DTMM that calculates HCF behavior from AM process variables. Two injector prototypes were additively manufactured. The first injector design strategy aggressively pursued low-loss performance by substantially increasing the oxidizer flow area. The combination of manufacturing lead times and the fatigue testing schedule meant that the DTMM was not available when building this first prototype. Therefore, its process parameters were chosen based on a manual review of the available coupon data. This prototype was built successfully and evaluated in 58 combustion tests. Sustained detonation was achieved with remarkably reduced pressure loss, and some tests even displayed pressure loss characteristics similar to conventional gas turbine combustors. This achieved the project goal of improving RDE injector design. The second injector was manufactured according to the optimized parameters predicted by the DTMM. The flow area modifications of this injector were less aggressive than the first injector since demonstrating low pressure loss was not an objective of the second hot-fire test series. Rather, the test objective was to cause high cycle fatigue failure in the part due to periodic loading from the rotating detonation wave. The observed number of cycles to failure was to be compared to the number predicted by the DTMM and thereby assess the utility of the DTMM in component design. However, the required level of vibration was not obtained during combustion. Therefore, high cycle fatigue was not experienced in the hot-fire tests of the second injector. Fatigue data was obtained by further testing the second injector in a conventional HCF test apparatus. The injector demonstrated HCF strength above the DTMM prediction. In fact, it did not fail and testing was only discontinued due to reaching the end of the period of performance. This points to some success in the project’s primary goal of successfully developing and applying the DTMM to a component design. Implementing the DTMM recommendations for optimal processing parameters led to a part with acceptable properties. The DTMM was also shown to be an efficient correlator of data and to provide insight into the relationship between process settings, microstructure, and property performance. However, the failure of the DTMM prediction to match the experimental result of the injector fatigue test also points to the need to include significantly more data in the model development. In this project, coupons made with identical processing parameters exhibited drastically different properties from each other and from the injector part, which clearly influences the accuracy of a model that predicts performance based on parameters. Uncertainties in the build process must be quantified to develop more robust models. A denser and broader matrix of coupon process and geometry variations, several repeated builds of every point, more in-situ build process measurements, and direct observation of tensile and HCF sample microstructure (as opposed to separate microstructure specimens) are recommendations to improve future AM modeling efforts.

20 FOSSIL-FUELED POWER PLANTS↗