Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parallel optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗

Large-Eddy Simulation of a wind turbine using a Filtered Actuator Line Model

When dealing with multirotor devices such as quadcopters or wind farms, the cost of blade-resolved large-eddy simulation (LES) becomes prohibitive. Combining LES with a family of lower-fidelity models, called actuator line models (ALMs), has grown in popularity in the past decade. ALM replaces full blade resolution with an array of actuator points or lines parameterized by aerodynamic lift/drag polar plots along the blades. Body forces computed based on these actuator points are then projected onto the LES flow mesh, mimicking the effect of rotating blades on the flow. However, the optimal projection radius and the associated LES grid size is often too restrictive for multirotor simulations. Recently, a new tip-correction-based filtered ALM (F-ALM) was proposed by Martinez-Tossas and Meneveau (2019), which allows coarser-than-optimal grids by avoiding the associated overprediction of thrust. In this work, F-ALM is implemented into a high-order, in-house LES code to simulate National Renewable Energy Laboratory Phase VI wind turbine. It is then followed by a comparison between the baseline ALM and the newly implemented F-ALM in terms of instantaneous and time-averaged flow fields and blade loads, revealing the advantages of F-ALM in preventing the overprediction of power on coarse grids. Finally, this encourages accurate and affordable simulations of multirotor devices in the future.

17 WIND ENERGY↗

Decentralized Schemes with Overlap for Solving Graph-Structured Optimization Problems

We present a new algorithmic paradigm for the decentralized solution of graph-structured optimization problems that arise in the estimation and control of network systems. A key and novel design concept of the proposed approach is that it uses overlapping subdomains to promote and accelerate convergence. We show that the algorithm converges if the size of the overlap is sufficiently large and that the convergence rate improves exponentially with the size of the overlap. The proposed approach provides a bridge between fully decentralized and centralized architectures and is flexible in that it enables the implementation of asynchronous schemes, handling of constraints, and balancing of computing, communication, and data privacy needs. The proposed scheme is tested in an estimation problem for a 9241-node power network and we show that it outperforms the alternating direction method of multipliers.

asynchronous↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Enhanced Light Outcoupling from OLEDs Fabricated on Novel Low-Cost Patterned Plastic Substrates of Varying Periodicity

OLEDs continue to make strides in display applications, but their commercial utilization in solid-state lighting (SSL) is lagging. An ongoing challenge, in particular for manufacturing, is the need for enhanced efficiency and hence the necessity to increase in an inexpensive approach the extraction of the light generated inside the OLED into the forward (viewing) hemisphere. In conventional OLEDs fabricated on a transparent flat anode coated on glass, the external quantum efficiency (EQE) is only ~20%. About 50% of the light is lost to internal waveguiding in the high refractive index (RI) organic + ITO anode layers and to surface plasmon polaritons (SPPs) at the organic/metal cathode interface. Another ~30% of the light is externally waveguided in the substrate to its edges. While extraction of the externally waveguided light is commonly addressed by adding a microlens array (MLA) or a scattering layer at the substrate’s air-side, light outcoupling increases by only ~1.6-1.7x (vs up to 2.5x in improving from ~20% to ~50%). The use of a hemispherical lens or an index matching fluid (IMF) at the substrate/photodetector (PD) interface increases the outcoupling by at least 2x; these approaches however, are not viable industrially, and even a MLA is sometimes undesirable due to its non-planar, scattering structure. In multi-stack tandem OLEDs, where the metal cathode is far from the emitting zone(s), the impact of photons loss to SPPs decreases. Our project addressed the ~50% loss to the internally waveguided light and SPPs. We evaluated OLEDs fabricated on patterned or planarized plastic substrates manufactured in a cost-effective approach compatible with a roll-to-roll (R2R) process. The OLEDs were either (i) patterned to various degrees depending on the pitch a and height or depth h of the pattern features or (ii) planar, with a pattern buried under a flat high RI planarization layer. We demonstrated that the outcoupling from green patterned OLEDs reaches ~50% by mitigating plasmon–related loss and internal waveguiding, even without the addition of a MLA, a hemispherical lens, or IMF. Simulations conducted in parallel with the experimental effort demonstrated how diffraction by conformally corrugated OLEDs increases the outcoupling to >60%. Structures with varying pitch values were also simulated indicating that combining domains of varying pitch could increase outcoupling to 55-60%. Experimentally, we additionally assessed the role a and h in determining not only the OLED efficiencies, but also their structural properties, i.e., the uniformity and conformality throughout the OLED stack. As planar OLEDs are preferred over corrugated devices, we studied different patterns in plastic substrates that were planarized by a high RI formulation. Planar green OLEDs on such structures showed enhanced efficiencies with EQEs larger than 60% with the addition of an IMF (to extract the substrate mode) at the substrate/Si PD interface. White OLEDs showed EQEs of 45.5%. Plastic substrates are currently less attractive than glass substrates due to drawbacks such as permeability to water vapor and oxygen, and in some cases thermal instability. Plastic substrates however, are flexible and easy to handle unlike thin flexible glass, and once transparent thin barrier films are available, they will become more attractive; they are already of interest in medical applications. Importantly, as it is easy to generate various patterns in different plastic materials, they provide excellent means for assessing and optimizing enhancing extracting structures. Such structures can also be transferred to glass substrates with some process modifications. The technical effectiveness and economic feasibility of the project lie in the patterning of the extracting plastic substrates in an approach that is scalable to R2R manufacturing. R2R processes are of drastically lower-cost than batch or single-unit fabrication. The patterned plastic can be a part of an integrated substrate either plastic or glass, which includes also a MLA or a planar layer with embedded scattering particles, as well as a conductive metal mesh/electrode design. SSL is environmentally-friendly and as OLED SSL becomes more efficient it will reduce electricity consumption, and hence lighting cost, as well as produce less expensive attractive lighting fixtures. Our university-industry collaboration is hence of major benefit to the public as it demonstrates the feasibility of manufacturing optimized extracting substrates for highly efficient OLEDs for SSL in a future R2R process, which would drastically reduce the manufacturing cost and increase production in the USA. Moreover, newly developed methods by our team allow low-cost roll manufactured substrates to be transferred to flexible or rigid glass substrates, which solves the plastic substrate barrier issues, and when combined with device encapsulation will increase the OLEDs’ environmental stability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Towards reverse mode automatic differentiation of Kokkos-based codes

Derivative computation is a key component of optimization, sensitivity analysis, uncertainty quantification, and the solving of nonlinear problems. Automatic differentiation (AD) is a powerful technique for evaluating such derivatives, and in recent years, has been integrated into programming environments such as Jax, PyTorch, and TensorFlow to support derivative computations needed for training of machine learning models, facilitating wide-spread use of these technologies. The C++ language has become the de facto standard for scientific computing due to numerous factors, yet language complexity has made the wide-spread adoption of AD technologies for C++ difficult, hampering the incorporation of powerful differentiable programming approaches into C++ scientific simulations. This is exacerbated by the increasing emergence of architectures, such as GPUs, with limited memory capabilities and requiring massive thread-level concurrency. C++ AD tools must effectively use these environments to bring novel scientific simulations to next-generation DOE experimental and observational facilities. In this project, we investigated source transformation-based automatic differentiation using LLVM compiler infrastructure to automatically generate portable and efficient gradient computations of Kokkos-based code. We have demonstrated that our proposed strategy is feasible by investigating the usage of a prototype LLVM-based source transformation tool to generate gradients of simple functions made of sequences of simple Kokkos parallel regions. Speedups of up to 500x compared to Sacado were observed on NVIDIA V100 GPU.

97 MATHEMATICS AND COMPUTING↗

Towards gradient multimaterial toolpath generation for direct ink writing with connected fermat spirals

This work describes advances towards a reproducible, parametrically defined algorithm for generating graded multimaterial toolpaths for direct ink writing. Expanding on the existing Fermat space-filling algorithm and coupling with image-driven processing techniques, we demonstrate the fabrication of multimaterial structures. Here, material composition is encoded within toolpaths by parsing hue values from a multi-colored image. By performing dynamic velocity compensation based on local curvature and Euclidean distance filtering, internal voids are mitigated while optimizing print fidelity. Here, the work opens new avenues for designing complex toolpaths with locally programmable composition.

3D Printing↗

Divergence Reduction in Monte Carlo Neutron Transport with On-GPU Asynchronous Scheduling

While Monte Carlo Neutron Transport (MCNT) is near-embarrasingly parallel, the effectively unpredictable lifetime of neutrons can lead to divergence when MCNT is evaluated on GPUs. Divergence is the phenomenon of adjacent threads in a warp executing different control flow paths; on GPUS, it reduces performance because each work group may only execute one path at a time. The process of Thread Data Remapping (TDR) resolves these discrepancies by moving data across hardware such that data in the same warp will be processed through similar paths. A common issue among prior implementations of TDR is the synchronous nature of its remapping and processing cycles, which exhaustively sort data produced by prior processing passes and exhaustively evaluate the sorted data. In another work, we defined a method of remapping data through an asynchronous scheduler which allows for work to be stored in shared memory and deferred arbitrarily until that work is a viable option for low-divergence evaluation. This article surveys a wider set of cases, with the goal of characterizing performance trends across a more comprehensive set of parameters. These parameters include cross sections of scattering/capturing/fission, use of implicit capture, source neutron counts, simulation time spans, and tuned memory allocations. Across these cases, we have recorded minimum and average execution times, as well as a heuristically tuned near-optimal memory allocation size for both synchronous and asynchronous scheduling. Across the collected data, it is shown that the asynchronous method is faster and more memory efficient in the majority of cases, and that it requires less tuning to achieve competitive performance.

Computer Science↗

Designing for Zero Energy and Zero Carbon on a Multi-Building Scale Using URBANopt: Preprint

Groundbreaking efforts are necessary to mitigate contributors increasing impacts of climate change. In parallel to inventing pioneering clean energy technologies it is even more fundamental to rethink designing energy systems within a singular facility and collectively to function as a district. Facilities should not be continuously passive by just consuming; there is a need to shift to perform more dynamically. Designing for zero energy and zero carbon on a multi-building scale can uncover opportunities for building energy efficiency, decarbonization, demand flexibility, and resiliency that are not accessible at an individual building scale. This approach can be challenging without innovative tools to evaluate the multitude of possibilities. As an investigated result, we highlight the use of a campus-scale energy modeling platform - URBANopt™ - for the expansion of the National Renewable Energy Laboratory's (NREL's) South Table Mountain campus in Golden, Colorado. Programmatic growth included the design of three new all-electric, zero-energy, and zero-carbon, mixed used buildings (a combination of research laboratories and office space). This investigation is critical to NREL reaching net-zero emissions for its operational footprint, which will occur in phases over the next decade. Leveraging URBANopt's capabilities, we evaluate 1) high-performance building energy efficiency and decarbonization measures, 2) 4th generation district heating and cooling (4th GDHC) systems, 3) optimized onsite generation and energy storage assets that meet zero-energy and zero-carbon targets at minimum life-cycle costs, and 4) cost-optimal distributed energy technology mixes, dispatch strategies, and associated capacities that increase resiliency to grid outages. This work demonstrates the use and capabilities of URBANopt through a real-world case study on a multi-building scale.

community energy model↗

Simulations of edge and SOL turbulence in diverted negative and positive triangularity plasmas

Optimizing the performance of magnetic confinement fusion devices is critical to achieving an attractive fusion reactor design. Negative triangularity (NT) scenarios have been shown to achieve excellent levels of energy confinement, while avoiding edge localized modes. Modeling turbulent transport in the edge and SOL is key in understanding the impact of NT on turbulence and extrapolating the results to future devices and regimes. Previous gyrokinetic turbulence studies have reported beneficial effects of NT across a broad range of parameters. However, most simulations have focused on the inner plasma region, neglecting the impact of NT on the outermost edge. In this work, we investigate the effect of NT in edge and scrape-off layer simulations, including the magnetic X-point and separatrix. For the first time, we employ a multi-fidelity approach, combining global, non-linear gyrokinetic simulations with drift-reduced fluid simulations, to gain a deeper understanding of the underlying physics at play. First-principles simulations using the GENE-X code demonstrate that in comparable NT and PT geometries, similar profiles are achieved, while the turbulent heat flux is reduced by more than 50% in NT. Comparisons with results from the drift-reduced fluid turbulence code GRILLIX suggest that the turbulence is driven by trapped electron modes. The parallel heat flux width on the divertor targets is reduced in NT, primarily due to a lower spreading factor S.

GENE-X↗

Wave Tank Testing Report for Controls Validation of a Heaving Point Absorber

The core objectives of this project is to improve the power capture of three different wave energy conversion (WEC) devices by more than 50% using an advanced control system and validate the attained improvements using wave tank and full scale testing. In parallel, we will bring along the development of a wave prediction system that is required to enable effective control and test it at full scale. The purposes of this report are to: 1. Plan and document the 1/25th scale device testing at the wave-tank facility; 2. Document the test article, setup and methodology, sensor and instrumentation, mooring, electronics, wiring, and data flow and quality assurance; 3. Communicate the testing results between the associated members; 4. Facilitate reviews that will help to ensure all aspects (risk, safety, testing procedures, etc.); 5. Provide a systematic guide to setting up, executing and decommissioning the experiment.

16 TIDAL AND WAVE POWER↗

Enriched immersed finite element and isogeometric analysis: algorithms and data structures

Immersed finite element methods provide a convenient analysis framework for problems involving geometrically complex domains, such as those found in topology optimization and microstructures for engineered materials. However, their implementation remains a major challenge due to, among other things, the need to apply nontrivial stabilization schemes and generate custom quadrature rules. This article introduces the robust and computationally efficient algorithms and data structures comprising an immersed finite element preprocessing framework. The input to the preprocessor consists of a background mesh and one or more geometries defined on its domain. The output is structured into groups of elements with custom quadrature rules formatted such that common finite element assembly routines may be used without or with only minimal modifications. The key to the preprocessing framework is the construction of material topology information, concurrently with the generation of a quadrature rule, which is then used to perform enrichment and generate stabilization rules. While the algorithmic framework applies to a wide range of immersed finite element methods using different types of meshes, integration, and stabilization schemes, the preprocessor is presented within the context of the extended isogeometric analysis. This method utilizes a structured B-spline mesh, a generalized Heaviside enrichment strategy considering the material layout within individual basis functions’ supports, and face-oriented ghost stabilization. Using a set of examples, the effectiveness of the enrichment and stabilization strategies is demonstrated alongside the preprocessor’s robustness in geometric edge cases. Additionally, the performance and parallel scalability of the implementation are evaluated.

Computer implementation↗

Evaluating adaptive and predictive power management strategies for optimizing visualization performance on supercomputers

Power is becoming an increasingly scarce resource on the next generation of supercomputers, and should be used wisely to improve overall performance. One strategy for improving power usage is hardware overprovisioning, i.e., systems with more nodes than can be run at full power simultaneously without exceeding the system-wide power limit. With this study, we compare two strategies for allocating power throughout an overprovisioned system – adaptation and prediction – in the context of visualization workloads. While adaptation has been suitable for workloads with more regular execution behaviors, it may not be as suitable on visualization workloads, since they can have variable execution behaviors. This study considers a total of 104 experiments, which vary the rendering workload, power budget, allocation strategy, and node concurrency, including tests processing data sets up to 1 billion cells and using up to 18,432 cores across 512 nodes. Overall, we find that prediction is a superior strategy for this use case, improving performance up to 27% compared to an adaptive strategy.

97 MATHEMATICS AND COMPUTING↗

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗

A general approach to seismic inversion with automatic differentiation

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. Here, the mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.

58 GEOSCIENCES↗

Hybrid Solar System (Final Scientific/Technical Report)

GTI Energy (GTI) teamed with the University of California at Merced (UCM) to scaleup the hybrid solar system (HSS) technology for demonstrating its performance at the US Gypsum (USG) plant in Plaster City, California. The technology integrates two-stage concentrating solar collector with matching particle thermal transport and storage (TSS) system to deliver cost-effective, and on-demand distributed high temperature industrial process heat up to 600°C with solar thermal, in this case to a gypsum kettle, to reduce its fuel use and carbon footprint. Current solar technologies, which reach these temperatures, are not distributable (towers) or cost-effective (dish). The research team developed a conceptual system design for host site retrofit, including preliminary heat balance, process flow diagram, particle to process heat exchanger and equipment placements at the site. Subsequently, parallel efforts were carried out at UCM to design, build and test a 12 m long commercial scale prototype concentrating thermal-only collector system and at GTI to design, build and test a matching 650°C capable particle TTS system. The nominal 50 kWth collector consists of a parabolic trough and three 4 m long two-stage receivers in series. Prior to on-sun testing, a 4 m long receiver was fabricated and successfully tested at 650 °C in a laboratory setting for 100 hrs of continuous operation showing less than 15% radiation loss. A 7 m wide x 17 m long parabolic trough was then installed at UCM for on-sun testing of the 12 m long receiver, and concurrently several 4 m long receivers were built. The optics of the parabolic trough were calibrated, and on-sun test were carried out on 12 m long receivers. During tests, the intense solar radiation (53x) caused the absorber tubes in the receivers to bend, reducing the overall optical efficiency. To address the bending issue, a self-consistent algorithm that includes ray tracing, thermal and deformation models was developed to perform thermal stress analysis on absorbers for parabolic solar collectors. Results obtained with this algorithm showed a dramatic rise in deformation as absorber tube length increases. A combined efficiency parameter that includes the occluded area for the mounts was developed to obtain an optimized tube length obtained. Based on the results, a length of 2.7 m for the absorber + 0.2 m for the coupler was chosen to minimize any bending and optimize optical efficiency while maintaining ease of mounting. The associated particle TTS system was designed, built and successfully tested at GTI. It includes storage, receiving and lock hoppers and piping that simulates the transfer of captured solar energy to an actual industrial furnace. Tests over 77 charge-discharge cycles demonstrated <2% particle degradation, with no problematic particle accumulations and no flow interruptions. The piping pressure drop was about 5 psi. The team also worked with Stanley Consultants (Stanley) to prepare conceptual and preliminary engineering packages to facilitate follow-on development and commercialization efforts. These include process and instrumentation diagram’s (P&ID’s), general arrangements, electrical one-line, project definitions document, equipment data sheets, schedule, and construction cost estimate for 2 MWth system. Updated HSS technology commercialization and customer engagement plans and detailed costs and evaluated market trade-offs and manufacturing.

03 NATURAL GAS↗

Low-Temperature Plasma-Based Metrology of Lithium-Ion Battery Electrode Materials (CRADA Final Report)

As part of the Cyclotron Road program, SirenOpt Inc. evaluated its low-temperature plasma-based metrology sensor prototype for measuring multiple critical properties of lithium-ion battery electrode materials in parallel and in real-time. Cost-effective, minimal-waste manufacturing of high-performance battery electrode materials will be vital for achieving society’s net-zero carbon emission goals. Because existing electrode metrology sensors cannot operate within most sections of manufacturing lines, manufacturers often complete hundreds of processing steps before they can test their products and detect problems. When manufacturers perform these offline tests, they typically only test a small portion of the manufactured products. Current electrode manufacturing thus often yields many low-quality products, or off-spec products that must be thrown away all together. For example, at least 6% of the total lithium-ion battery manufacturing cost (i.e., over $250 million/year for the average gigafactory) is devoted to processing defective electrodes that are not scrapped until performance tests are failed during late-stage quality control checks. Electrode variability also leads manufacturers to build extra cells into battery packs to reduce the risk of poor performance. For example, many electric vehicle (EV) manufacturers include up to 10% more cells than needed, which substantially increases the cost and weight of the final EV product. The SirenOpt sensor can potentially enable early detection of poorly manufactured electrodes and allow them to be removed earlier from manufacturing lines, which can save battery manufacturers (hundreds of) millions of dollars per year. The sensor can further be used to improve product quality by accelerating R&D and process optimization, improving quality control, and enabling real-time process control. Overall, a real-time, in-situ metrology strategy can create unprecedented opportunities for implementation of smart manufacturing practices and advanced quality and process control solutions to realize higher battery electrode throughput and performance.

25 ENERGY STORAGE↗

Proximity Portability and in Transit , M-to-N Data Partitioning and Movement in SENSEI [Book Chapter]

In high-performance parallel in situ processing, the term in transit processing refers to those configurations where data must move from a producer to a consumer that runs on separate resources. In the context of parallel and distributed computing on an HPC platform one of the central challenges is to determine a mapping of data from producer ranks to consumer ranks. This problem is complicated by the heterogeneity that arises in producer-consumer pairs, such as when producer and consumer codes have different levels of concurrency, different scaling characteristics, or different data models. The resulting mapping and movement of data from M producer to N consumer ranks can have a significant impact on aggregate application performance, particularly when the data consumer requires only a subset of the overall data for its task. This chapter focuses on the design considerations that underlie SENSEI’s implementation to this challenging problem. These design considerations extend the core SENSEI architecture and include ideas like the need to accommodate flexibility in the choice of different partitioning methods, the ability for a data consumer to request and receive only the subset of data needed for its particular operation, and the ability to leverage any of several different data transport tools. The idea of proximity portability, being able to use different data transport methods as part of an in transit workflow, is illustrated through the use of three different transport layers where switching from one transport tool to another is accomplished with only a configuration file change. Here, the chapter also includes a performance analysis summary showing the performance gains that are possible in terms of multiple metrics, such as memory footprint, time to solution, and amount of data moved, when using optimized partitioners in an in transit setting, gains that are made possible by the implementation shaped by specific design considerations.

Bethel, E. Wes↗