Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Applying graph partitioning methods in measurement-based dynamic load balancing

Load imbalance leads to an increasing waste of resources as an application is scaled to more and more processors. Achieving the best parallel efficiency for a program requires optimal load balancing which is a NP-hard problem. However, finding near-optimal solutions to this problem for complex computational science and engineering applications is becoming increasingly important. Charm++, a migratable objects based programming model, provides a measurement-based dynamic load balancing framework. This framework instruments and then migrates over-decomposed objects to balance computational load and communication at runtime. This paper explores the use of graph partitioning algorithms, traditionally used for partitioning physical domains/meshes, for measurement-based dynamic load balancing of parallel applications. In particular, we present repartitioning methods developed in a graph partitioning toolbox called SCOTCH that consider the previous mapping to minimize migration costs. We also discuss a new imbalance reduction algorithm for graphs with irregular load distributions. We compare several load balancing algorithms using microbenchmarks on Intrepid and Ranger and evaluate the effect of communication, number of cores and number of objects on the benefit achieved from load balancing. New algorithms developed in SCOTCH lead to better performance compared to the METIS partitioners for several cases, both in terms of the application execution time and fewer number of objects migrated.

97 MATHEMATICS AND COMPUTING↗

Densely Aligned Graphene Nanoribbon Arrays and Bandgap Engineering

Graphene has attracted great interest for future electronics due to its high mobility and high thermal conductivity. However, a two-dimensional graphene sheet behaves like a metal, lacking a bandgap needed for the key devices components such as field effect transistors (FETs) in digital electronics. It has been shown that, partly due to quantum confinement, graphene nanoribbons (GNRs) with ~2 nm width can open up sufficient bandgaps and evolve into semiconductors to exhibit high on/off ratios useful for FETs. However, a challenging problem has been that, such ultra-narrow GNRs (~2 nm) are difficult to fabricate, especially for GNRs with smooth edges throughout the ribbon length. Despite high on/off ratios, these GNRs show very low mobility and low on-state conductance due to dominant scattering effects by imperfections and disorders at the edges. Wider GNRs (>5 nm) show higher mobility, higher conductance but smaller bandgaps and low on/off ratios undesirable for FET applications. It is highly desirable to open up bandgaps in graphene or increase the bandgaps in wide GNRs to afford graphene based semiconductors for high performance (high on-state current and high on/off ratio) electronics. Large scale ordering and dense packing of such GNRs in parallel are also needed for device integration but have also been challenging thus far. It has been shown theoretically that uniaxial strains can be applied to a GNR to engineer its bandgap. The underlying physics is that under uniaxial strain, the Dirac point moves due to stretched C-C bonds, leading to an increase in the bandgap of armchair GNRs by up to 50% of its original bandgap (i.e. bandgap at zero strain). For zigzag GNRs, due to the existence of the edge states, changes of bandgap are smaller under uniaxial strain and can be increased by ~30%. This work proposes a novel approach to the fabrication of densely aligned graphene nanoribbons with highly smooth edges afforded by anisotropic etching and uniaxial strain for bandgap engineering of GNRs towards high on/off ratio and high on-state current GNR devices. First, we will develop a novel approach for the fabrication of high density GNR arrays (pitch <50 nm, tunable down to 30nm) with pre-defined edge orientation and smooth edges using a free standing nano-mask derived from diblock copolymer assembly for patterning of graphene sheets. Anisotropic graphene edges will be developed to afford smooth edges along crystallographic lattice directions. Then, we will fabricate GNR devices on flexible substrates and apply uniaxial strain to engineer the bandgap of the GNRs. The bandgap of GNRs could be increased by up to 50% under uniaxial strain according to theoretical calculations and will be investigated through electrical transport measurements. Micro-Raman spectroscopy of single GNRs and parallel arrays will be used to probe and quantify the uniaxial strain. Electrical measurements will be used to probe the on/off ratio of GNR FET devices and confirm the bandgap tuning effects. Finally, we plan to use dense parallel arrays of GNRs to demonstrate strained GNR field effect transistors with high on/off ratios and high on-state current, and compare strained GNR FETs with carbon nanotube and Si based field effect transistor (FET) devices.

42 ENGINEERING↗

Linux OS Jitter Measurements at Large Node Counts using a BlueGene/L

We present experimental results for a coordinated scheduling implementation of the Linux operating system. Results were collected on an IBM Blue Gene/L machine at scales up to 16K nodes. Our results indicate coordinated scheduling was able to provide a dramatic improvement in scaling performance for two applications characterized as bulk synchronous parallel programs.

59 BASIC BIOLOGICAL SCIENCES↗

SSCA1-K1

SSCA1-K1 is a parallel implementation of kernel 1 of the SSCA1 benchmark suite released by the DARPA HPCS program. This kernel is able to run in parallel on a distributed shared memory system at extreme scales using OpenSHMEM.

Baker, Matthew↗

Bulk heterojunction organic photovoltaic cells made by glancing angle deposition

A method of making a bulk heterojunction organic photovoltaic cell by glancing angle deposition. As the disclosed method relies on a trajectory of incident vapor flux that is not parallel to the substrate normal, micro and nano-scale columnar structures of thin films can be grown on the substrate. There is also disclosed a method of forming a donor-acceptor heterojunction by depositing at least one additional organic material over the columnar structures.

Forrest, Stephen R.↗

Controlled microfluidic production of alginate beads for in situ encapsulation of microbes

The development and refinement of a microfluidic-based alginate bead generator system for bacterial encapsulation is presented. The resulting microgels have application for the encapsulation of single cells, and can allow for small scale, clonal expansion of thousands of isolated cells in parallel. PDMS based microfluidic chips were fabricated using conventional lithography techniques to produce both externally gelled and directly gelled alginate microspheres using a controlled, water-in-oil emulsion system. The production of directly gelled beads, formed by the in-chip mixing of aqueous alginate and calcium chloride solutions dispersed within an organic carrier flowstream is qualitatively compared to a system, which produces beads and relies on diffusion of a crosslinking agent from the carrier fluid to cause gelation (external gelation). While the direct gelation scheme allows the use of biocompatible oils as the organic carrier, it also has a detrimental effect on device stability often resulting in clogging and gel-streaming at the microfluidic interface of these solutions. A design for the continuous production of directly gelled beads was evaluated in terms of the threshold flow conditions and reagent concentrations that did not result in clogging or streaming. Monodisperse alginate microgels of 30 mum diameter were produced at frequencies of over 500 beads per second. The beads could be completely dispersed into aqueous media using an off-chip washing protocol to remove the organic phase. The microgels effectively encapsulated individual or small numbers of GFP-expressing Escherichia. coli, which could be subsequently clonally expanded. The described microfluidic platform is a robust front-end sample preparation technology that shows strong potential for use in drug delivery systems, biosensors, and other cell-based microcompartmentalization applications. The co-culturing of microbial colonies in a large population of alginate beads will allow for functional - sorting and genetic analyses at the single cell level.

59 BASIC BIOLOGICAL SCIENCES↗

Time-parallel multiscale/multiphysics framework

We introduce the time-parallel compound wavelet matrix method (tpCWM) for modeling the temporal evolution of multiscale and multiphysics systems. The method couples time parallel (TP) and CWM methods operating at different spatial and temporal scales. We demonstrate the efficiency of our approach on two examples: a chemical reaction kinetic system and a non-linear predator prey system. Our results indicate that the tpCWM technique is capable of accelerating time-to-solution by 2 3-orders of magnitude and is amenable to efficient parallel implementation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Information criteria for quantifying loss of reversibility in parallelized KMC

Parallel Kinetic Monte Carlo (KMC) is a potent tool to simulate stochastic particle systems efficiently. However, despite literature on quantifying domain decomposition errors of the particle system for this class of algorithms in the short and in the long time regime, no study yet explores and quantifies the loss of time-reversibility in Parallel KMC. Inspired by concepts from non-equilibrium statistical mechanics, we propose the entropy production per unit time, or entropy production rate, given in terms of an observable and a corresponding estimator, as a metric that quantifies the loss of reversibility. Typically, this is a quantity that cannot be computed explicitly for Parallel KMC, which is why we develop a posteriori estimators that have good scaling properties with respect to the size of the system. Through these estimators, we can connect the different parameters of the scheme, such as the communication time step of the parallelization, the choice of the domain decomposition, and the computational schedule, with its performance in controlling the loss of reversibility. From this point of view, the entropy production rate can be seen both as an information criterion to compare the reversibility of different parallel schemes and as a tool to diagnose reversibility issues with a particular scheme. As a demonstration, we use Sandia Lab's SPPARKS software to compare different parallelization schemes and different domain (lattice) decompositions.

97 MATHEMATICS AND COMPUTING↗

A Bloom Filter Based Scalable Data Integrity Check Tool for Large-Scale Dataset

Large scale HPC applications are becoming increasingly data intensive. At Oak Ridge Leadership Computing Facility (OLCF), we are observing the number of files curated under individual project are reaching as high as 200 millions and project data size is exceeding petabytes. These simulation datasets, once validated, often needs to be transferred to archival system for long term storage or shared with the rest of the research community. Ensuring the data integrity of the full dataset at this scale is paramount important but also a daunting task. This is especially true considering that most conventional tools are serial and file-based, unwieldy to use and/or can't scale to meet user's demand.To tackle this particular challenge, this paper presents the design, implementation and evaluation of a scalable parallel checksumming tool, fsum, which we developed at OLCF. It is built upon the principle of parallel tree walk and work-stealing pattern to maximize parallelism and is capable of generating a single, consistent signature for the entire dataset at extreme scale. We also applied a novel bloom-filter based technique in aggregating signatures to overcome the signature ordering requirement. Given the probabilistic nature of bloom filter, we provided a detailed error and trade-off analysis. Using multiple datasets from production environment, we demonstrated that our tool can efficiently handle both very large files as well as many small-file based datasets. Our preliminary test showed that on the same hardware, it outperforms conventional tool by as much as 4×. It also exhibited near-linear scaling properties when provisioned with more compute resources.

97 MATHEMATICS AND COMPUTING↗

Atomic-scale bonding of bulk metallic glass to crystalline aluminum

A Ti{sub 40}Zr{sub 25}Cu{sub 12}Ni{sub 3}Be{sub 20} bulk metallic glass (BMG) was welded to a crystalline aluminum by the parallel plate explosive welding method. Experimental evidence and numerical simulation show that atomic-scale bonding between the BMG and the crystalline aluminum can be achieved, and the weldment on the BMG side can retain its amorphous state without any indication of crystallization in the welding process. Nanoindentation tests reveal that the interface of the explosive joints exhibits a significant increase in hardness compared to the matrix on its two sides. The joining of BMG and crystalline materials opens a window to the applications of BMGs in engineering.

36 MATERIALS SCIENCE↗

Role of local stresses on co-zone twin-twin junction formation in HCP magnesium

Twin-twin interactions control the formation of twin-twin junctions (TTJ) in hexagonal metals when multiple twin variants are activated in a grain. In this work, we employ a combination of two computational techniques, a 3D full-field crystal plasticity model (CP) and large-scale molecular dynamics (MD), to study the TTJ formation associated with two non-parallel {101¯2} twins in Mg. The local intra-granular stresses generated by discrete twins are computed using a spatially resolved CP model. Atomic-scale knowledge regarding formation processes and local stresses is revealed by MD. The combined analyses suggest that the twin junction forms by the migration of the boundaries of both, the impinging and impinged twin, taking place in the immediate vicinity of the contact point. It is further shown that local stress fields that are generated after initial contact promote thickening of the impinging twin, and may facilitate nucleation of a new twin on the opposite boundary of the recipient twin. In conclusion, calculations of the strain energies suggest that formation of the co-zone twin-twin junction is energetically favorable but detwinning of the TTJ upon load reversal or under cyclic loading is not.

36 MATERIALS SCIENCE↗

Model Exploration of an Information-Based Healthcare Intervention Using Parallelization and Active Learning

This paper describes the application of a large-scale active learning method to characterize the parameter space of a computational agent-based model developed to investigate the impact of CommunityRx, a clinical information-based health intervention that provides patients with personalized information about local community resources to meet basic and self-care needs. Additionally, the diffusion of information about community resources and their use is modeled via networked interactions and their subsequent effect on agents' use of community resources across an urban population. A random forest model is iteratively fitted to model evaluations to characterize the model parameter space with respect to observed empirical data. We demonstrate the feasibility of using high-performance computing and active learning model exploration techniques to characterize large parameter spaces; by partitioning the parameter space into potentially viable and non-viable regions, we rule out regions of space where simulation output is implausible to observed empirical data. We argue that such methods are necessary to enable model exploration in complex computational models that incorporate increasingly available micro-level behavior data. We provide public access to the model and high-performance computing experimentation code.

97 MATHEMATICS AND COMPUTING↗

Hierarchical power distribution in large scale computing systems

Techniques for managing power distribution amongst processors in a massively parallel computer architecture are disclosed. The techniques utilize a hierarchy that organizes the various processors of the massively parallel computer architecture. The hierarchy groups numbers of the processors at the lowest level. When processors complete tasks, the power assigned to those processors is distributed to other processors in the same group so that the performance of those processors can be increased. Hierarchical organization simplifies the calculations required for determining how and when to distribute power, because when tasks are complete and power is available for distribution, a relatively small number of processors are available for consideration to receive that power. The number of processors that are grouped together can be adjusted in real time based on performance factors to improve the trade-off between calculation speed and power distribution efficacy.

42 ENGINEERING↗

NWChem: Past, present, and future

Specialized computational chemistry packages have permanently reshaped the landscape of chemical sciences by providing tools to support and guide the experimental effort and for prediction of chemical and materials properties. In this regard, a special role has been played by electronic structure packages where complex chemical and materials processes can be modeled using first-principle-driven methodologies. Over the last few decades, the rapid development of computing technologies and a tremendous increase in computational power has offered a unique chance to study complex chemical transformations using sophisticated and predictive many-body techniques to describe correlated behavior of electrons in molecular and condensed phase systems at different levels of theory. In enabling these simulations, a critical role has been played by novel parallel algorithms capable of taking advantage of computational resources to address polynomial scaling of electronic structure methods. NWChem was among the first electronic structure codes that focused on delivering scalable performance for electronic structure simulations. Herein, we briefly review the NWChem suite of computational codes including its history, design principles, parallel tools, current capabilities, outreach and outlook.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Progress on Optimizing Wind Farms and Rotor Designs Using Adjoints

Modern wind plants are increasingly tasked with multiple performance objectives. In addition to designing plants that maximize power output and minimize the levelized cost of energy (LCOE), the design and operation of wind plants is increasingly influenced by challenges regarding grid integration of variable generation renewables. This places a growing emphasis on making wind plants more controllable and predictable. WindSE is a Reynolds-averaged Navier-Stokes (RANS) model designed around analytical gradient and adjoint methods, with the ability to capture terrain-induced effects, as shown in Figure 1. The recent addition of an unsteady solver with an actuator line method (ALM) and ongoing work to enable massively parallel optimizations gives it a unique niche to explore coupled plant-level controls and design problems. This code is an open source python package built on the FEniCS framework that utilizes fast, parallel PETSc solvers to model fluid flow throughout wind-farm scale domains. Two recent studies performed using WindSE demonstrate the capability to optimize under a wide variety of flow conditions and objective functions. In the first, we present an optimization focused on modifying the layout of a wind farm with a fixed number of turbines for maximum total power output [1]. This study highlights the ability to quickly perform simulations using the steady Navier-Stokes solver combined with rotors represented as actuator disks while also stressing the importance of capturing terrain-induced effects. Gradient-based optimization using the RANS equations is viable due to the inclusion of efficiently computed adjoint derivatives. We interpret the physical results of the optimal layout and also discuss the computational cost of scaling to larger problems. In the second study, we present the capabilities of the unsteady Navier-Stokes solver, where rotor-blade profiles represented by actuator lines are optimized to enhance wake steering effects and overall power production [2]. We quantify the wind plant performance gains obtained from this type of simultaneous control co-design optimization as compared to optimizing the blade design and yaw independently. Figure 2 shows the differences between a baseline two-turbine system and an optimized system where we fine-tune the blade chord profile. Results and challenges from each study are quickly summarized and used to motivate the current development efforts within WindSE. Current and future work is focused on enabling higher-resolution studies with more degrees of freedom through parallelization of both the simulation and optimization algorithms. We present benchmarking results to show that WindSE performs well in both weak- and strong-scaling tests and further demonstrate that the optimizer obtains the same convergence rates in both shared- and distributed-memory environments. Using larger wind farms, we can study deep-array effects within an optimization context, allowing the use of objective functions that have been previously unstudied. As an example, we present ongoing work on a blockage metric which characterizes the loss of available kinetic energy due to wake effects from multiple upstream turbines.

adjoint optimization↗

Higher-order finite-difference formulation of periodic Orbital-free Density Functional Theory

We present a real-space formulation and higher-order finite-difference implementation of periodic Orbital-free Density Functional Theory (OF-DFT). Specifically, utilizing a local reformulation of the electrostatic and kernel terms, we develop a generalized framework for performing OF-DFT simulations with different variants of the electronic kinetic energy. In particular, we propose a self-consistent field (SCF) type fixed-point method for calculations involving linear-response kinetic energy functionals. In this framework, evaluation of both the electronic ground-state and forces on the nuclei are amenable to computations that scale linearly with the number of atoms. We develop a parallel implementation of this formulation using the finite-difference discretization. We demonstrate that higher-order finite-differences can achieve relatively large convergence rates with respect to mesh-size in both the energies and forces. Additionally, we establish that the fixed-point iteration converges rapidly, and that it can be further accelerated using extrapolation techniques like Anderson's mixing. We validate the accuracy of the results by comparing the energies and forces with plane-wave methods for selected examples, including the vacancy formation energy in Aluminum. Overall, the suitability of the proposed formulation for scalable high performance computing makes it an attractive choice for large-scale OF-DFT calculations consisting of thousands of atoms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Scale-dependent normalized amplitude and weak spectral anisotropy of magnetic field fluctuations in the solar wind turbulence

Turbulence in the solar wind was recently reported to be anisotropic, with the average power spectral index close to −2 when sampling parallel to the local mean magnetic field B{sub 0} and close to −5/3 when sampling perpendicular to the local B{sub 0}. This result was widely considered to be observational evidence for the critical balance theory (CBT), which is derived by making the assumption that the turbulence strength is close to one. However, this basic assumption has not yet been checked carefully with observational data. Here we present for the first time the scale-dependent magnetic-field fluctuation amplitude, which is normalized by the local B{sub 0} and evaluated for both parallel and perpendicular sampling directions, using two 30-day intervals of Ulysses data. From our results, the turbulence strength is evaluated as much less than one at small scales in the parallel direction. An even stricter criterion is imposed when selecting the wavelet coefficients for a given sampling direction, so that the time stationarity of the local B{sub 0} is better ensured during the local sampling interval. The spectral index for the parallel direction is then found to be −1.75, whereas the spectral index in the perpendicular direction remains close to −1.65. These two new results, namely that the value of the turbulence strength is much less than one in the parallel direction and that the angle dependence of the spectral index is weak, cannot be explained by existing turbulence theories, like CBT, and thus will require new theoretical considerations and promote further observations of solar-wind turbulence.

79 ASTRONOMY AND ASTROPHYSICS↗