Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

ParFlow Sand Tank: A tool for groundwater exploration

The ParFlow Sand Tank model is an open source application designed to allow users to interactively simulate and visualize groundwater movement through the subsurface. The app is designed for both research and education; teaching hydrogeology concepts and making it easy explore and run sophisticated groundwater simulations. Our goal is to support increased accessibility and usability of research grade hydrology tools for research and teaching. The Sand Tank application simulates groundwater and surface water fluxes as well as contaminant transport in real time using the integrated physical hydrology model ParFlow (Kollet & Maxwell, 2006; Maxwell & Miller, 2005; Osei-Kuffuor et al., 2014) and the particle tracking code EcoSlim (Maxwell et al., 2019). ParFlow is a numerical hydrology model that simulates spatially distributed groundwater and surface water flow. It is a well established research tool with more than 90 publications documenting its development use to advance our understanding of groundwater dynamics and groundwater surface water interactions from the hillslope to the continental scale e.g. (Condon et al., 2020; Condon & Maxwell, 2019; Maxwell & Condon, 2016). It is designed for efficient parallel computation and has been run on many platforms spanning from laptops to supercomputers. However, one of the challenges of ParFlow is that it requires significant training and hydrologic expertise to develop simulations. The Sand Tank application makes this model accessible to anyone for education and exploration. Our application uses ParFlow for its simulation backend and ParaView for the data loading and processing. The communication infrastructure relies on the ParaViewWeb framework. We use model templates deployed in Docker images to setup the Sand Tank framework. Users can build the application locally or interact with it through our web deployment. When interacting with a template users can interactively change model parameters like subsurface processes or pump/inject water into the subsurface and watch the system respond to their changes in real time as the simulation runs. Additionally, our template setup will allow more advanced users to build custom templates of increasing complexity for both research and educational purposes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Rapid QSTS Simulations for High-Resolution Comprehensive Assessment of Distributed PV

The rapid increase in penetration of distributed energy resources on the electric power distribution system has created a need for more comprehensive interconnection modeling and impact analysis. Unlike conventional scenario-based studies, quasi-static time-series (QSTS) simulations can realistically model time-dependent voltage controllers and the diversity of potential impacts that can occur at different times of year. However, to accurately model a distribution system with all its controllable devices, a yearlong simulation at 1-second resolution is often required, which could take conventional computers a computational time of 10 to 120 hours when an actual unbalanced distribution feeder is modeled. This computational burden is a clear limitation to the adoption of QSTS simulations in interconnection studies and for determining optimal control solutions for utility operations. The solutions we developed include accurate and computationally efficient QSTS methods that could be implemented in existing open-source and commercial software used by utilities and the development of methods to create high-resolution proxy data sets. This project demonstrated multiple pathways for speeding up the QSTS computation using new and innovative methods for advanced time-series analysis, faster power flow solvers, parallel processing of power flow solutions and circuit reduction. The target performance level for this project was achieved with year-long high-resolution time series solutions run in less than 5 minutes within an acceptable error.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Distributed Training and Optimization of Neural Networks

Deep learning models are yielding increasingly better performances thanks to multiple factors. To be successful, model may have large number of parameters or complex architectures and be trained on large dataset. This leads to large requirements on computing resource and turn around time, even more so when hyperparameter optimization is done (e.g. search over model architectures). While this is a challenge that goes beyond particle physics, we review the various ways to do the necessary computations in parallel, and put it in the context of high-energy physics.

Vlimant, Jean-Roch↗
DOE OSTI2020

Cross-Sections of Nanocellulose from Wood Analyzed by Quantized Polydispersity of Elementary Microfibrils

Bio-based nanocellulose has been shown to possess impressive mechanical properties and simplicity for chemical modifications. The chemical properties are largely influenced by the surface area and functionality of the nanoscale materials. However, finding the typical cross-sections of nanocellulose, such as cellulose nanofibers (CNFs), has been a long-standing puzzle, where subtle changes in extraction methods seem to yield different shapes and dimensions. Here, we extracted CNFs from wood with two different oxidation methods and variations in degree of oxidation and high-pressure homogenization. Additionally, the cross-sections of CNFs were characterized by small-angle X-ray scattering and wide-angle X-ray diffraction in dispersed and freeze-dried states, respectively, where the results were analyzed by assuming that the cross-sectional distribution was quantized with an 18-chain elementary microfibril, the building block of the cell wall. We find that the results agree well with a pseudosquare unit having a size of about 2.4 nm regardless of sample, while the aggregate level strongly depends on the extraction conditions. Furthermore, we find that aggregates have a preferred cohesion of phase boundaries parallel to the (110)-plane of the cellulose fibril, leading to a ribbon shape on average.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Oxygen Vacancies Alter Methanol Oxidation Pathways on NiOOH

A thorough comprehension of the mechanism underlying the methanol oxidation reaction (MOR) on Ni-based catalysts is critical for future electrocatalytic design and development. However, the mechanism of MOR on these materials remains a matter of controversy. Herein, we combine in situ surface-enhanced infrared absorption spectroscopy (SEIRAS) and density functional theory (DFT) calculations to identify the active sites and determine the mechanism of MOR on monometallic Ni-based catalysts in alkaline media. The SEIRAS results show that formate and (bi)carbonate are formed after the commencement of the MOR with potential-dependent relative distributions. These spectroscopic results are in good agreement with the DFT-computed reaction profiles over an oxygen vacancy, suggesting that the MOR mainly proceeds through the formate-involving pathway, in which the early consumption of methanol yields formate as the major product, while increasing potential drives further oxidation of formate to (bi)carbonate. We also find a parallel pathway for the generation of (bi)carbonate at high potentials that bypasses the formation of formate. The two main pathways are thermodynamically more feasible than the one predominantly reported in the literature for MOR on NiOOH that involves CHO and/or CO as key intermediates. These DFT results are supported by spectroscopic evidence showing that no band associated with CHO or CO can be detected by SEIRAS, which is attributed to the nature of the oxygen vacancies as the active sites, suppressing deep dehydrogenation of CH 2 O to CHO. Furthermore, this work thus shows the promising role of defect engineering in promoting the electrocatalytic MOR activity and selectivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Large Scale MD to Predict Epitope Regions in HIV Env [Slides]

Highly dense carbohydrates located on the surface of the HIV Env protein play a key role in immune evasion. Such evolutionary adaptation hampers any attempt to obtain a full mechanistic understanding of the role played by the glycans in protecting the virus against an effective immune response. Moreover, and due to their chemical variability, an accurate molecular understanding of the so called “glycan shield” is still limited by the lack of effective resolution of state-of-the-art experimental technics. Here, we have used extensive computational modelling in order to fill this gap, addressing the presence of a large glycan variability as observed experimentally. Based on an automated pipeline, we were able to assemble, set-up and simulate via Molecular dynamics hundreds of different glycosylated Env variants at nearly atomic resolution, recapitulating the glycosylation distributions observed experimentally. Results from these simulations were subjected to machine learning and very accurate prediction of simulation derived glycan shielding areas of each glycan as a function of static sequence features. Such predictive models of per-glycan shielding, incorporating both glycan dynamics and heterogeneity, were used to develop a novel sequence-based glycan shield mapping strategy. Parallel to these studies, we also developed an accurate machine learning approach to predict glycan heterogeneity data using sequence features and found good prediction accuracy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Multi-GPU porting of a phase-change cascaded lattice Boltzmann method for three-dimensional pool boiling simulations

The Lattice Boltzmann method (LBM) has proven effective in simulating phase-change phenomena, such as melting, solidification, evaporation, and boiling. In this work, we develop a highly parallelized multi-GPU implementation of LBM for three-dimensional pool boiling simulations. The code is based on the OpenACC programming model, which enables the code to be deployed efficiently on multi-core CPUs, GPUs, and potentially other accelerators, without the need for architecture-specific rewrites. To support large-scale simulations, the domain is decomposed and distributed across multiple compute nodes using MPI. We demonstrate that the code exhibits excellent scaling properties, with ideal strong-scaling running with up to 256 GPUs on the MareNostrum5 cluster.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Current-Source Solid-State DC Transformer Integrating LVDC Microgrid, Energy Storage, and Renewable Energy Into MVDC Grid

Solid-state DC transformer to integrate low-voltage DC (LVDC) microgrid, wind turbine (WT) generator, photovoltaic (PV), and energy storage (ES) into medium-voltage (MV) direct-current (MVDC) distribution grids is attractive. This paper proposes current-source DC solid-state transformer (SST) for MVDC collection system in WT, PV, and ES farms or as an interface between the MVDC grid and the LVDC microgrid. Compared to conventional current-source converter (CSC) based SSTs, a switch reduction scheme on reverse-blocking device bridges is proposed to reduce device count and the number of devices on the DC-link current path. Importantly, the proposed switch reduction scheme is generic and can be applied to the DC ports of DC-AC, AC-DC, or DC-DC hard-switching or soft-switching CSC-based SSTs. Based on this scheme, the proposed current-source DC SSTs are derived, which have reduced electrolytic-capacitor-less DC-link. The proposed DC SSTs also achieve single-stage isolated DC-DC or DC-AC conversion, full-range zero-voltage switching (ZVS) for main switches, zero-current switching (ZCS) for resonant switches, and controlled dv/dt. The proposed DC SSTs, operating principles, predictive control method, the ZVS, and the controlled dv/dt under voltage buck-boost ranges are verified with MV simulations and an experimental prototype based on SiC MOSFETs, diodes, and a nanocrystalline transformer.

14 SOLAR ENERGY↗
DOE OSTI2022

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗
DOE OSTI2025

Metagenome-assembled genomes from topsoils collected during NEON campaign in East River, CO (06/14/2018-06/28/2018)

The Watershed Function Science Focus Area (WF SFA) at Lawrence Berkeley National Lab is working to build a mechanistic understanding of the distribution and dynamics of biogeochemical processes in mountainous watersheds and their response to perturbation. In June 2018, the NEON (National Ecological Observatory Network) Airborne Observatory Platform (AOP) performed a taskable airborne imaging campaign to collect visible to shortwave infrared (VSWIR) imaging spectroscopy and LiDAR data across 330 km2 in the Upper East River at Crested Butte, CO. We conducted a parallel ground sampling campaign to sample vegetation traits, as well as soil physical, chemical, and microbiological characteristics. We collected these samples from 438 sites across 12 locations spanning much of the elevation, topographic, and geologic variability across the study area. A subset of 250 samples were used for soil metagenomics which is presented here. In addition, at each site, vegetation samples were collected to measure species-specific leaf water content and leaf mass area, foliar elemental composition and foliar CN stable isotope ratios. Soil samples were collected to measure soil physical properties which include bulk density and soil texture analysis. A suite of soil chemical properties was measured from the samples collected at each site, including pH, organic matter, concentrations exchangeable cations, total elemental composition, and the concentrations of extractable N pools (e.g. total free amino acids, ammonium, nitrate, dissolved organic N, and total dissolved N). Additionally, we have measured soil microbial biomass CN stoichiometry. Here, we present 1982 metagenome-assembled genomes (MAGs) for the bacterial and archaeal community from topsoil collected from during NEON 2018 campaign. All metagenomes were sequenced at JGI (Joint Genome Institute) (GOLD Study ID: Gs0149986). Metagenomes were assembled using JGI Metagenome Workflow (10.1128/mSystems.00804-20). The dataset includes (1) zip files for 1982 MAG fasta files (neon_genomes1-5.tar.gz, split into 5 tarballs to keep tarballs under 0.5 GB), (2) neon_Gs0149986_samples_soilproperties_metagenomes.csv: the sample information together with the accession numbers for the underlying metagenomes and the associated soil physical and chemical measurements in NMDC (National Microbiome Data Collaborative) compliant format, (3) neon_Gs0149986.kml: location bounding box file for the sampled locations, (4) samples.csv: sample metadata file used to register Internationall Generic Sample Numbers (IGSNs), (5) flmd.csv: file level metadata file, and (6) dd.csv: data dictionary file. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2020

Component and efficient plate and frame absorber

An absorber for an absorption refrigeration system for a vertically mounted plate absorber has fins positioned over the plate to promote distribution of a fluid under flow as a nearly continuous thin film. The absorber has rows of fins that are evenly spaced with the fins occupying a portion of the active width of the plate with adjacent rows offset by the width of the plate. A combined evaporator-absorber module is constructed with the absorbing face of the absorber parallel with an evaporating surface of an evaporator where absorber solution and refrigerant fall as parallel falling sheets of liquid. The absorber is covered with a porous hydrophobic membrane to isolate the falling absorber solution from the falling liquid refrigerant.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Profiling the BLAST bioinformatics application for load balancing on high-performance computing clusters

Abstract Background The Basic Local Alignment Search Tool (BLAST) is a suite of commonly used algorithms for identifying matches between biological sequences. The user supplies a database file and query file of sequences for BLAST to find identical sequences between the two. The typical millions of database and query sequences make BLAST computationally challenging but also well suited for parallelization on high-performance computing clusters. The efficacy of parallelization depends on the data partitioning, where the optimal data partitioning relies on an accurate performance model. In previous studies, a BLAST job was sped up by 27 times by partitioning the database and query among thousands of processor nodes. However, the optimality of the partitioning method was not studied. Unlike BLAST performance models proposed in the literature that usually have problem size and hardware configuration as the only variables, the execution time of a BLAST job is a function of database size, query size, and hardware capability. In this work, the nucleotide BLAST application BLASTN was profiled using three methods: shell-level profiling with the Unix “time” command, code-level profiling with the built-in “profiler” module, and system-level profiling with the Unix “gprof” program. The runtimes were measured for six node types, using six different database files and 15 query files, on a heterogeneous HPC cluster with 500+ nodes. The empirical measurement data were fitted with quadratic functions to develop performance models that were used to guide the data parallelization for BLASTN jobs. Results Profiling results showed that BLASTN contains more than 34,500 different functions, but a single function, RunMTBySplitDB, takes 99.12% of the total runtime. Among its 53 child functions, five core functions were identified to make up 92.12% of the overall BLASTN runtime. Based on the performance models, static load balancing algorithms can be applied to the BLASTN input data to minimize the runtime of the longest job on an HPC cluster. Four test cases being run on homogeneous and heterogeneous clusters were tested. Experiment results showed that the runtime can be reduced by 81% on a homogeneous cluster and by 20% on a heterogeneous cluster by re-distributing the workload. Discussion Optimal data partitioning can improve BLASTN’s overall runtime 5.4-fold in comparison with dividing the database and query into the same number of fragments. The proposed methodology can be used in the other applications in the BLAST+ suite or any other application as long as source code is available.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Evaluation of flow-induced plate deflection for University of Missouri research reactor low-enriched uranium fuel element

The University of Missouri Research Reactor (MURR), located on the campus of the University of Missouri in Columbia, Missouri, is one of the six United States (U.S.) High Performance Research Reactors (USHPRR), including one critical facility, that are actively collaborating with the U.S. Department of Energy (DOE) National Nuclear Security Administration (NNSA) Office of Material Management and Minimization (M3) Reactor Conversion Program to convert from highly enriched uranium (HEU, ≥20 wt% U-235) fuel to low-enriched uranium (LEU, <20 wt% U-235) fuel. A new type of very high-density LEU fuel based on a monolithic alloy of uranium and 10 wt% molybdenum (U-10Mo) is expected to allow conversion of some USHPRR, including MURR. In the design of its fuel elements, MURR is using thin parallel curved fuel plates separated by coolant channels. In this work, fluid-structure interaction (FSI) analysis of the MURR LEU fuel element is performed at the element level (as compared to the plate level analysis), which models all components of the LEU fuel element, including fuel plates and the supporting structures. Therefore, the effect of supporting structures on the flow distribution within the element and the fuel plate deflection are evaluated. In addition to the element nominal flow rate and dimensions, the tolerances in the geometry of the coolant channel and plate thickness, the effect of a comb on plate deflection, and the uncertainty of the flow rate per element are evaluated. For the LEU fuel plates, which are thinner than the current HEU plates, the predicted plate deflection is found to be small compared to the fabrication and assembly tolerances. Thus, the FSI-induced deflections are not expected to noticeably reduce the coolant flow rate or predicted safety margins in the limiting channels for the MURR LEU fuel element. In addition to the simulation work, a hydraulic performance test of the MURR LEU fuel element is currently being planned to support conversion to the use of LEU fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

A simple, flexible technique for RF cavity wake-field calculations

It is typical in the accelerator field to model machine components, especially RF cavities, as parallel RLC resonators. In the interest of simulating and diagnosing beam instabilities, knowledge of the time-domain voltage waveform over an equivalent resonator by a bunch current often proves useful. This waveform may be found by convolving the bunch current with the RLC resonator impulse response. While analytical and quasi-analytical expressions are available in this regime for common distributions such as the Gaussian, analogous results for less standard distributions are difficult to obtain using direct methods, which opens the door for the development of a more generalized technique. In this paper, a formulation is created that allows for the simple computation of the time-domain voltage waveform of and RLC resonator. The formulation uses the Cauchy Residue Theorem to extract the convolution result from the Fourier Domain, and it only requires that the current distribution Fourier Transform be holomorphic and known at one specific evaluation point. This greatly simplifies the computation of the time domain voltage for a large amount of bunch distributions both common and uncommon.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Algorithm 1028: VTMOP: Solver for Blackbox Multiobjective Optimization Problems

VTMOP is a Fortran 2008 software package containing two Fortran modules for solving computationally expensive bound-constrained blackbox multiobjective optimization problems. VTMOP implements the algorithm of [32], which handles two or more objectives, does not require any derivatives, and produces well-distributed points over the Pareto front. The first module contains a general framework for solving multiobjective optimization problems by combining response surface methodology, trust region methodology, and an adaptive weighting scheme. The second module features a driver subroutine that implements this framework when the objective functions can be wrapped as a Fortran subroutine. Lastly, support is provided for both serial and parallel execution paradigms, and VTMOP is demonstrated on several test problems as well as one real-world problem in the area of particle accelerator optimization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

An atomic beam of titanium for ultracold atom experiments

Here we generate an atomic beam of titanium (Ti) using a “Ti-ball” Ti-sublimation pump, which is a common getter pump used in ultrahigh vacuum systems. We show that the sublimated atomic beam can be optically pumped into the metastable 3d 3 ( 4 F)4s a 5 F 5 state, which is the lower energy level in a cycling optical transition that can be used for laser cooling. We measure the atomic density and transverse and longitudinal velocity distributions of the beam through laser fluorescence spectroscopy. We find a metastable atomic flux density of 4.3(2) × 10 9 s -1 cm -2 with a mean forward velocity of 773(8) m/s at 2.55 cm directly downstream of the center of the Ti-ball. Owing to the details of optical pumping, the beam is highly collimated along the transverse axis parallel to the optical pumping beam and the flux density falls off as 1/r. We discuss how this source can be used to load atoms into a magneto-optical trap.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Enhancement of ECCD by the current condensation effect for stabilizing large magnetic islands caused by neoclassical tearing modes in tokamak plasmas

The radio frequency current condensation effect reported in Reiman and Fisch (2018 Phys. Rev. Lett. 121 225001) is modeled in the nonlinear resistive magnetohydrodynamic code. A series of numerical investigations have been performed to investigate the enhancement of electron cyclotron current drive (ECCD) by the current condensation effect during the control of neoclassical tearing mode (NTM) in tokamak plasmas. In the numerical model, both the parallel transport and the perpendicular transport of electron temperature are considered. The EC driven current and driven perturbed electron temperature can nonlinearly evolve within the given magnetic configuration and eventually reach saturation states. The input power threshold of ECCD and the fold bifurcation phenomenon are numerically verified via nonlinear simulations. The numerical results show good agreements with the analytical results. Moreover, spatial distributions of EC current for the two solutions at different condensed level are displayed. The control effectiveness of ECCD for large NTM islands has been evaluated while considering the current condensation effect. While taking into account current condensation effect, for a sufficiently large input power, a larger island can be more effectively stabilized than a smaller one, which suggests a reassessment of the previous idea that the ECCD should always be turned on as early as possible. The potential physics mechanism behind the ECCD control have all been discussed in detail. Furthermore, the condensation effect is found to have favorable effects on the radial misalignment of ECCD. In the consideration of the situation for extremely localized control needs, a highly peaked heating profile is adopted to verify that the fold bifurcation phenomenon still exists and the current condensation effect can still take effect in this extreme condition.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

SAIGE-GPU: accelerating genome- and phenome-wide association studies using GPUs

Genome-wide association studies (GWAS) at biobank scale are computationally intensive, especially for admixed populations requiring robust statistical models. SAIGE is a widely used method for generalized linear mixed-model GWAS but is limited by its CPU-based implementation, making phenome-wide association studies impractical for many research groups. We developed SAIGE-GPU, a GPU-accelerated version of SAIGE that replaces CPU-intensive matrix operations with GPU-optimized kernels. The core innovation is distributing genetic relationship matrix calculations across GPUs and communication layers. Applied to 2068 phenotypes from 635 969 participants in the Million Veteran Program, including diverse and admixed populations, SAIGE-GPU achieved a 5-fold speedup in mixed model fitting on supercomputing infrastructure and cloud platforms. We further optimized the variant association testing step through multi-core and multi-trait parallelization. Deployed on Google Cloud Platform and Azure, the method provided substantial cost and time savings. Source code and binaries are available for download at https://github.com/saigegit/SAIGE/tree/SAIGE-GPU-1.3.3. A code snapshot is archived at Zenodo for reproducibility (DOI: [10.5281/zenodo.17642591]). SAIGE-GPU is available in a containerized format for use across HPC and cloud environments and is implemented in R/C++ and runs on Linux systems.

Rodriguez, Alex [Argonne National Laboratory (ANL)↗