Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

PoliMOR

PoliMOR is a scalable, automated, and customizable policy engine framework for multi-tiered parallel file systems. It is composed of single-purpose agents that handle tasks such as gathering file metadata, making policy decisions, and then executing actions based on those policies. These agents are designed to communicate using distributed message queues, allowing the number of individual agents to be scaled up as needed. PoliMOR automates the data management tasks by precluding the need for admin intervention. The agents in PoliMOR can be customized to integrate any utilities/tools that perform tasks like metadata scanning and data placement management.

Brumgard, Christopher↗
DOE OSTI2021

Scalable balanced training of conditional generative adversarial neural networks on image data

Here, we propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data labels, and enhances scalability by performing a parallel training where multiple generators are concurrently trained, each one of them focusing on a single data label. Performance is assessed in terms of inception score, Fréchet inception distance, and image quality on MNIST, CIFAR10, CIFAR100, and ImageNet1k datasets, showing a significant improvement in comparison to state-of-the-art techniques to training DC-CGANs. Weak scaling is attained on all the four datasets using up to 1000 processes and 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Gene-environment interactions due to quantile-specific heritability of triglyceride and VLDL concentrations

"Quantile-dependent expressivity" is a dependence of genetic effects on whether the phenotype (e.g., triglycerides) is high or low relative to its distribution in the population. Quantile-specific offspring-parent regression slopes (β OP ) were estimated by quantile regression for 6227 offspring-parent pairs. Quantile-specific heritability (h 2 ), estimated by 2β OP /(1 + $\Gamma$ spouse ), decreased 0.0047 ± 0.0007 (P = 2.9 × 10 -14 ) for each one-percent decrement in fasting triglyceride concentrations, i.e., h 2 ± SE were: 0.428 ± 0.059, 0.230 ± 0.030, 0.111 ± 0.015, 0.050 ± 0.016, and 0.033 ± 0.010 at the 90th, 75th, 50th, 25th, and 10th percentiles of the triglyceride distribution, respectively. Consistent with quantile-dependent expressivity, 11 drug studies report smaller genotype differences at lower (post-treatment) than higher (pre-treatment) triglyceride concentrations. This meant genotype-specific triglyceride changes could not move in parallel when triglycerides were decreased pharmacologically, so that subtracting pre-treatment from post-treatment triglyceride levels necessarily created a greater triglyceride decrease for the genotype with a higher pre-treatment value (purported precision-medicine genetic markers). In addition, sixty-five purported gene-environment interactions were found to be potentially attributable to triglyceride's quantile-dependent expressivity, including gene-adiposity (APOA5, APOB, APOE, GCKR, IRS-1, LPL, MTHFR, PCSK9, PNPLA3, PPARγ2), gene-exercise (APOA1, APOA2, LPL), gene-diet (APOA5, APOE, INSIG2, LPL, MYB, NXPH1, PER2, TNFA), gene-alcohol (ALDH2, APOA5, APOC3, CETP, LPL), gene-smoking (APOC3, CYBA, LPL, USF1), gene-pregnancy (LPL), and gene-insulin resistance interactions (APOE, LPL).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Axolotl: a scalable genomics library based on Apache Spark (Axolotl) v1.0.0

Axolotl is a Python library for scalable distributed genome and metagenome data analysis. Existing tools and systems that we rely on are struggling to keep up with the rapid explosion of genomic data. Compounding this issue, developing scalable solutions require a steep learning curve in parallel programming, which presents a barrier to academic researchers. While we do have scalable solutions for specific tasks, we lack comprehensive, end-to-end solutions. It's this gap in our toolkit that we aim to address with Axolotl. The Axolotl library is built for easy parallel processing, efficiently handling multiple tasks or large datasets simultaneously, and scaling up to meet the demands of extensive genomic data analysis.

Wang, Zhong↗
DOE OSTI2023

Hybrid Solar System (Final Scientific/Technical Report)

GTI Energy (GTI) teamed with the University of California at Merced (UCM) to scaleup the hybrid solar system (HSS) technology for demonstrating its performance at the US Gypsum (USG) plant in Plaster City, California. The technology integrates two-stage concentrating solar collector with matching particle thermal transport and storage (TSS) system to deliver cost-effective, and on-demand distributed high temperature industrial process heat up to 600°C with solar thermal, in this case to a gypsum kettle, to reduce its fuel use and carbon footprint. Current solar technologies, which reach these temperatures, are not distributable (towers) or cost-effective (dish). The research team developed a conceptual system design for host site retrofit, including preliminary heat balance, process flow diagram, particle to process heat exchanger and equipment placements at the site. Subsequently, parallel efforts were carried out at UCM to design, build and test a 12 m long commercial scale prototype concentrating thermal-only collector system and at GTI to design, build and test a matching 650°C capable particle TTS system. The nominal 50 kWth collector consists of a parabolic trough and three 4 m long two-stage receivers in series. Prior to on-sun testing, a 4 m long receiver was fabricated and successfully tested at 650 °C in a laboratory setting for 100 hrs of continuous operation showing less than 15% radiation loss. A 7 m wide x 17 m long parabolic trough was then installed at UCM for on-sun testing of the 12 m long receiver, and concurrently several 4 m long receivers were built. The optics of the parabolic trough were calibrated, and on-sun test were carried out on 12 m long receivers. During tests, the intense solar radiation (53x) caused the absorber tubes in the receivers to bend, reducing the overall optical efficiency. To address the bending issue, a self-consistent algorithm that includes ray tracing, thermal and deformation models was developed to perform thermal stress analysis on absorbers for parabolic solar collectors. Results obtained with this algorithm showed a dramatic rise in deformation as absorber tube length increases. A combined efficiency parameter that includes the occluded area for the mounts was developed to obtain an optimized tube length obtained. Based on the results, a length of 2.7 m for the absorber + 0.2 m for the coupler was chosen to minimize any bending and optimize optical efficiency while maintaining ease of mounting. The associated particle TTS system was designed, built and successfully tested at GTI. It includes storage, receiving and lock hoppers and piping that simulates the transfer of captured solar energy to an actual industrial furnace. Tests over 77 charge-discharge cycles demonstrated <2% particle degradation, with no problematic particle accumulations and no flow interruptions. The piping pressure drop was about 5 psi. The team also worked with Stanley Consultants (Stanley) to prepare conceptual and preliminary engineering packages to facilitate follow-on development and commercialization efforts. These include process and instrumentation diagram’s (P&ID’s), general arrangements, electrical one-line, project definitions document, equipment data sheets, schedule, and construction cost estimate for 2 MWth system. Updated HSS technology commercialization and customer engagement plans and detailed costs and evaluated market trade-offs and manufacturing.

03 NATURAL GAS↗
DOE OSTI2025

Graph-Learning-Assisted State and Event Tracking for Solar-Penetrated Power Grids with Heterogeneous Data Sources

Unlike transmission systems, distribution systems do not typically contain sufficient metering to enable real-time state estimation. The lack of sufficient real-time measurements prohibits accurate and timely monitoring of the state of distribution systems. As a result, control and optimal operation of distribution systems, especially those containing large numbers of renewable generation units are not possible without proper data and information about the current state of the system. The main motivation of this project is to address this shortcoming by developing an approach which provides “predicted” real-time measurements so that they can be used to execute a distribution system state estimator. Thus, the objective of the project is to make the distribution systems fully observable, such that the hosting capacity for solar generation can be accurately estimated, and unnecessary solar curtailments can be avoided. In order to accomplish this goal, the project investigated the use of a grid-model-informed machine learning (ML) tool which integrates heterogeneous data streams obtained from AMI meters, SCADA as well as PMU measurements and created synchronous measurement snapshots for the state estimator (SE); and developed a hybrid robust SE which provides not only accurate state estimates but also real-time feedback for the ML model refinement.

14 SOLAR ENERGY↗
DOE OSTI2021

Fiber orientation effects on ultra-high performance concrete formed by 3D printing

Despite the growing interest in 3D concrete printing, its current progress is limited by reinforcing methods. Inclusion of steel fibers is a potential reinforcing solution; however, the effect of printing process on orientation of the fibers is still unknown. This study aims to quantitatively investigate the orientation distribution of steel fibers in 3D printed ultra-high performance concrete. The effects of extrusion nozzle size, Cartesian print speed, and fiber volume fraction on the orientation of fibers were evaluated using digital image analysis. The consequent effects of the fiber orientation on the mechanical properties of the 3D-printed specimens were also determined. The results were compared with those of the conventionally mold-cast specimens. The results revealed that the smaller nozzle size and higher fiber volume fraction significantly enhanced the fiber alignment parallel to the printing direction. This preferential fiber alignment led to superior mechanical performance of the printed specimens to the mold-cast specimens.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Discovery of Extended Tidal Tails around the Globular Cluster Palomar 13

We use photometry from the DECam Legacy Survey to detect candidate tidal tails extending ~5° on either side of the Palomar 13 globular cluster. The tails are aligned with the proper motion of Palomar 13 and are consistent with its old, metal-poor stellar population. We identify three RR Lyrae stars (RRLs) that are plausibly associated with the tails, in addition to four previously known in the cluster. From these RRLs, we find that the mean distance to the cluster and tails is 23.6 ± 0.2 kpc and estimate the total (initial) luminosity of the cluster to be , consistent with previous claims that its initial luminosity was higher than its current luminosity. Combined with previously determined proper motion and radial velocity measurements of the cluster, we find that Palomar 13 is on a highly eccentric orbit (e ~ 0.8) with a pericenter of ~9 kpc and an apocenter of ~69 kpc, and a recent pericentric passage of the cluster ~75 Myr ago. We note a prominent linear structure in the interstellar dust map that runs parallel to the candidate tidal features, but conclude that reddening due to dust is unlikely to account for the structure that we observe. If confirmed, the Palomar 13 stellar stream would be one of very few streams with a known progenitor system, making it uniquely powerful for studying the disruption of globular clusters, the formation of the stellar halo, and the distribution of matter within our Galaxy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Particlization in fluid dynamical simulations of heavy-ion collisions: The IS3D module

The IS3D particlization module simulates the emission of hadrons from heavy-ion collisions via Monte-Carlo sampling of the Cooper–Frye formula which converts fluid dynamical information into local phase-space distributions for hadrons. The code package includes multiple choices for the non-equilibrium correction to these distribution functions: the 14-moment approximation, first-order Chapman–Enskog expansion, and two types of modified equilibrium distributions. This makes it possible to explore to what extent heavy-ion experimental data are sensitive to different choices for δf n , presently the main source of theoretical uncertainty in the particlization stage. Here, we validate our particle sampler with a high degree of precision by generating several million hadron emission events from a longitudinally boost-invariant hypersurface and comparing the event-averaged particle spectra and space–time distributions to the Cooper–Frye formula.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

STAR Highlights

In this overview talk, I have represented STAR to highlight the results of 19 parallels talks and 38 posters at this Quark Matter Conference. Overall, the contents have 8 major categories: 1. experimental measurements related to the BreitWheeler process and vacuum birefringence; 2. probes of initial states of heavy-ion collisions (parton distribution function and azimuthal correlations in small systems); 3. constraints on temperature-dependent viscosity (η/s(T)) with multiple flow harmonics and rapidity correlations; 4. hard probes using jet structures and heavy flavors; 5. exploration of the origin of global polarization and vorticity; 6. chiral and thermal properties of the QGP; 7. Beam Energy Scan (BES) and the critical point search; 8. upgrades and summary.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Barkas effect in strongly magnetized plasmas

Strongly magnetized plasmas, which are characterized by the particle gyrofrequency exceeding the plasma frequency, exhibit novel transport properties. For example, recent work showed that the friction force on a test charge moving through a strongly magnetized plasma not only consists of the typical stopping power component but also includes components perpendicular to the test charge's velocity. However, these studies only considered test charges that have the same sign as the charge of the plasma particles. Here, we extend these calculations to the case of charges with opposite signs (such as an ion interacting with strongly magnetized electrons). This is done with both a novel generalized Boltzmann kinetic theory and molecular dynamics simulations. It is found that the friction force changes dramatically depending on the sign of the interacting charges. Likewise, the stopping power component for oppositely charged particles decreases in magnitude compared with like-charged particles, and the perpendicular components increase in magnitude. Moreover, the difference between the two cases increases as the gyrofrequency becomes larger compared with the plasma frequency. Finally, the electrical resistivity is calculated from the friction force, where it is found that strong magnetization in conjunction with oppositely charged interactions significantly decreases the parallel resistivity and increases the perpendicular resistivity.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

A numerical solver for investigating the space charge effect on the electric field in liquid argon time projection chambers

This paper reports the development of a numerical solver aimed to simulate the interaction between the space charge (i.e. ions) distribution and the electric field in liquid argon time projection chamber (LArTPC) detectors. The ion transport equation is solved by a time-accurate, cell-centered finite volume method and the electric potential equation by a continuous finite element method. The electric potential equation updates the electric field which provides the drift velocity to the ion transport equation. The ion transport equation updates the space charge density distribution which appears as the source term in the electric potential equation. The interaction between the space charge distribution and the electric field is numerically simulated within each physical time step. The convective velocity in the ion transport equation can include the background flow velocity in addition to the electric drift velocity. The numerical solver has been parallelized using the Message Passing Interface (MPI) library. Numerical tests show and verify the capability and accuracy of the current numerical solver. It is planned that the developed numerical solver, together with a Computational Fluid Dynamics (CFD) package which provides the flow velocity field, can be used to investigate the space charge effect on the electric field in large-scale particle detectors.

42 ENGINEERING↗
DOE OSTI2023

Resilient Inverter-Driven Black Start with Collective Parallel Grid-Forming Operation

As modern power systems are experiencing exceptional changes with increasing penetrations of inverter-based resources (IBRs), system restoration using IBRs has received attention. Using local grid-forming (GFM) assets near consumers, engineered to establish grid voltages in the absence of a stiff grid, i.e., bottom-up restoration, a distribution system could obtain high system resilience by not relying on the bulk power system restoration, which requires significant human intervention and procedure. This paper studies the technical feasibility of the novel approach with detailed electromagnetic transient (EMT) simulations. To thoroughly evaluate the potential of GFM inverters and the technical challenges in IBR-driven black start, a detailed three-phase inverter model is developed, including negative-sequence control for voltage balance and a phase-by- phase current limiter to sustain momentary overloading during the black start. To examine dynamic aspects of the black-start process, the EMT simulation also models transformer and motor dynamics to emulate their inrush and startup behaviors as well as network dynamics. In addition, active involvement of grid- following distributed energy resources is also studied to facilitate the black-start process. By allowing multiple GFM inverters to collectively black start without leader-follower coordination, we demonstrate that a system can achieve high resilience even with a fraction of assets lost. Two test cases of inverter-driven black start, using two and one GFM inverters, respectively, for a heavily unbalanced 2-MVA distribution feeder are demonstrated. Takeaways for further study and field deployment are provided.

grid-forming inverter↗
DOE OSTI2024

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Real-Time GPU-Accelerated OFDR With an Integrated Auxiliary Interferometer

A GPU-accelerated optical frequency domain reflectometry (OFDR) system with an improved integrated auxiliary interferometer is proposed. Unlike conventional approaches that require separate auxiliary interferometers and multiple detection channels, the proposed OFDR system embeds this functionality directly into the signal via an intentional beat component. This enables self-calibration of laser nonlinearity while maintaining a cost-effective hardware configuration. Building on this simplified configuration, the system leverages GPU acceleration with an NVIDIA RTX 4070 Ti to achieve real-time performance, delivering high-throughput signal processing for continuous OFDR interrogation. The signal processing pipeline comprises signal capture, resampling for nonlinearity compensation, and frequency shift computation, all optimized for parallel execution. Hardware benchmarking demonstrates substantial acceleration over CPU implementations, achieving up to a 45× speedup for resampling and frequency shift computations and enabling processing latencies below 30 ms. Thermal response validation is conducted under two complementary scenarios: localized heating using a water bath and cryogenic-temperature conditions using liquid nitrogen. Under localized heating, the system achieves an accuracy of 0.249 °C with a thermal sensitivity of 5.971 GHz/°C, while cryogenic-temperature validation demonstrates a frequency shift response with a sensitivity of 2.383 GHz/°C and an accuracy of 2.04 °C. The high acceleration of the proposed GPU-accelerated OFDR system and its accuracy are achieved by exploiting CUDA-based stride indexing, enabling efficient parallel segmentation and processing of large datasets without additional memory copies. The benchmarking results confirm the robustness, accuracy, and deployability of the proposed OFDR system across a wide temperature range, establishing it as a practical platform for real-time distributed fiber sensing in structurally dynamic environments.

Harb, Salah [Lawrence Berkeley National Laboratory↗
DOE OSTI2023

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Applications which fuse machine learning and simulation are rarely best served by a single computing resource. Highly parallel simulation codes are best deployed on super- computers, while AI tasks used to decide which simulations to perform may be best suited to specialized accelerators. Here we present a Function-as-a-Service (FaaS) system for executing complex, distributed computational campaigns that achieves performance parity with conventional workflow systems without the complexities of secure network connections between compute providers. One innovation enabling high performance is a subsystem that directly moves task data between sites, separate from the cloud-hosted FaaS system used to distribute task instructions. We also introduce a flexible scheduling system that allows us access factor of 2 trade offs between the amount of resources required to solve a problem at each compute site. We anticipate that this system will upgrade multi-site applications from demonstration projects to routine practice in computational science.

Ward, Logan↗
DOE OSTI2022

Resilient Inverter-Driven Black Start with Collective Parallel Grid-Forming Operation: Preprint

As the modern power systems are experiencing exceptional changes with increasing penetration of inverter-based resources (IBRs), system restoration using IBRs has received attention. Using local grid-forming (GFM) assets near consumers, engineered to establish grid voltages in the absence of a stiff grid, i.e., bottom-up restoration, a distribution system would obtain high system resilience, by not relying on the bulk power system restoration requiring significant human intervention and procedure to restore. This paper studies the technical feasibility of the novel approach with detailed electromagnetic transient (EMT) simulations. To thoroughly evaluate the potential of GFM inverters and technical challenges in IBR-driven black start, a detailed three-phase inverter model is developed, including negative-sequence control for voltage balance and a phase-by-phase current limiter to sustain momentary overloading during the black start. To examine dynamic aspects of the black start process, the EMT simulation also models transformer and motor dynamics to emulate their inrush and start-up behaviors as well as network dynamics. In addition, active involvement of grid-following distributed energy resources (DER) is also studied to facilitate the black start process. It is shown that, by allowing multiple GFM inverters to collectively black start without master-slave coordination, a system can achieve high resilience even with a fraction of assets lost. Two test cases of inverter-driven black start using two and one GFM inverters, respectively, for a heavily unbalanced 2-MVA distribution feeder are demonstrated. Takeaways for further study and field deployment are provided.

grid-forming inverter↗