Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Demystifying asynchronous I/O Interference in HPC applications

With increasing complexity of HPC workflows, data management services need to perform expensive I/O operations asynchronously in the background, aiming to overlap the I/O with the application runtime. However, this may cause interference due to competition for resources: CPU, memory/network bandwidth. The advent of multi-core architectures has exacerbated this problem, as many I/O operations are issued concurrently, thereby competing not only with the application but also among themselves. Furthermore, the interference patterns can dynamically change as a response to variations in application behavior and I/O subsystems (e.g. multiple users sharing a parallel file system). Without a thorough understanding, I/O operations may perform suboptimally, potentially even worse than in the blocking case. To fill this gap, here we investigate the causes and consequences of interference due to asynchronous I/O on HPC systems. Specifically, we focus on multi-core CPUs and memory bandwidth, isolating the interference due to each resource. Then, we perform an in-depth study to explain the interplay and contention in a variety of resource sharing scenarios such as varying priority and number of background I/O threads and different I/O strategies: sendfile, read/write, mmap/write underlining trade-offs. The insights from this study are important both to enable guided optimizations of existing background I/O, as well as to open new opportunities to design advanced asynchronous I/O strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

AI4IO: A suite of AI-based tools for IO-aware scheduling

Traditional workload managers do not have the capacity to consider how IO contention can increase job runtime and even cause entire resource allocations to be wasted. Whether from bursts of IO demand or parallel file systems (PFS) performance degradation, IO contention must be identified and addressed to ensure maximum performance. In this paper, we present AI4IO (AI for IO), a suite of tools using AI methods to prevent and mitigate performance losses due to IO contention. AI4IO enables existing workload managers to become IO-aware. Currently, AI4IO consists of two tools: PRIONN and CanarIO. PRIONN predicts IO contention and empowers schedulers to prevent it. CanarIO mitigates the impact of IO contention when it does occur. We measure the effectiveness of AI4IO when integrated into Flux, a next-generation scheduler, for both small- and large-scale IO-intensive job workloads. Our results show that integrating AI4IO into Flux improves the workload makespan up to 6.4%, which can account for more than 18,000 node-h of saved resources per week on a production cluster in our large-scale workload.

Wyatt, II, Michael R.↗
DOE OSTI2020

CephFS experiments on stria.sandia.gov

This report is an institutional record of experiments conducted to explore performance of a vendor installation of CephFS on the SNL stria cluster. Comparisons between CephFS, the Lustre parallel file system, and NFS were done using the IOR and MDTEST benchmarking tools, a test program which uses the SEACAS/Trilinos IOSS library, and the checkpointing activity performed by the LAMMPS molecular dynamics simulation.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

CephFS experiments on stria.sandia.gov

This report is an institutional record of experiments conducted to explore performance of a vendor installation of CephFS on the SNL stria cluster. Comparisons between CephFS, the Lustre parallel file system, and NFS were done using the IOR and MDTEST benchmarking tools, a test program which uses the SEACAS/Trilinos IOSS library, and the checkpointing activity performed by the LAMMPS molecular dynamics simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Position Papers for the ASCR Workshop on the Management and Storage of Scientific Data

The purpose of this workshop is to identify priority research directions in the area of data management for high-performance and scientific computing above and beyond HPC’s traditional "the parallel file system is the data-management system" model. Supporting the breadth of the DOE mission, including the explosion of AI uses and the growing needs of experimental and observational science, motivates revisiting our assumptions about data management. There are many facets of this topic to explore including: (1) Interfaces for accessing data that resides on traditional persistent storage as well as memory devices; (2) Storage-system architecture design that supports scientific workflows on varied hierarchical storage and networking devices; (3) Devising metadata management infrastructure to support FAIR principles (Findability, Accessibility, Interoperability, and Reusability); (4) Capturing provenance information about scientific data; (5) Utilizing AI to learn I/O patterns of emerging workloads for efficient data management; (6) Providing data management support for AI and complex workflows; and (7) Understanding the overlap between traditional storage systems and I/O (SSIO) efforts and data management. While the program committee has identified these topics as important areas for discussion, we welcome position papers from the community that propose additional topics of interest for discussion at the workshop. The workshop agenda will include breakout sessions for discussing these and selected topic areas to inform priority research directions for data management for high-performance and scientific computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Report for the ASCR Workshop on the Management and Storage of Scientific Data

The purpose of this workshop is to identify priority research directions in the area of data management for high-performance and scientific computing above and beyond HPC’s traditional "the parallel file system is the data-management system" model. Supporting the breadth of the DOE mission, including the explosion of AI uses and the growing needs of experimental and observational science, motivates revisiting our assumptions about data management. There are many facets of this topic to explore including: (1) Interfaces for accessing data that resides on traditional persistent storage as well as memory devices; (2) Storage-system architecture design that supports scientific workflows on varied hierarchical storage and networking devices; (3) Devising metadata management infrastructure to support FAIR principles (Findability, Accessibility, Interoperability, and Reusability); (4) Capturing provenance information about scientific data; (5) Utilizing AI to learn I/O patterns of emerging workloads for efficient data management; (6) Providing data management support for AI and complex workflows; and (7) Understanding the overlap between traditional storage systems and I/O (SSIO) efforts and data management. While the program committee has identified these topics as important areas for discussion, we welcome position papers from the community that propose additional topics of interest for discussion at the workshop. The workshop agenda will include breakout sessions for discussing these and selected topic areas to inform priority research directions for data management for high-performance and scientific computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Studies of Quark Transport and Hadronization in Nuclei

In this project, we conducted the first measurement of di‑hadron azimuthal correlations in deep inelastic scattering (DIS) off nuclei using the CLAS detector at Jefferson Lab. Using 5 GeV electron‑beam data collected on deuterium, carbon, iron, and lead targets, we extracted di‑pion correlation functions over a broad kinematic range. The results show a monotonic broadening of the correlation peak with increasing nuclear mass, along with pronounced dependencies on the pions’ kinematics. Separately, we implemented an algorithm based on the Kalman filter that achieved the first complete alignment of the CLAS12 central tracking system. In parallel, we developed simulations, algorithms, and performance studies that informed the conceptual designs of the forward hadronic calorimeter Insert and the Zero Degree Calorimeter, both of which are now included in the ePIC detector baseline for the forthcoming Electron Ion Collider.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1967

System automatically supplies precise analytical samples of high-pressure gases

High-pressure-reducing and flow-stabilization system delivers analytical gas samples from a gas supply. The system employs parallel capillary restrictors for pressure reduction and downstream throttling valves for flow control. It is used in conjunction with a sampling valve and minimizes alterations of the sampled gas.

Langdon, W. M.↗
NASA NTRS1971

Kubo conductivity of a strongly magnetized two-dimensional plasma.

The Kubo formula is used to evaluate the bulk electrical conductivity of a two-dimensional guiding-center plasma in a strong dc magnetic field. The particles interact only electrostatically. An ?anomalous' electrical conductivity is derived for this system, which parallels a recent result of Taylor and McNamara for the coefficient of spatial diffusion.

Montgomery, D.↗
NASA NTRS1972

Advanced transport structures and materials technology.

A program was undertaken regarding the economic benefits attainable through the application of advanced technologies to the next generation of long-range transport aircraft in the Mach number range from 0.85 to 1.0. In addition to airframe studies, two parallel engine systems studies contracts are also in progress. The manufacturability of composites promises structural concepts which can take forms very similar to those employed in conventional structures or forms very different from conventional approaches. It is pointed out that the findings of the studies discussed justify a considerably expanded effort not only in composite materials but also in other technologies.

Goble, R. L.↗
NASA NTRS1972

Determination of flow areas for series-parallel compartment venting to satisfy pressure differential requirements.

A unique method for solving the design problem of determining the areas required to meet an imposed pressure differential limit is presented. The associated analytical technique for determining the transient pressure differentials in a multicompartment series-parallel connected system is also presented. In an effort to verify the results obtained by using the analytical methods presented, a test was conducted using a seven compartment system. It was found in the investigations that a computer program based on the analytical model described can determine the pressure, temperature, pressure differentials, and mass flow rates into and out of each compartment at subsonic or sonic velocities.

Kirby, C. E.↗
NASA NTRS1972

Parametric analysis of RF communications and tracking systems for manned space stations

System performance, system interface compatibility, and system management and operations are analyzed for external and internal communications provided by the modular space station. Mathematical models are utilized to evaluate performances of the various communication links between the MSS and the tracking and data relay satellites, the shuttle, and the ground stations. Communication control design requirements are determined from overall MSS control design and checkout requirements are developed in a related systems study. Parallel design efforts consider equipment configurations for the external communication assembly baseband and the internal communication assembly to accommodate signal transfer and control. The recommended baseline design considers also interfaces between equipment groups and the critical functional and signal characteristics of these interfaces. The data processing assembly has direct communication circuits to the external communication assembly and the control interface is provided via a digital data bus and a remote acquisition and control unit.

Source record↗
NASA NTRS1974

Prediction of compressor stall for distorted and undistorted flow by use of a multistage compressor simulation on the digital computer

A simulation technique is presented for the prediction of compressor stall for axial-flow compressors for clean and distorted inlet flow. The simulation is implemented on the digital computer and uses stage stacking and lumped-volume gas dynamics. The resulting nonlinear differential equations are linearized about a steady-state operating point, and a Routh-Hurwitz stability test is performed on the linear system matrix. Parallel compressor theory is utilized to extend the technique to the distorted inlet flow problem. The method is applied to the eight-stage J85-13 compressor.

Daniele, C. J.↗
NASA NTRS1975

NASTRAN solutions of problems described by simultaneous parabolic differential equations

NASTRAN solution techniques are shown for a numerical analysis of a class of coupled vector flow processes described by simultaneous parabolic differential equations. To define one physical problem type where equations of this form arise, the differential equations describing the coupled transfers of heat and mass in mechanical equilibrium with negligible mass average velocity are presented and discussed. Also shown are the equations describing seepage when both electrokinetic and hydrodynamic forces occur. Based on a variational statement of the general problem type, the concepts of scalar transfer elements and parallel element systems are introduced. It is shown that adoptation of these concepts allows the direct use of NASTRAN's existing Laplace type elements for uncoupled flow (the heat transfer elements) for treating multicomponent coupled transfer. Sample problems are included which demonstrate the application of these techniques for both steady-state and transient problems.

Mason, J. B.↗