Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distribution parameters”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Fabrication of model ultrafiltration membranes with uniform, high aspect ratio pores

Here, in this manuscript, we report the facile fabrication of large-area model membranes with highly uniform and high aspect ratio pores with diameters <20 nm. These membranes are useful for fundamental investigations of separation by size exclusion in the ultrafiltration regime, where species to be separated from solution have dimensions of 1–100 nm. Such investigations require membranes with narrow pores and high aspect ratios such that the Hagen–Poiseuille equation is followed, enabling well-known models such as the hindered transport model to be evaluated and other affecting factors to be ignored. We demonstrate that the sub-20 nm pores in the membrane are of sufficiently high aspect ratio such that water flux through the membrane is consistent with the Hagen–Poiseuille equation. The fabrication relies on self-assembling block copolymers to form uniform, densely packed patterns with sub-20 nm resolution, sequential infiltration synthesis to convert the block copolymer in situ into a mask with adequate contrast to etch pores with an aspect ratio >5, and low-resolution photolithography to transfer the pattern over a large area into a silicon nitride membrane. Model membranes with narrow pore-size distribution fabricated in this way provide the means to investigate parameters that impact size-selective ultrafiltration separations such as the relationships between solute or particle size and pore size, their distributions, and rejection profiles, and, therefore, test the validity or limits of separation models.

Chen, Wen↗

Mock light-cones and theory friendly catalogues for the CANDELS survey

Here we present mock catalogues created to support the interpretation of the Cosmic Assembly Near-IR Deep Extragalactic Legacy Survey (CANDELS). We extract haloes along past light-cones from the Bolshoi Planck dissipationless N-body simulations and populate these haloes with galaxies using two different independently developed semi-analytic models of galaxy formation and the empirical model UNIVERSEMACHINE. Our mock catalogues have geometries that encompass the footprints of observations associated with the five CANDELS fields. In order to allow field-to-field variance to be explored, we have created eight realizations of each field. In this paper, we present comparisons with observable global galaxy properties, including counts in observed frame bands, luminosity functions, colour–magnitude distributions and colour–colour distributions. We additionally present comparisons with physical galaxy parameters derived from SED fitting for the CANDELS observations, such as stellar masses and star formation rates. We find relatively good agreement between the model predictions and CANDELS observations for luminosity and stellar mass functions. We find poorer agreement for colours and star formation rate distributions. All of the mock light-cones as well as curated ‘theory friendly’ versions of the observational CANDELS catalogues are made available through a web-based data hub.

79 ASTRONOMY AND ASTROPHYSICS↗

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗

Analysis of Previously Classified White Dwarf–Main-sequence Binaries Using Data from the APOGEE Survey

We present analyses of near-infrared spectroscopic data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) survey for 45 previously confirmed or candidate white dwarf–main-sequence (WDMS) binaries identified by the optical Sloan Digital Sky Survey (SDSS) and LAMOST surveys. Among these 45 systems, we classify three as having red giant primaries in the LAMOST sample and 14 as young stellar object contaminants in the photometrically identified SDSS sample. From among the subsample of 28 systems that we confirm to have MS primaries, we derive and place limits on orbital periods and velocity amplitudes for 14. Seven systems have significant velocity variations that warrant a post-common-envelope (PCE) binary classification, four of which are newly classified, three of which are newly confirmed, and five for which we can derive full orbital parameters. If confirmed, one of these newly discovered systems (2M14544500+4626456) will have the second-longest orbital period reported for a typical compact PCE WDMS binary (P = 15.1 days). In addition to the seven above, we also recover and characterize with APOGEE data the well-known PCE WDMS systems EG UMa and HZ 9. We also investigate the overall metallicity distribution of the WDMS sample, which is a parameter space not often explored for these systems. Of note, we find one system (2M14244053+4929580) to be extremely metal-poor ([Fe/H] = − 1.42) relative to the rest of the near-solar sample. Additionally, the PCE systems in our sample are found to be, on average, higher in metallicity than their wide-binary counterparts, though we caution that with this small number of systems, the sample may not be representative of the overall distribution of WDMS systems.

36 MATERIALS SCIENCE↗

Notch insensitivity in fatigue failure of chopped carbon fiber chip-reinforced composites using experimental and computational analysis

This study focuses on the notch effect on the fatigue failure of chopped carbon fiber chip-reinforced sheet molding compound (SMC) composites by using both experimental and numerical methods. The S-N diagrams of notched specimens are first obtained experimentally, which exhibit large scatter and are shown to depend on the spatial distribution of local fiber orientations. After considering the effect of this spatial distribution by adopting a new fatigue damage parameter to normalize the results, we achieve a much better correlation in the normalized S-N diagram for all the notched specimens with different hole diameters. Next, compared with the fatigue results of smooth specimens without notches, we find that SMC composites under tension-tension fatigue loading exhibit notch-insensitivity, which renders this type of composites a better candidate in joints or similar applications. Meanwhile, the fatigue failure mechanisms of notched SMC composites are explored through a microstructure characterization procedure. On this basis, a computational micromechanics model considering the notch effect and an improved multi-scale progressive damage fatigue law, calibrated by coupon-level fatigue tests of smooth SMC composites under different loading conditions, are employed to predict the fatigue behavior of notched SMC composites. We show that detailed failure processes and fatigue life of notched SMC composites can be efficiently and adequately predicted by this computational framework.

36 MATERIALS SCIENCE↗

Spatiotemporal Metabolic Network Models Reveal Complex Autotroph-Heterotroph Biofilm Interactions Governed by Photon Incidences

Autotroph-heterotroph interactions are ubiquitous in natural environment and play a key role in controlling various essential ecosystem functions, such as production and utilization of organic matter, cycling of nitrogen, sulfur, and other chemical elements. Understanding how these biofilm metabolic interactions are constrained in space and time remains challenging because fully predictive models designed for this purpose are currently limited. Toward filling this gap, here we developed community metabolic network models for two autotroph-heterotroph biofilm consortia (termed UCC-A and UCC-O), which share a suite of common heterotrophic members but have a single distinct photoautotrophic cyanobacterium (Phormidesmis priestleyi str. ANA and Phormidium sp. OSCR) that provides organic carbon and nitrogen sources to support the growth of heterotrophic partners. After determining model parameters by data fitting using the spatiotemporal distributions of microbial abundances, we comparatively analyzed the resulting biofilm models to examine any fundamental differences in microbial interactions between the two consortia under the variation of key environmental variables: CO2 and photon levels. The UCC-A model predicted generally expected responses, i.e., the autotroph population increased in response to elevated levels of CO2 and photon, followed by increase in the heterotroph population. In contrast, the UCC-O model showed somewhat complicated dynamics, e.g., higher photon incidence rates resulted in the increase in autotroph population but decrease in heterotroph population due to the lowered provision of glucose from the autotroph. A further analysis showed that species coexistence was governed by the photon incidences rather than the carbon availability for UCC-O, which was the opposite for UCC-A.

Phalak, Poonam↗

The Development of a Generalized Riser Flow Regime Map Based Upon Higher Moment and Chaotic Statistics Using Electrical Capacitance Volume Tomography (ECVT)

Dynamic analyses have been applied to the temporal signals from an Electro Capacitance Volume Tomography instrument located near mid-height on the riser of an industrial-scale cold-flow circulating fluidized bed to characterize gas-solids flow behavior in the riser. Twelve capacitance electrodes surround the cylindrical riser over a height of 1.3 m. The instrument used a neural network deconvolution algorithm to determine the spatially resolved solids fraction recorded at 52 Hz. Experiments were carried out over a range of gas and solids flows in the transport regime using a Geldart Group B bed material, high density polyethylene with mean particle size of 880 μm. The radial solids distribution was found to vary from one-time step to the next between profiles typical of laminar and turbulent flow. The duration of time spent in each of these flow profiles depended upon the operating regime – dilute, core-annular, or fast fluidized bed. The chaotic structure of the temporal data was characterized using the three conventional approaches: the first 4 moments from the distribution of signal in time, system memory parameters from the autocorrelation function and the Hurst exponent, and analysis of the correlationentropy and correlation dimension of the attractor. These signal analysis techniques were used to clearly distinguish differences between different transport operating regimes. Specifically, it was experimentally observed that a riser transitions from core annular flow profile to dilute and dense regimes via increasing the frequency of short term transients to either dilute or dense flow profiles, respectively. A regime map was generated based upon these dynamics using solids flux and gas velocity axes. Fast fluidized, core annular, and dilute each exhibited different degree of dynamic characteristics typical of fluid dominated or particle compromising behavior. It should be noted that the magnitude for the different statistics was in the same range regardless of the regime, it was the radial profile for the statistic that changed and subsequently identified that there was a change in the regime. Finally, a reduced regime map was developed consisting of plotting the gas velocity normalized by the upper transport velocity versus the solids flux normalized by the saturation carrying capacity. The use of this reduced plot allowed the data from widely different conditions to be plotted and compared on the same<p>graph. Note that in many instances, some of the statistics identified the operating point as being in one regime while others indicated that it was in another indicating a transition region between dilute or core annular regimes and between the core annular and fast fluidization regimes. This now provides a tool that can be used to optimize process performance, identify changes in operating states, or replicate process dynamics during process scaling or changing operating parameters. </p>

Breault, Ronald↗

A Statistical Framework for Evaluating Rain Microphysics in Model Simulations and Disdrometer Observations

Abstract Statistical analyses of a large disdrometer data set and a diverse set of model simulations for convection using the Regional Atmospheric Modeling System were conducted, with the mutual goal of providing insights into precipitation formation and microphysical processes. We demonstrate that a two‐moment bulk microphysical model successfully captures the dominant observed modes of variability in rainfall related to rainfall intensity and raindrop size distributions. The model reproduced the general distribution of observed precipitation groups (PGs) derived from Principal Component Analysis. The multi‐variable analysis also uncovered some shortcomings in the model as well as limitations of the disdrometer data. The model solutions were constrained in their predicted drop size distributions (DSDs) due to the fixed DSD parameters assumed in a two‐moment microphysics scheme. A case study from the Mid‐latitude Continental Clouds and Convection Experiment field project demonstrated how model results can be used to contextualize the disdrometer observations which are limited in sample size, spatial coherence, and detection of small drops and low drop concentrations. The case study also showed that the spatial patterns of the statistically derived PGs revealed by the model are consistent with the hypothesized microphysical processes that determine surface rain DSDs. This work demonstrates how leveraging the strengths of observations and models together can improve our understanding and representation of rain microphysical processes.

54 ENVIRONMENTAL SCIENCES↗

Statistics of the NiCoCr medium-entropy alloy: Novel aspects of an old puzzle

Abstract We study the K -state phenomenon in the NiCoCr medium-entropy alloy using first-principles techniques jointly with the efficient Wang–Landau Monte Carlo and simulated annealing algorithms. Our theoretical results successfully explain the existence of the peak around 940 K in the experimental specific heat curve that characterizes the K -state phenomenon and give a fine picture of its atomic origin. The peak is caused by the maximum change of the local configurations characterized by the short-range-order (SRO) parameters at that temperature. The maximum change in SRO parameters is dominated by the nearest-neighbor interactions of atoms but substantially tuned by the many-body interactions. One surprising aspect revealed by the reciprocal-space SRO parameters is that the Ni–Co pair distribution is not random even above the ordering transition temperature, dramatically different from Ni–Cr and Co–Cr, indicating the system cannot be treated as a pseudo binary alloy. This prototypical example shows the complicated nature of multicomponent alloys, different from binary alloys. Our methods can be directly used to study the important K -state phenomenon observed in a number of other composition-concentrated alloys regardless of their number of components.

Pei, Zongrui (ORCID:0000000307484629)↗

BEYONDPLANCK X. Planck Low Frequency Instrument frequency maps with sample-based error propagation

We present Planck Low Frequency Instrument (LFI) frequency sky maps derived within the BEYONDPLANCK framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical, and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples, each of which corresponds to one possible realization of the various modeled instrumental systematic corrections, including correlated noise, time-variable gain, as well as far sidelobe and bandpass corrections. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncertainties into higher-level science products, including astrophysical component maps, angular power spectra, and cosmological parameters. We show that the two dominant sources of LFI instrumental systematic uncertainties are correlated noise and gain fluctuations, and the products presented here support – for the first time – full Bayesian error propagation for these effects at full angular resolution. We compared our posterior mean maps with traditional frequency maps delivered by the Planck Collaboration, and find generally good agreement. The most important quality improvement is due to significantly lower calibration uncertainties in the new processing, as we find a fractional absolute calibration uncertainty at 70 GHz of Δg 0 /g 0 = 5 x 10 -5 , which is nominally 40 times smaller than that reported by Planck 2018. However, we also note that the original Planck 2018 estimate has a nontrivial statistical interpretation, and this further illustrates the advantage of the new framework in terms of producing self-consistent and well-defined error estimates of all involved quantities without the need of ad hoc uncertainty contributions. We describe how low-resolution data products, including dense pixel-pixel covariance matrices, may be produced from the posterior samples directly, without the need for computationally expensive analytic calculations or simulations. We conclude that posterior-based frequency map sampling provides unique capabilities in terms of low-level systematics modeling and error propagation, and may play an important role for future Cosmic Microwave Background (CMB) B-mode experiments aiming at nanokelvin precision.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurements of the thermal and ionization state of the intergalactic medium during the cosmic afternoon

We perform the first measurement of the thermal and ionization state of the intergalactic medium (IGM) across 0.9 < z < 1.5 using 301 Ly α absorption lines fitted from 12 archival Hubble Space Telescope Space Telescope Imaging Spectrograph quasar spectra. We employ the machine-learning-based inference method that uses joint Doppler parameter–column density (⁠b-N HI ⁠) distributions obtained from Ly α forest decomposition. Our results show that the Γ HI photoionization rates, ⁠, agree with recent ultraviolet background synthesis models, with log(Γ HI /s -1 ) = $-11.79^{+0.18}_{-0.15}$, $-11.98^{+0.09}_{-0.09}$⁠, and $-12.32^{+0.10}_{-0.12}$⁠, at z = 1.4, 1.2, and 1, respectively. We obtain the IGM temperature at the mean density, T 0 ⁠, and the adiabatic index, γ⁠, as [log(T 0 /K), γ] = $[4.13^{+0.12}_{-0.10}, 1.34^{+0.10}_{-0.15}]$, $[3.79^{+0.11}_{-0.11}, 1.70^{+0.09}_{-0.09}]$, and $[4.12^{+0.15}_{-0.25}, 1.34^{+0.21}_{-0.26}]$ at z = 1.4⁠, 1.2, and 1. Our measurements of T 0 at z = 1.4 and 1.2 are consistent with the trend predicted from previous z < 3 temperature measurements and theoretical expectations, where the IGM cools down after $He\tiny{II}$ reionization in the absence of any non-standard heating. However, our T 0 measurement at z = 1 unexpectedly high IGM temperature. Given the relatively large uncertainty in these measurements, where σ T$_0$ ~ 5000 K, mostly emanating from the limited size of our data set, we cannot conclude whether the IGM cools down as expected. Lastly, we generate mock data sets to test the constraining power of future measurement with larger data sets. The results demonstrate that, with redshift path-length Δz ~ 2 for each redshift bin, three times the current data set, we can constrain the T 0 of IGM within 1500 K, which would be sufficient to constrain the IGM thermal history at z < 1.5 conclusively.

79 ASTRONOMY AND ASTROPHYSICS↗

Baryon–antibaryon photoproduction cross sections off the proton

The GlueX experiment at Jefferson Lab has observed 𝑝⁢$\overline{p}$ and, for the first time, Λ$\overlineΛ$ and 𝑝$\overlineΛ$ photoproduction from a proton target at photon energies up to 11.6 GeV. The angular distributions are forward peaked for all produced pairs, consistent with Regge-like 𝑡-channel exchange. Asymmetric wide-angle antibaryon distributions show the presence of additional processes. In a phenomenological model, we find consistency with a double-𝑡-channel exchange process where antibaryons are created only at the middle vertex. The model matches all observed distributions with a small number of free parameters. In the hyperon channels, we observe a clear distinction between photoproduction of the Λ$\overlineΛ$ and 𝑝$\overlineΛ$ systems but general similarity to the 𝑝$\overline{p}$ system. We report both total cross sections and cross sections differential with respect to momentum transfer and the invariant masses of the created particle pairs. No narrow resonant structures were found in these reaction channels. The suppression of 𝑠$\overline{s}$ quark pairs relative to 𝑑$\overline{d}$ quark pairs is similar to what has been seen in other reactions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Cosmic structure strikes back: The elimination of vector-mediated nonstandard interaction models as a mechanism for sterile neutrino dark matter production

We revisit sterile neutrino production enabled by nonstandard interactions (NSIs) among active neutrinos mediated by new bosons. We focus on vector mediators, including neutrinophilic, gauged 𝐿 𝜇 −𝐿 𝜏 , and 𝐵−𝐿 realizations, that modify in-medium dispersion and scattering, thereby altering the active-sterile conversion history. Building on a novel production framework with NSI thermal potentials and collision integrals, we compute nonthermal phase-space distributions across sterile neutrino mixing and NSI parameters and map each point to an equivalent thermal warm dark matter particle mass 𝑚 th via linear theory transfer function fitting with the cosmological structure formation Boltzmann solver. This enables a direct reinterpretation of state-of-the-art structure formation limits from Milky Way satellites, strong lensing, and the Lyman-𝛼 forest. These limits, in conjunction with x-ray decay searches, as well as results from a wide variety of particle physics experiments allow for a more complete examination of these models. We find that these vector-mediated models are ruled out when the full combination of current constraints, listed above, are taken into account. NSI scalar-mediated models and models with low reheating temperatures remain viable.

cosmology↗

The Need for Nb3Sn Coated Cu Cavities for Future Accelerators

Based on current efforts in the U.S. on the novel concept of parallel-feed RF accelerator structures, and in the U.S. and abroad in producing Nb3Sn films on either Cu or bronze, we rec-ommend that the Particle Physics community foster R&D in Superconducting Nb3Sn coated Cu RF Cavities instead of costly bulk Nb. The paper includes methods to process the coated cavi-ties at temperatures consistent with Cu retaining its shape. A devoted global effort in develop-ing Cu cavity structures coated with Nb3Sn would make the ILC or Higgs factories more afforda-ble and more likely to be built. Not only do parallel-feed RF structures enable both higher ac-celerating gradients and higher efficiencies, but they would be applicable to both Cu and Nb3Sn coated Cu cells. Increased effort on these two techniques would synergize expenditures to-wards progress, which will converge on the choice of technology for the RF of an ILC or any fu-ture accelerator. The current methods of Nb3Sn coatings on Cu or bronze can be geared also towards standard cavity cells. In conclusion, the use of distributed coupling structure topology within improved performance parameters together with Nb3Sn coating technology can lead to a paradigm shift for superconducting linacs, with higher gradient, higher temperature of opera-tion, and reduced overall costs for any future collider.

43 PARTICLE ACCELERATORS↗

A New Capability of E4D For 3D Parallel Joint Inversion of DC Resistivity And Traveltime Data on Unstructured Mesh

A major challenge in interpreting geophysical data is how to derive consistent three-dimensional (3D) earth models of different physical properties from spatially and temporally limited measurements. Joint inversion with cross-gradient constraints is an approach to find such models by imposing structural similarities between different physical parameters. We have developed a parallel distributed-memory joint inversion code for direct-current (DC) resistivity and traveltime data using the cross-gradient constraint on unstructured mesh. The code utilizes existing E4D framework for parallel forward simulation, distributed storage and computation of the Jacobian matrix of forward operator, and parallel execution of matrix-vector multiplication during inversion. Besides, the joint inversion is solved by nonlinear conjugate gradient algorithm parallelized for DC resistivity and traveltime data. The joint inversion capability of E4D was tested using synthetic data from cross-borehole DC resistivity and traveltime data. The results indicate that the shape and size of the anomalies from the joint inversion are more reliable than those from separate inversions.

58 GEOSCIENCES↗

Final Cooling with Thick Wedges for a Muon Collider

A muon collider is a particle accelerator that collides muons rather than protons or electrons. An important component of such a collider is cooling, in which the emittance of the muon beam is reduced to make it suitable for use in a collider. In the last stage of this process, called final 4D cooling, emittance in the transverse axes is reduced while emittance in the longitudinal axis is allowed to grow. In previous studies, Final 4-D cooling used absorbers within very high field solenoids to cool low-momentum muons. Simulations of the systems did not reach the desired cooling design goals. In this study, we develop and optimize a different conceptual design for the final 4D cooling channel, which is based on single thick wedges. We used G4Beamline to simulate the channel and Python to generate and analyze particle distributions. We characterized the effects of various parameters on the performance of this system, including the initial emittances and Twiss parameters, the length and angle of the wedges, the length of the drift channel, and the length, frequency, gradient, and phase of the RF cavities. We optimized the design parameters of the cooling channel and produced two conceptual designs (corresponding to two possible starting points for the input beam) which achieve transverse cooling in both x and y by a factor of ≈ 3.5. These channels achieve a lower transverse and longitudinal emittance than the best design previously published.

43 PARTICLE ACCELERATORS↗

Numerical Modeling & Optimization of the iProTech Pitching Inertial Pump (PIP) Wave Energy Converter (WEC) (CRADA Final Report)

This project represents a continuation of the collaboration between iProTech and NLR to simulate, optimize and design the iProTech Pitching Inertial Pump (PIP) device. The objectives of this TEAMER project are twofold: 1. Refining the physical characteristics of the existing iProTech PIP WEC-Sim model to enhance the model’s fidelity and include controllable components. Key model enhancements target the inclusion of Coulomb friction, the introduction of a controllable bypass valve, and the replacement of traditional check valves with advanced motorized ones. 2. Exploring traditional and advanced control algorithms. From traditional methods like latching control to cutting-edge reinforcement learning (RL) algorithms, the goal is to ensure the PIP device's adaptability and optimal performance across a range of ocean conditions. NLR is tasked with augmenting the WEC-Sim model and implementing the control algorithms, culminating in performance comparison analyses. iProTech will update their existing 3D models, advise on model improvements, and determine crucial system metrics. WEC-Sim, developed in MATLAB/SIMULINK with Simscape Multibody, is the main piece of software that will be used in this project. Coupled with the MATLAB RL Toolbox, it offers a robust platform for in-depth simulation and optimization of the iProTech PIP device. Building on previous work to explore the PIP design space and optimize its geometry, mass distribution, center of gravity and other key parameters, this project aims to refine iProTech’s existing numerical models and develop effective control algorithms that can seamlessly integrate into their future hardware testing campaigns.

16 TIDAL AND WAVE POWER↗

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize multiple performance metrics, including job wait time and system throughput. Traditional heuristic-based scheduling algorithms increasingly struggle and lack the efficiency needed to meet the demands and address the complexity and scale of modern HPC systems. Consequently, recent research efforts have focused on leveraging advancements in Artificial Intelligence (AI) and Deep Learning (DL), particularly Reinforcement Learning (RL), to develop more adaptable and intelligent scheduling strategies. Previous RL-based scheduling approaches have explored a range of algorithms, from Deep Q-Networks (DQN) to Proximal Policy Optimization (PPO), and more recently, hybrid methods that integrate Graph Neural Networks (GNNs) with RL techniques. However, a common limitation across these methods is their reliance on relatively small datasets, with few methods being evaluated using large-scale, multi-million-job trace datasets representative of real-world HPC workloads. Moreover, existing RL schedulers face scalability issues due to centralized policy updates, which hinder training efficiency and performance when applied to large datasets. This study introduces a novel RL-based scheduler utilizing Decentralized Distributed Proximal Policy Optimization (DD-PPO) algorithm, which supports large-scale distributed training across multiple workers without requiring parameter synchronization at every step. By eliminating reliance on centralized updates to a shared policy, the DD-PPO scheduler enhances scalability, training efficiency, and sample utilization. Experimental validation using a large real-world dataset containing over 11.5 million job traces collected from petascale HPC systems over six years assesses the influence of dataset scale on training effectiveness and compares DD-PPO performance to traditional and advanced scheduling approaches. The experimental results demonstrate improved scheduling performance in comparison to both heuristic-based schedulers and existing RL-based scheduling algorithms.

AI↗