Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cluster scheduling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Efficient prediction of concentrating solar power plant productivity using data clustering

Concentrating solar power (CSP) plants convert solar energy to electricity and can be deployed with a thermal storage capability to shift electricity generation from time periods with available solar resource to those with high electricity demand or electricity price. Rigorous optimization of plant design and operational strategies can improve the market-competitiveness and commercial viability; however, such optimization may require hundreds of annual performance simulations, each of which can be computationally expensive when including considerations such as optimization of dispatch scheduling, sub-hourly time resolution, and stochastic effects due to uncertain weather or electricity price forecasts. This paper proposes a methodology to reduce the computational burden associated with simulation of electricity yield and revenue for CSP plants over a single- or multi-year period. Data-clustering techniques are employed to select a small number of limited-duration time blocks for simulation that, when appropriately weighted, can reproduce generation and revenue over a single year or within each year of a multi-year period. After selection of appropriate data features and weighting factors defining similarity between time-series profiles, the methodology captured annual revenue within 2.3%, 1.7%, or 1.2% using simulation of 10, 30, or 50 three-day exemplar time blocks, respectively, for each of three single-year location/weather/market scenarios and five plant configurations ranging from low to high solar multiple and storage capacity. When applied to multi-year datasets, the proposed methodology can capture inter-year variability that is unavailable from typical meteorological year (TMY) datasets while simultaneously requiring simulation of less than a single year of data.

14 SOLAR ENERGY↗

Profiles of upcoming HPC Applications and their Impact on Reservation Strategies

With the expected convergence between HPC, BigData and AI, new applications with different profiles are coming to HPC infrastructures. Here, we aim at better understanding the features and needs of these applications in order to be able to run them efficiently on HPC platforms. The approach followed is bottom-up: we study thoroughly an emerging application from the neuroscience community (SLANT) to understand its behavior. Based on these observations, we derive a generic, yet simple, application model (namely, a linear sequence of stochastic jobs). We expect this model to be representative for a large set of upcoming applications that require the computational power of HPC clusters without fitting the typical behavior of large-scale traditional applications. In a second step, we show how one can manipulate this generic model in a scheduling framework. Specifically we consider the problem of making reservations (both time and memory) for an execution on an HPC platform. We derive solutions using the model of the first step of this work. We experimentally show the robustness of the model, even with very few data or with another application, to generate the model, and provide performance gains with regards to standard and more recent approaches used in the neuroscience community.

97 MATHEMATICS AND COMPUTING↗

EJFAT: Towards Intelligent Compute Destination Load Balancing

To handle increased data flow, Jefferson Lab (JLab) is partnering with ESnet for development of an AI/ML directed compute work Load Balancer (LB) of UDP streamed data. The LB is FPGA based featuring dynamically configurable, low latency and high throughput destination address switching. The LB provides integration of edge and core computing to support JLab experimental programs, the Electron-Ion Collider, as well as data centers of the future. In the ESnet/JLab FPGA Accelerated Transport (EJFAT) initiative, the function of the LB Data Plane (DP) is to redirect data streams to selectable (but unknown to sender) destination hosts based on current worload and within that host to destination ports as a function of sub- stream id. This effects hierarchical scaling, first across compute machines for processing over a series of events and second, across ports so different data source sub-streams may be assigned to different processors for further parallelization. The LB Control Plane (CP) programs the DP using compute farm telemetry to direct and balance workloads across a compute cluster as the operating conditions require. While Proportional/Integrative/Derivative (PID) controllers are often seen in similar applications, here we investigate the feasibility of a Reinforcement Learning (RL) based schedule manager running in the CP to provide dynamic updates to the DP scheduling policy.

Lawrence, David↗

Spacelab 2 - A preview

The Spacelab 2 mission, which is scheduled for Space Shuttle Challenger launch in July of 1985, will carry four telescopes for solar study, a dual X-ray telescope for observation of galaxy clusters, and a helium-cooled IR telescope for studies of interstellar clouds and other extended sources. The largest cosmic ray detector carried to space thus far will also be part of the payload. Life science experiment packages will examine the vitamin D chemistry of human blood under zero-G conditions, and the manner in which pine tree seedlings sense gravity and respond to it. Spacelab 2 will carry a crew of seven, including three mission specialists and two payload specialists.

Henize, K. G.↗

New Fracture Diagnostic Tool for Unconventionals: High-Resolution Distributed Strain Sensing via Rayleigh Frequency Shift during Production in Hydraulic Fracture Test 2

Fiber Optic monitoring in unconventional reservoirs has proven to be an invaluable diagnostic tool for assessing both near-wellbore stimulation effectiveness and to help describe the far-field frac geometries created by hydraulic fracture stimulation. Unfortunately, gaining any detailed qualitative and quantitative understanding of the near-wellbore frac geometry or cluster/stage productivity during production via Fiber Optic (FO) has proven to be more difficult, particularly in wells producing liquids. A new FO diagnostic method, Distributed Strain Sensing based on Rayleigh Frequency Shift (DSS-RFS), first demonstrated for oil and gas applications in the Hydraulic Test Site 2 (HFTS2) provides new insights about the characteristics of near-wellbore-region (NWR) during production. DSS-RFS is different from other FO strain measurements because it relies on accurate measurement of frequency shifts of Rayleigh backscattered spectrum obtained by scanning the fiber with a coherent optical time-domain reflectometer with a range of laser frequencies using a tunable-wavelength laser system. Changes in strain are measured with an extremely high spatial resolution of 20 cm and with high signal-to-noise ratios over long distances. In HFTS2, strain changes for the entire wellbore have been measured twice during scheduled shut-in and reopening operations (February 2020 and September 2020). After removing temperature effects, consistent strain changes have been observed at the location of most perforation clusters. These are caused by near wellbore fracture aperture changes due to pressure increases during shut-in within the near-wellbore fracture network. The strain-change patterns from the DSS-RFS during shut-in correlate very well with the location of clusters and allow for the definition of extending intervals with positive strain signals at each cluster and slightly compressing intervals with negative strain signals between the clusters and in the non stimulated intervals. The locations of the measured positive strain peaks also show good correspondence to DAS acoustic intensity measurements acquired during the stimulation. The geometry and magnitude of the strain changes differ significantly between the two tested completion designs in the same well. During shut in and reopening each cluster exhibit its own strain-change / pressure path. In addition, the September 2020 dataset also revealed the existence of small but measurable strain changes as consequence of pressure decline during production. These strain changes also correlate well with the presence of producing clusters, but the strain-rate signals are opposite to that obtained during shut-in and reopening operations. Although Downloaded from http://onepetro.org/URTECONF/proceedings-pdf/21URTC/2-21URTC/D021S031R002/2477551/urtec-2021-5408-ms.pdf/1 by Carol Worster on 28 February 2022 URTeC 5408 2 we are still in the early stages of exploring the potential of this novel FO technique, we believe that the highly detailed information contained in the measurement of strain changes using DSS-RFS during production can significantly improve our understanding of near-wellbore hydraulic fracture characteristics and the relationships between stimulation and production from unconventional oil and gas wells.

04 OIL SHALES AND TAR SANDS↗

Investigation into the transport properties of planetary interiors through inelastic X-ray scattering experiments and quantum molecular dynamics (Final Technical Report)

This was a two-year research project for the period 08/15/2018 - 08/14/2020 conducted at the University of Nevada, Reno using Pronghorn, a newly built high-performance cluster located at the University. The short-term project goal was to provide computational support for the experimental campaigns at LCLS through data analysis of previous and upcoming scheduled experiments, along with performing state-of-the-art atomistic simulations of dense plasmas. The longer-term goal was to create a new computational high energy density physics group located at the University of Nevada, Reno. Guided by results from past and future high-resolution scattering experiments, we aimed to research and develop non-equilibrium and non-adiabatic atomistic simulations of dense plasmas that went beyond the Born-Oppenheimer approximation

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fracture Network Prediction Using Physics-based Machine Learning Algorithms

In recent years, systematic CO2 injection into geological reservoirs across the U.S. has gained traction as a strategy to mitigate greenhouse gas emissions. This approach necessitates precise monitoring to ensure secure containment, minimize risks, and optimize storage management. Our study leverages machine learning (ML) techniques to advance the understanding of CO2 injection processes, focusing on the Illinois Basin. Over a three-year injection period, we analyzed microseismic data, identifying 19 temporal intervals with significant bottom-hole pressure changes. By partitioning microseismic events into these intervals and estimating b-values, we revealed over 100 clusters of events related to fracture initiation or reactivation. Advanced spatial analysis highlighted horizontally-oriented fractures along the NNW-SSE axis. This quantification of fracture networks informs dynamic injection scheduling, work-over strategies, and risk assessments, enhancing carbon capture, utilization, and storage (CCUS) operations. Additionally, our methodology offers valuable insights for oil and gas operations and geothermal development, supporting fracture-based monitoring and risk mitigation.

Kumar, Abhash↗

Skylab 4 crew observations

Comments on food, exercise, scheduling, medical training, the effect of fluid shift, and vestibular phenomena are briefly reported. A ballistocardiographic effect of around 60 beats per minute was observed several times for the whole Skylab cluster. Also experienced were light flashes that were well correlated with the South Atlantic anomaly.

E. G. Gibson↗

Scale-free Graphs for General Aviation Flight Schedules

In the late 1990s a number of researchers noticed that networks in biology, sociology, and telecommunications exhibited similar characteristics unlike standard random networks. In particular, they found that the cummulative degree distributions of these graphs followed a power law rather than a binomial distribution and that their clustering coefficients tended to a nonzero constant as the number of nodes, n, became large rather than O(1/n). Moreover, these networks shared an important property with traditional random graphs as n becomes large the average shortest path length scales with log n. This latter property has been coined the small-world property. When taken together these three properties small-world, power law, and constant clustering coefficient describe what are now most commonly referred to as scale-free networks. Since 1997 at least six books and over 400 articles have been written about scale-free networks. In this manuscript an overview of the salient characteristics of scale-free networks. Computational experience will be provided for two mechanisms that grow (dynamic) scale-free graphs. Additional computational experience will be given for constructing (static) scale-free graphs via a tabu search optimization approach. Finally, a discussion of potential applications to general aviation networks is given.

Alexandov, Natalia M.↗

Automatic generation of efficient orderings of events for scheduling applications

In scheduling a set of tasks, it is often not known with certainty how long a given event will take. We call this duration uncertainty. Duration uncertainty is a primary obstacle to the successful completion of a schedule. If a duration of one task is longer than expected, the remaining tasks are delayed. The delay may result in the abandonment of the schedule itself, a phenomenon known as schedule breakage. One response to schedule breakage is on-line, dynamic rescheduling. A more recent alternative is called proactive rescheduling. This method uses statistical data about the durations of events in order to anticipate the locations in the schedule where breakage is likely prior to the execution of the schedule. It generates alternative schedules at such sensitive points, which can be then applied by the scheduler at execution time, without the delay incurred by dynamic rescheduling. This paper proposes a technique for making proactive error management more effective. The technique is based on applying a similarity-based method of clustering to the problem of identifying similar events in a set of events.

Morris, Robert A.↗

Electric vehicle supply equipment location and capacity allocation for fixed-route networks

Electric vehicle (EV) supply equipment location and allocation (EVSELCA) problems for freight vehicles are becoming more important because of the trending electrification shift. Some previous works address EV charger location and vehicle routing problems simultaneously by generating vehicle routes from scratch. Although such routes can be efficient, introducing new routes may violate practical constraints, such as drive schedules, and satisfying electrification requirements can require dramatically altering existing routes. To address the challenges in the prevailing adoption scheme, we approach the problem from a fixed -route perspective. We develop a mixed -integer linear program, a clustering approach, and a metaheuristic solution method using a genetic algorithm (GA) to solve the EVSELCA problem. The clustering approach simplifies the problem by grouping customers into clusters, while the GA generates solutions that are shown to be nearly optimal for small problem cases. A case study examines how charger costs, energy costs, the value of time (VOT), and battery capacity impact the cost of the EVSELCA. Charger equipment costs were found to be the most significant component in the objective function, leading to a substantial reduction in cost when decreased. VOT costs exhibited a significant decrease with rising energy costs. Further, an increase in VOT resulted in a notable rise in the number of fast chargers. Longer EV ranges decrease total costs up to a certain point, beyond which the decrease in total costs is negligible.

33 ADVANCED PROPULSION SYSTEMS↗

Elastic distributed training with fast convergence and efficient resource utilization

Distributed learning is now routinely conducted on cloud as well as dedicated clusters. Training with elastic resources brings new challenges and design choices. Prior studies focus on runtime performance and assume a static algorithmic behavior. In this work, by analyzing the impact of of resource scaling on convergence, we introduce schedules for synchronous stochastic gradient descent that proactively adapt the number of learners to reduce training time and improve convergence. Our approach no longer assumes a constant number of processors throughout training. In our experiment, distributed stochastic gradient descent with dynamic schedules and reduction momentum achieves better convergence and significant speedups over prior static ones. Numerous distributed training jobs running on cloud may benefit from our approach.

Cong, Guojing↗

The COSPIX Mission: Focusing on the Energetic and Obscured Universe

Tracing the formation and evolution of all supermassive black holes, including the obscured ones, understanding how black holes influence their surroundings and how matter behaves under extreme conditions, are recognized as key science objectives to be addressed by the next generation of instruments. These are the main goals of the COSPIX proposal, made to ESA in December 2010 in the context of its call for selection of the M3 mission. In addition, COSPIX, will also provide key measurements on the non thermal Universe, particularly in relation to the question of the acceleration of particles, as well as on many other fundamental questions as for example the energetic particle content of clusters of galaxies. COSPIX is proposed as an observatory operating from 0.3 to more than 100 keV. The payload features a single long focal length focusing telescope offering an effective area close to ten times larger than any scheduled focusing mission at 30 keV, an angular resolution better than 20 arcseconds in hard X-rays, and polarimetric capabilities within the same focal plane instrumentation. In this paper, we describe the science objectives of the mission, its baseline design, and its performances, as proposed to ESA.

Ferrando, P.↗

ATS-6 - Satellite Instructional Television Experiment

The Satellite Instructional Television Experiment (SITE) is scheduled for the second year of satellite operation. Applications Technology Satellite (ATS-6) will receive C-band video signals from Ahmedabad and Delhi, India, and will retransmitt the video and two audio subcarriers at 860 MHz to 6 clusters of 400 direct-receive stations for a total of 2400 direct-receive stations. Morning programs of 1.5 hours per day are designed for classroom use, and evening programs of 2.5 hours duration are designed for village adult education. Indian production antennas and television sets have been tested and found to meet specifications, and a successful experiment is anticipated.

Miller, J. E.↗

Applications of artificial intelligence 1993: Knowledge-based systems in aerospace and industry; Proceedings of the Meeting, Orlando, FL, Apr. 13-15, 1993

The present volume on applications of artificial intelligence with regard to knowledge-based systems in aerospace and industry discusses machine learning and clustering, expert systems and optimization techniques, monitoring and diagnosis, and automated design and expert systems. Attention is given to the integration of AI reasoning systems and hardware description languages, care-based reasoning, knowledge, retrieval, and training systems, and scheduling and planning. Topics addressed include the preprocessing of remotely sensed data for efficient analysis and classification, autonomous agents as air combat simulation adversaries, intelligent data presentation for real-time spacecraft monitoring, and an integrated reasoner for diagnosis in satellite control. Also discussed are a knowledge-based system for the design of heat exchangers, reuse of design information for model-based diagnosis, automatic compilation of expert systems, and a case-based approach to handling aircraft malfunctions.

Fayyad, Usama M.↗

AI4IO: A suite of AI-based tools for IO-aware scheduling

Traditional workload managers do not have the capacity to consider how IO contention can increase job runtime and even cause entire resource allocations to be wasted. Whether from bursts of IO demand or parallel file systems (PFS) performance degradation, IO contention must be identified and addressed to ensure maximum performance. In this paper, we present AI4IO (AI for IO), a suite of tools using AI methods to prevent and mitigate performance losses due to IO contention. AI4IO enables existing workload managers to become IO-aware. Currently, AI4IO consists of two tools: PRIONN and CanarIO. PRIONN predicts IO contention and empowers schedulers to prevent it. CanarIO mitigates the impact of IO contention when it does occur. We measure the effectiveness of AI4IO when integrated into Flux, a next-generation scheduler, for both small- and large-scale IO-intensive job workloads. Our results show that integrating AI4IO into Flux improves the workload makespan up to 6.4%, which can account for more than 18,000 node-h of saved resources per week on a production cluster in our large-scale workload.

Wyatt, II, Michael R.↗

EVA crew workstation provisions for Skylab and Space Shuttle missions

A synopsis of scheduled extravehicular activities (EVA) for a nominal Skylab mission is presented with an overview of EV workstation equipment developed for the program. Also included are the unprogrammed extravehicular activities and supporting equipment that was quickly developed and retrofitted in a series of successful operations to salvage the crippled Skylab Cluster during the Skylab 1 Mission. Because EVA appears to be a requirement for the Space Shuttle Program, candidate EV workstations are discussed in terms of effective and economical Shuttle payload servicing and maintenance. Several such concepts, which could provide a versatile, portable EV support system, are presented.

Brown, N. E.↗

From Paper to Production to Test: An Update on NASA's J-2X Engine for Exploration

The NASA/industry team responsible for developing the J-2X upper stage engine for the Space Launch System (SLS) Program has made significant progress toward moving beyond the design phase and into production, assembly, and test of development hardware. The J-2X engine exemplifies the SLS Program goal of using proven technology and experience from more than 50 years of United States spaceflight experience combined with modern manufacturing processes and approaches. It will power the second stage of the fully evolved SLS Program launch vehicle that will enable a return to human exploration of space beyond low earth orbit. Pratt & Whitney Rocketdyne (PWR) is under contract to develop and produce the engine, leveraging its flight-proven LH2/LOX, gas generator cycle J-2 and RS-68 engine capabilities, recent experience with the X-33 aerospike XRS-2200 engine, and development knowledge of the J-2S tap-off cycle engine. The J- 2X employs a gas generator operating cycle designed to produce 294,000 pounds of vacuum thrust in primary operating mode with its full nozzle extension. With a truncated nozzle extension suitable to support engine clustering on the stage, the nominal vacuum thrust level in primary mode is 285,000 pounds. It also has a secondary mode, during which it operates at 80 percent thrust by altering its mixture ratio. The J-2X development philosophy is based on proven hardware, an aggressive development schedule, and early risk reduction. NASA Marshall Space Flight Center (MSFC) and PWR began development of the J-2X in June 2006. The government/industry team of more than 600 people within NASA and PWR successfully completed the Critical Design Review (CDR) in November 2008, following extensive risk mitigation testing. Assembly of the first development engine was completed in May 2011 and the first engine test was conducted at the NASA Stennis Space Center (SSC), test stand A2, on 14 July 2011. Testing of the first development engine will continue through the autumn of 2011, be paused for test stand modifications to the passive diffuser, and then restart in the spring of 2012. This testing will be followed by specialized powerpack testing intended to examine the design and operating margins of the engine turbomachinery. The development plan beyond this point leads through more system-level, engine testing of several samples, analytical model validation activities, functional and performance verification, and then ultimate certification to support human spaceflight. This paper will discuss the J-2X development background, provide top-level information on design and development planning, and will explore some of the development challenges and mitigation activities pursued to date.

Kynard, Michael↗