Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource potential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Energy, Exergy, Entropy Generation Minimization, and Exergoenvironmental Analyses of Energy Systems-A Mini-Review

Meeting the growing energy demands has become a crucial challenge, which should employ energy integration and benefit from the extraction of the maximum thermodynamic potential of the resources consumed. This brief review presents an overview of the essential elements of the methods of energy, exergy, entropy generation minimization, and exergoenvironmental analyses. In combination, these methodologies constitute a powerful toolbox for the design, analysis, and optimization of energy systems. The quantification of energy and environmental impacts provided by them is essential in guiding toward system designs that are consistent with current energy and environmental needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Strategies for Continuous Balancing in Future Power Systems with High Wind and Solar Shares

The use of wind power has grown strongly in recent years and is expected to continue to increase in the coming decades. Solar power is also expected to increase significantly. In a power system, a continuous balance is maintained between total production and demand. This balancing is currently mainly managed with conventional power plants, but with larger amounts of wind and solar power, other sources will also be needed. Interesting possibilities include continuous control of wind and solar power, battery storage, electric vehicles, hydrogen production, and other demand resources with flexibility potential. The aim of this article is to describe and compare the different challenges and future possibilities in six systems concerning how to keep a continuous balance in the future with significantly larger amounts of variable renewable power production. A realistic understanding of how these systems plan to handle continuous balancing is central to effectively develop a carbon-dioxide-free electricity system of the future. The systems included in the overview are the Nordic synchronous area, the island of Ireland, the Iberian Peninsula, Texas (ERCOT), the central European system, and Great Britain.

14 SOLAR ENERGY↗

Assessing Forest Level Response to the Death of a Dominant Tree within a Premontane Tropical Rainforest

Small-scale treefall gaps are among the most important forms of forest disturbance in tropical forests. These gaps expose surrounding trees to more light, promoting rapid growth of understory plants. However, the effects of such small-scale disturbances on the distribution of plant water use across tree canopy levels are less known. To address this, we explored plant transpiration response to the death of a large emergent tree, Mortoniodendron anisophyllum Standl. & Steyerm (DBH > 220 cm; height ~40 m). Three suppressed, four mid-story, and two subdominant trees were selected within a 50 × 44 m premontane tropical forest plot at the Texas A&M Soltis Center for Research and Education located in Costa Rica. We compared water use rates of the selected trees before (2015) and after (2019) the tree gap using thermal dissipation sap flow sensors. Hemispherical photography indicated a 40% increase in gap fraction as a result of changes in canopy structure after the treefall gap. Micrometeorological differences (e.g., air temperature, relative humidity, and vapor pressure deficit (VPD)) could not explain the observed trends. Rather, light penetration, as measured by sensors within the canopy, increased significantly in 2019. One year after the tree fell, the water usage of trees across all canopy levels increased modestly (15%). Moreover, average water usage by understory trees increased by 36%, possibly as a result of the treefall gap, exceeding even that of overstory trees. These observations suggest the possible reallocation of water use between overstory and understory trees in response to the emergent tree death. With increasing global temperatures and shifting rainfall patterns increasing the likelihood of tree mortality in tropical forests, there is a greater need to enhance our understanding of treefall disturbances that have the potential to redistribute resources within forests.

54 ENVIRONMENTAL SCIENCES↗

Integrated Biorefinery of Brewer’s Spent Grain for Second-Generation Ethanol, Mycoprotein, and Bioactive Vinasse Production

Brewer’s spent grain (BSG), the main lignocellulosic by-product of the beer industry, represents an abundant yet underutilized resource with high potential for valorization. This study presents an integrated biorefinery approach to convert BSG into second-generation (2G) ethanol, bioactive vinasse for plant growth promotion, and fungal biomass as a potential mycoprotein source. The biomass was first subjected to biological delignification using the white-rot fungus Ganoderma lucidum, after which two valorization routes were explored: (i) evaluation of the fungal biomass as a mycoprotein candidate and (ii) alcoholic fermentation for ethanol production. For the latter, three pretreatment strategies were assessed (diluted sulfuric acid and two deep eutectic solvents (DESs) based on choline chloride combined with either glycerol or lactic acid) followed by a one-pot enzymatic saccharification and fermentation using Kluyveromyces marxianus SLP1. The highest ethanol yield on substrate (YP/S) was achieved with [Ch]Cl:lactic acid pretreatment (0.46 g/g, 89.32% of theoretical). Vinasse, recovered after distillation, was characterized for organic acid content and tested on Solanum lycopersicum seed germination, showing promising biostimulant activity. Overall, this work highlights the potential of BSG as a sustainable feedstock within circular economy models, enabling the production of multiple bio-based products from a single residue.

Ganoderma lucidum↗

MSD CoP Webinar: Quantum Computing Futures through a Multisector Lens

Context: This webinar featured two presentations examining quantum computing and its complex implications across the energy, water, and materials sectors. Olivier Ezratty introduced quantum computing, its anticipated applications and added value, and the hardware required to support these systems. He also discussed their energy demands and the role of the Quantum Energy Initiative in developing an interdisciplinary research field focused on these challenges. David McCollum then explored the opportunities and multisectoral challenges associated with next-generation, quantum-accelerated data centers, including their potential energy and resource impacts and the infrastructure chokepoints that could emerge. Together, the presentations emphasized the need for long-term planning and cross-cutting research collaboration as quantum computing technologies continue to develop. Presenters: Olivier Ezratty (Quantum Energy Initiative); David McCollum (Oak Ridge National Laboratory) Moderator: Patrick M. Reed (MSD CoP Facilitation Team); Gokul Iyer (Pacific Northwest National Laboratory) This webinar was held on: July 9th, 2026 from 1:00–2:30 PM EDT.

Quantum Computing↗

Understanding Low Level Jets in the US Atlantic Offshore

Low level jets (LLJs) in the atmosphere exhibit a local windspeed maximum in the boundary layer, with positive shear beneath the jet and negative shear above the jet. Wind turbines tend to experience increased loads with varying wake recovery characteristics in the presence of an LLJ, therefore understanding the mechanism and impact of LLJs is crucial to wind energy development. The US Mid-Atlantic offshore region is a huge potential wind energy resource, yet LLJs in this area are poorly understood. In particular, the coastal offshore environment does not exhibit the same diurnal cycle that leads to strong LLJs in the well-characterized Great Plains region. In this study, we use the Weather Research and Forecasting model (WRF) plus lidar buoy data to identify case studies for LLJ events in 2020 in the New York Bight. A reduced order model is presented to explain the onset of these events based on the competing effects of baroclinicity and eddy diffusivity. Finally, using the macro-scale WRF, we drive a micro-scale large eddy simulation (LES) to generate a more detailed characterization of the Marine Boundary Layer during an LLJ. Gaining a better understanding of LLJs and their impacts on offshore wind in the mid-Atlantic is crucial for a transition toward renewable energy.

atmospheric boundary layer↗

Markets, Resources, and Environmental and Energy Justice (MarkeRs-EEJ)

This project will support the development of CO2U technologies and a CO2U industry by assessing the resource and market potential and infrastructure requirements for midterm (-2030) and long-term (-2050) deployment of CO2U technologies, as well as evaluating implications on energy justice factors such as air quality, gross domestic product (GDP), and jobs. Addressing both of these topics enables the project to provide context that can be used across a large portfolio of CO2U technologies so stakeholders can make decisions informed by both economic and societal factors.

BIOMASS FUELS↗

Investigation of Scale Deposition and Wellbore Corrosion in Carbonated Brine Injection: A Simulation Study

Carbonated brine injection (CBI), which involves dissolving CO2 in produced water to be injected into deep geologic reservoirs, is a method to manage produced brine, carbon dioxide (CO2) sequestration, and reduce anthropogenic greenhouse gas emissions. This low-risk CO2 storage strategy can leverage the existing saltwater disposal infrastructure and well resources. However, the potential for corrosion and scale deposition are a major challenge for carbonated brine which may result in subsidence, wellbore failure, casing failure, and cement failure. The main objective of this research was to evaluate the wellbore materials compatibility with carbonated brine water during the injection process, for repurposing Class II saltwater disposal wells for CBI.

Belarbi, Zineb↗

Insight into the Radiolytic Degradation Mechanism of TODGA

Partitioning and transmutation schemes, where americium is separated from other components of used nuclear fuel and burned in a fast neutron reactor, offer a path to dramatically decrease the space requirements for storage of nuclear fuel cycle wastes, allowing more efficient usage of potentially scarce storage resources.[1] Improvements in the efficiency of processes for separating americium from used nuclear fuels can thus have a significant impact on the costs of future nuclear fuel cycles. Understanding separation ligand radiation chemistry is important for development of new ligands and processes, as the ligand degradation products can have a deleterious effect on a separation process. Tetraoctyl diglycolamide (TODGA) has been studied as a ligand for lanthanide/minor actinide extraction for partitioning and transmutation schemes. However, the mechanism of initial energy transfer from products of solvent radiolysis to TODGA is still under debate. One proposed mechanism is attack by a n-dodecane radical cation resulting in electron abstraction and formation of a TODGA radical cation,[2] while later work has proposed hydrogen abstraction from sites adjacent to the central ether oxygen by other radical species.[3] The latter mechanism is proposed to result in degradation products from rupture of the ether bond. However, radiolytic degradation of TODGA in n-dodecane shows products that would result from rupture of all the backbone bonds. There is little information on what degradation products would be expected to form from the TODGA radical cation. In this work, we have begun to investigate this by examining the electron impact (EI) ionization mass spectrum of TODGA, which initially produces a TODGA radical cation in the gas phase. The EI spectrum shows fragments that would result from most backbone bond cleavages, similar to what is observed in the radiolysis of TODGA in n-dodecane. As the lifetime of the solvent radical cation decreases from n-dodecane to n-hexane,[4] irradiation of TODGA in n-hexane should have less solvent radical cations available for reaction with TODGA, and instead should favor reactions with longer-lived radicals. In contrast to n-dodecane, radiolytic degradation of TODGA in n-hexane produces only N,N-dioctylacetamide, which would result from rupture of the ether bond. The n-dodecane radical cation lifetime is long enough to produce TODGA radical cations but the n-hexane radical cation is mostly consumed before reaction with TODGA, so other radical processes that abstract hydrogen from TODGA dominate. This suggests that electron abstraction by the n-dodecane radical cation is an important component of TODGA radiolysis, although it does not rule out the presence of mechanisms involving hydrogen abstraction adjacent to the ether oxygen. References [1] J. Serp et al., Energies 2017, 10 (9), DOI: 10.3390/en10091445. [2] C. Zarzana et al., Solvent Extr. Ion Exch. 2015, 33 (5), 431–447, DOI: 10.1080/07366299.2015.1012885. [3] T. Koubský et al., Prog. Nucl. Energy 2017, 94, 208–215, DOI: 10.1016/j.pnucene.2016.07.010. [4] F. Sviridenko et al., Chem. Phys. Lett. 1998, 297 (3), 343–349, DOI: 10.1016/S0009-2614(98)01099-9.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Sustainable Aviation Fuel: Reducing Emissions from Commercial Flight

Demand for jet fuel is expected to balloon over the next three decades, which adds to the aviation industry’s challenge of meeting goals for cutting aviation greenhouse gas (GHG) emissions in half by 2050.1 Sustainable aviation fuels (SAFs) made from renewable biomass and waste resources have the potential to deliver the performance of petroleum-based jet fuel but with a fraction of its carbon footprint, giving airlines solid footing for reducing GHG emissions from flight.

09 BIOMASS FUELS↗

Community structure and function during periods of high performance and system upset in a full-scale mixed microalgal wastewater resource recovery facility

Microalgae have the potential to exceed current nutrient recovery limits from wastewater, enabling water resource recovery facilities (WRRFs) to achieve increasingly stringent effluent permits. The use of photobioreactors (PBRs) and the separation of hydraulic retention and solids residence time (HRT/SRT) further enables increased biomass in a reduced physical footprint while allowing operational parameters (e.g., SRT) to select for desired functional communities. However, as algal technology transitions to full-scale, there is a need to understand the effect of operational and environmental parameters on complex microbial dynamics among mixotrophic microalgae, bacterial groups, and pests (i.e., grazers and pathogens) and to implement robust process controls for stable long-term performance. Here, we examine a full-scale, intensive WRRF utilizing mixed microalgae for tertiary treatment in the US (EcoRecover, Clearas Water Recovery Inc.) during a nine-month monitoring campaign. We investigated the temporal variations in microbial community structure (18S and 16S rRNA genes), which revealed that stable system performance of the EcoRecover system was marked by a low-diversity microalgal community (D INVSIMPSON = 2.01) dominated by Scenedesmus sp. (MRA = 55 %-80 %) that achieved strict nutrient removal (effluent TP < 0.04 mg·L -1 ) and steady biomass concentration (TSS monthly avg . = 400–700 mg·L −1 ). Operational variables including pH, alkalinity, and influent ammonium (NH 4 + ), correlated positively (p < 0.05, method = Spearman) with algal community during stable performance. Further, the use of these parameters as operational controls along with N/P loading and SRT allowed for system recovery following upset events. Importantly, the presence or absence of bacterial nitrification did not directly impact algal system performance and overall nutrient recovery, but partial nitrification (potentially resulting from NO 2 − accumulation) inhibited algal growth and should be considered during long-term operation. The microalgal communities were also adversely affected by zooplankton grazers (ciliates, rotifers) and fungal parasites (Aphelidium), particularly during periods of upset when algal cultures were experiencing culture turnover or stress conditions (e.g., nitrogen limitation, elevated temperature). Altogether, the active management of system operation in order to maintain healthy algal cultures and high biomass productivity can result in significant periods (>4 months) of stable system performance that achieve robust nutrient recovery, even in winter months in northern latitudes (WI, USA).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Time to Use Dendrohydrological Data in Water Resources Management?

Despite a wide consensus on the potential importance of streamflow reconstructions to water resources planning and management activities, applications of dendrohydrology have been piecemeal. This review article describes barriers to widespread use of dendrohydrological data and suggests research needs for operationalizing streamflow records reconstructed from these proxy data.

42 ENGINEERING↗

New Resource Adequacy Criteria for the Energy Transition: Modernizing Reliability Requirements

The transition toward a cleaner and more weather-dependent power system brings with it unprecedented challenges and opportunities for maintaining resource adequacy—namely, a future that includes rapid load growth, plant retirements, and a shift toward variable and energy-limited resources. Resource adequacy analyses, capacity accreditation, and the resource adequacy planning criteria are becoming increasingly important for power system planning and investment decisions. While previous ESIG reports evaluated the changing resource adequacy risks and planning practices created by the energy transition, none specifically examined potential changes to the resource adequacy criterion used for planning. The resource adequacy criterion sets the level of supply- and demand-side resources that are required for a given power system to meet reliability objectives. It is a pivotal standard that influences billions of dollars of investment decisions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Geothermal Uncertainty Representation in reV: the Renewable Energy Potential Model

We present a preliminary methodology for including geothermal resource uncertainty into the Renewable Energy Potential model, which estimates potential capacity and costs on a gridded surface at the national scale. The uncertainty outputs characterize the 10th, 50th and 90th percentile for geothermal resources using two energy capacity estimation equations. We then present a method and results that demonstrate how other geologic data layers, which may be indicative of permeability, can be used to inform the mean and standard deviation of the geothermal capacity. We demonstrate how the mean and standard deviation can be defined or partially informed by using collocated regression estimates and estimate errors, respectively . These regression results are from 36 observed geothermal power plants in the Great Basin region and are also used to benchmark the P10-P90 calculations.

exclusions↗

GeoThermalCloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are exploring hidden geothermal resources in the U.S.A. and designing profitable enhanced geothermal systems (EGS). Many processes and parameters control geothermal exploration and energy production from geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize subsurface geothermal conditions. Sparse and multi-scale characteristics of these datasets prohibit properly leveraging these datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) promise to resolve these issues. The tremendous challenges and risks of geothermal exploration and production bring the demand for novel ML methods and tools that can (1) analyze large field datasets, (2) assimilate model simulations (large inputs and outputs), (3) process sparse datasets, (4) perform transfer learning (between sites with different exploratory levels), (5) extract hidden geothermal signatures in the field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. To address these necessities, ML-based geothermal resources exploration and enhanced geothermal systems (EGS) design tools have been developed. The exploration tool is called GeoThermalCloud and EGS design tool is called GeoDT-ML. GeoThermalCloud (https://github.com/SmartTensors/GeoThermalCloud.jl) utilizes a LANL unsupervised ML platform called SmartTensors (https://tensors.lanl.gov/) to automate data analyses and interpretations by extracting hidden signatures to identify geothermal prospects. Also, it enables the identification of critical measurements needed to identify geothermal resource signatures. Alternatively, GeoDT-ML (https://github.com/SmartTensors/GeoThermalCloud.jl/tree/master/EGS) is an ML-based alternative to GeoDT (https://github.com/GeoDesignTool/GeoDT.git), a fast, simplified multi-physics solver to evaluate EGS project designs in uncertain geologic systems. GeoDT-ML leverages recent advances in deep learning and high-performance computing. It is a faster and simpler version of GeoDT. To make this project a success, we used capabilities of LANL, PNNL, Google, Stanford, and Julia Computing. We analyzed eight datasets of the U.S.A. using GeothermalCloud and demonstrated potential highly prospective geothermal resources and identified key factors defining highly prospective sites. The first data set includes 44 locations in southwest New Mexico and 18 geological, hydrogeological, geophysical, geothermal, geochemical attributes. We defined low- and medium-temperature hydrothermal systems and discovered a new highly prospective site. The second data set analyzed 18 shallow water chemistry attributes at 14,342 locations in the Great Basin. It demarcated modestly, moderately, and highly prospective sites including key attributes for each type of prospectivity. The third data set analyzed Utah FORGE data including satellite (InSAR), geophysical (gravity, seismic), geochemical, and geothermal attributes. Here, we performed prospectivity analysis to identify future drilling locations using geological, geochemical, and geophysical attributes. Maps of temperature at depth and heat flow are constructed based on the available data. Prospectivity maps were generated, and drilling locations were proposed for future geothermal field exploration. The fourth data set analyzed 21 attributes at 120 locations in Tularosa Basin, New Mexico; data comes from past play fairway analyses in this region. ML analyses identified geothermal signatures associated with modestly, moderately, and highly hydrothermal systems. We also defined dominant attributes and spatial distribution of the geothermal signatures. The fifth, sixth, seventh, and eighth datasets include Tohatchi Springs, New Mexico, Hawaii, Brady site, Nevada, and EGS Collab, respectively. Moreover, we coupled GeothermalCloud and magnetotellurics data to pinpoint drilling locations for developing geothermal projects in the Tularosa Basin, New Mexico. GeothermalCloud found potential prospective locations for geothermal resources near White Sands Missile Range and McGregor Range at Fort Bliss. Magnetotellurics data determined the potential depth (~1800m) of geothermal prospects at McGregor Range based on apparent resistivity structures/layers in the subsurface. The McGregor Range consists of three resistivity layers and two resistivity structures. Magnetotellurics data also helps identify that the western portion of the McGregor Range has thick and low-resistivity earth materials. The low resistivity to the west is most likely for a fault system. Assuming temperature is consistent with a geothermal reservoir, the west-central part of the McGregor Range has the highest geothermal potential because of the increase in porosity and associated permeability attributed to the interpreted fault system. Also, we devised a coupling strategy between a process model and GeothermalCloud to characterize hydrogeological conditions and geothermal conditions, respectively. The process model characterizes hydrogeological and geothermal conditions on highly prospective geothermal sites provided by GeothermalCloud. We developed a physics-informed neural network (PINN) version of the Burns equation that can be easily coupled with GeothermalCloud. Furthermore, we performed an optimal design decision maximizing the economic value of an EGS power plant. This study optimized the range of well spacing between injection and production wells maximizing net present value in dollars (NPV). For this task, we used the GeoDT to simulate the Utah FORGE EGS development cycle from the initial well design to the end of production. Next, we accomplished another crucial task, which is predicting permeability of geothermal reservoirs. Predicting permeability of geothermal reservoirs is a non-trivial task because of huge computational runtime of simulation and lack of measurements. To avoid these limitations, we used easy-to-measure chemical concentrations in the subsurface as measurement data and convolutional neural network based ML model of a high-fidelity model. Next, we predicted permeability using Markov chain Monte Carlo simulation. We found that Markov chain Monte Carlo simulation predicts permeability with a high certainty if the prediction zone in the simulation area has chemical concentration data. Finally, we analyzed the DOE funded INGENIOUS and GeoDAWN projects data. For discovering hidden geothermal systems in the Great Basin, the INGENIOUS project accumulated old data, collected new data, and released them in 2022. The dataset includes a total of 24 geological, geophysical, and geochemical attributes. Data resolution and scale significantly vary prohibiting an appropriate usage. To avoid such limitations, we brought all data in the same resolution and scale by applying the inverse distance weighting interpolation technique for predicting data in unsampled locations. Subsequently, we analyzed LiDAR data of the GeoDAWN project. We received data in tiles format. The DOE’s overarching goal is to use ML on LiDAR data for finding favorable geological structures (e.g., step up faults in Brady, Nevada). To serve the purpose, we need to label favorable geologic structures that correspond to LiDAR data. We wrote an algorithm to label the LiDAR data with the favorable geologic structures.

15 GEOTHERMAL ENERGY↗

Enabling Scalable VQE Simulation on Leading HPC Systems

Large-scale simulations of quantum circuits pose significant challenges, especially in the context of quantum chemistry, due to the number of qubits, circuit depth, and the number of circuits needed per problem. High-performance computing (HPC) systems offer massive computational capabilities that could help overcome these obstacles. We developed a high-performance quantum circuit simulator, called NWQ-Sim, and demonstrate its capability to simulate large quantum chemistry problems on NERSC's Perlmutter supercomputer. Integrating NWQ-Sim with XACC, we have executed QPE and VQE algorithms for downfolded quantum chemistry systems at unprecedented scales. Our work demonstrates the potential of leveraging HPC resources to advance quantum chemistry and other applications of near-term quantum devices.

Wang, Meng↗

Task 12 PV Sustainability - Mineral Resource Use Footprints of Residential PV Systems

Resource use intensity is often mentioned as one of the main characteristics of PV systems and PV electricity. Recently, the International Energy Agency published a report on the role of critical minerals in clean energy transitions. The Product Environmental Footprint pilot study on PV electricity quantified (among other environmental impacts) its abiotic depletion potential. So far, a comprehensive assessment of resource use impacts highlighting the different facets of its impacts is however lacking. For the first time, the resource use impacts of PV electricity are quantified simultaneously with four impact category indicators recommended or suggested by the Life Cycle Initiative hosted at UN Environment. The indicators cover distinctly different aspects of resource use, namely resource depletion with the Abiotic Depletion Potential, ultimate reserves (ADP UR ), economic resource scarcity with the Abiotic Depletion Potential, economic reserves (ADP ER ), resource quality with the Surplus Ore Potential, Ultimate Recoverable Resources (SOP URR ) and re-source criticality with the ESSENZ method. The resource use impacts caused from the generation of 1 kWh electricity with a residential scale photovoltaic (PV) system installed in Central Europe using mono- and multi-crystalline silicon panels and CdTe panels, respectively are quantified. The product system includes manufacture, use and end of life treatment (take back and recycling) of the PV panels, cabling, inverter and supporting structure, the supply chains of the raw materials and energy used in PV panel and inverter manufacture as well as transport logistics.

14 SOLAR ENERGY↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗