Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Complex Systems Characteristics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Roadmap for the future of extreme wildfire events

Background Extreme wildfire events (EWEs) represent a growing threat globally, posing substantial risks to ecosystems, human communities, and infrastructure. Despite increased recognition of their ecological, social, and economic significance, current definitions of EWEs vary widely, reflecting disciplinary biases and regional contexts. This article emerges from an interdisciplinary workshop convened to reassess and refine the definition of EWEs, examine their impacts across ecological and social dimensions, and identify critical knowledge gaps impeding our understanding of these infrequent but important events. Results Our synthesis highlights significant limitations with existing definitions, particularly their reliance on subjective thresholds and their emphasis on extreme fire behavior alone. EWEs encompass a spectrum of complex, multi-dimensional phenomena that extend beyond immediate biophysical characteristics to include cumulative social, economic, and ecological impacts. These impacts often manifest over extended timeframes and include hazardous environmental contamination, severe geomorphic disturbances, ecosystem transformations, and unintended consequences of post-fire management actions. Current wildfire modeling frameworks inadequately capture these compounding factors, particularly the interactions among social systems, ecological conditions, and extreme fire behavior. To overcome these issues, we advocate for an interdisciplinary and context-sensitive approach to defining and studying EWEs. This revised definition emphasizes wildfires exhibiting anomalies in fire behavior, ecological outcomes, or social impacts relative to historically observed baselines, accommodating variability across different geographic regions and ecological settings. Conclusions Adopting an interdisciplinary framework that integrates biophysical and social sciences will enhance the predictive capability of wildfire models and improve resilience planning and response strategies. Filling identified knowledge gaps—such as limited high-quality empirical fire behavior data and insufficient integration of social dynamics into modeling—will better prepare communities and ecosystems to cope with and adapt to EWEs. This inclusive approach underscores the necessity for collaboration across disciplines and sectors, essential to managing extreme wildfires in an era of increasing climatic and ecological uncertainty.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Non-Hermitian quantum mechanics approach for extracting and emulating continuum physics based on bound-state-like calculations: Detailed description

Here, this work applies a reduced basis method to study the continuum physics of a finite quantum system—either few or many-body. Specifically, I develop reduced-order models, or emulators, for the underlying inhomogeneous Schrödinger equation and train the emulators against the equation's bound-state-like solutions at complex energies. The emulators rapidly and accurately interpolate and extrapolate the matrix elements of the Hamiltonian resolvent operator (Green's function) across a parameter space that includes both complex energy and other real-valued physical inputs in the Schrödinger equation. The spectra, discretized and compressed as the result of emulation, and the associated resolvent matrix elements (or amplitudes), have the defining characteristics of non-Hermitian quantum mechanics calculations, featuring complex eigenenergies with negative imaginary parts and branch cuts moved below the real axis in the complex energy plane. Therefore, one now has a method that extracts continuum physics from bound-state-like calculations and emulates those extractions in the input parameter space. Building on a prior Letter [Zhang, Phys. Rev. Lett. 135, 242501 (2025)], this article provides the full theoretical details, a comprehensive analysis of the method's performance, and a brief discussion of how it can be coupled with existing continuum approaches to perform emulations in their input parameter spaces.

ab initio calculations↗
DOE OSTI2025

Python Library for Monte Carlo Simulations with Ab Initio and Machine-Learned Interatomic Potentials

There is a growing need in the simulation community for software that provides a transparent, reproducible, usable, and extensible (TRUE) Monte Carlo (MC) simulation framework employing energies from ab initio methods and machine-learning interatomic potentials (MLIPs). We introduce a Python library (ASE-MC) that adds Monte Carlo functionality to the Atomic Simulation Environment (ASE) package. Now, we can combine the powerful tools used to build systems and perform ab initio and MLIP in ASE with MC simulation algorithms to sample the configurational space with a concise Python script. After presenting the design philosophy, we demonstrate the flexibility of our approach using selected examples. These example simulations include liquid water described with a message-passing MLIP in the canonical and isothermal–isobaric ensembles, sampling the characteristic dihedral angle of biphenyl and comparing an MLIP to first-principles calculations, and a grand canonical Monte Carlo simulation of ammonia adsorption on Pt(111). These examples showcase the main features of the software, which include flexibility in the choice of ab initio or MLIP engine, ab initio or MLIP grand canonical MC with cavity bias insertions and deletions, the ability to add custom MC moves to the move set, and how users can condense complex MC workflows into a single Python script. Finally, this library serves as a framework for reproducible Monte Carlo simulations, facilitating easy reproduction of the work and application to new systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Generative diffusion model surrogates for mechanistic agent-based biological models

Mechanistic, multicellular, agent-based models are commonly used to investigate tissue, organ, and organism-scale biology at single-cell resolution. The Cellular-Potts Model (CPM) is a powerful and popular framework for developing and interrogating these models. CPMs become computationally expensive at large space- and time- scales making application and investigation of developed models difficult. Surrogate models may allow for the accelerated evaluation of CPMs of complex biological systems. However, the stochastic nature of these models means each set of parameters may give rise to different model configurations, complicating surrogate model development. In this work, we leverage denoising diffusion probabilistic models (DDPMs) to train a generative AI surrogate of a CPM used to investigate in vitro vasculogenesis. We describe the use of an image classifier to learn the characteristics that define unique areas of a 2-dimensional parameter space. We then apply this classifier to aid in surrogate model selection and verification. Our CPM model surrogate generates model configurations 20,000 timesteps ahead of a reference configuration and demonstrates approximately a 22x reduction in computational time as compared to native code execution. Our work represents a step towards the implementation of DDPMs to develop digital twins of stochastic biological systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Tactical Analysis for Calculating Contextual Risk at Boundaries: Summary of Laboratory Directed Research & Development Effort

The Tactical Analysis for Calculating Contextual Risk at Boundaries (TACCRAB) tool is an innovative digital twin (DT) platform and automated risk algorithm designed to transform operational decision-making in structured screening environments, with an initial focus on Southern Border Land Ports of Entry (POEs). The invention provides integration points for advanced artificial intelligence, predictive modeling, and real-time data analysis to produce a comprehensive risk management tool that enables proactive, data-informed security strategies. The core inventive features of TACCRAB center on its unique risk algorithm, which dynamically calculates contextual risk by synthesizing historical data, near real-time streaming data from the checkpoints themselves, and AI-generated predictions. Unlike traditional risk assessment methods, TACCRAB utilizes a DT to provide comprehensive operational insights, allowing stakeholders to visualize, simulate, and optimize checkpoint configurations with unprecedented speed and contextual awareness. TACCRAB's key innovation lies in its ability to combine multiple complex inputs - including technology detection probabilities, resource availability, screening pathway characteristics, and threat actor behavioral patterns - into a unified risk calculation and update these inputs based on changing operational and environmental conditions. By leveraging a DT that continuously updates and learns from linked data, TACCRAB can suggest adaptive mitigation strategies that minimize risk while maintaining operational efficiency. Particularly novel is the platform's approach to decision support, which goes beyond static risk assessment. The DT provides dynamic metrics such as wait times, resource allocation effectiveness, and potential emerging threat scenarios, enabling users to view sophisticated, relevant what-if simulations and optimize checkpoint operations in near real-time. The system's architecture allows for generalized application across different screening environments, such as secure facilities, ports of entry, and soft targets, making it a versatile tool for security and operational management. The invention distinguishes itself through its comprehensive integration of predictive modeling, AI-driven pattern discovery, and user-friendly interface design. By combining these elements, TACCRAB transforms complex risk data into actionable insights, supporting decision-makers at various organizational levels - from booth agents making split-second screening decisions to checkpoint managers optimizing the day's resource allocation to strategic planners managing long-term investments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

dynamics of organic-mineral interactions at the metal oxide-solution interface as studied via binding energetics (Final report)

This project focused on addressing longstanding fundamental and experimental uncertainties on how dissolved organic substances (DOS) interact with metal oxide surface under environmentally relevant conditions. By leveraging a custom-built real-time, in-tandem flow adsorption microcalorimetry-UV-Vis/fluorescence spectroscopy platform, we characterized the binding energetics, kinetics and mechanistic pathways driving DOS-metal oxide interactions at temporal resolution on the order of 1-5 seconds. We studied a diverse suite of model organic compounds/substances – including monocarboxylates (e.g. acetate and benzoate), di-carboxylates (oxalate and succinate), amino acids, amino-based nanparticles and natural organic matter – interacting at the mineral-water interface of structurally- and/or chemically distinct metal oxides (including SiO2, boehmite, ferrihydrite, and γ-Al2O3). Our results indicated that DOS-metal oxide interactions are governed by multi-step reaction pathways, often switching between distinct, resolvable enthalpy- and entropy-driven non-electrostatic or electrostatic configurations. To quantify these interactions, we developed and implemented an analytical workflow that integrates peak deconvolution and Monte-Carlo based error propagation to determine site-specific thermodynamic and kinetic parameters for individual binding/debinding events. In addition to resolving apparent first-order rate constants of each event, we were able to quantify associated apparent equilibrium constants as well as free energy, enthalpy and entropy contribution to the activation and subsequent progression of the binding/debinding process across compounds, compound class and metal oxide surfaces. The kinetic-thermodynamic data produced in this study captured how the interplay between oxide surface reactivity and DOS molecular structure jointly drives binding-debinding dynamics. Notably, that at pH below PZC of the oxide surface, neutral species were heavily involved in monocarboxylate binding, while anionic species drove dicarboxylate binding. Also, that among amino acids 1) positional isomers show distinctive binding characteristics to each other while enantiomers show no significant differences in binding characteristics, 2) molecules that bind via outer-sphere complexation show a larger entropic shift between binding and debinding with no impact on oxide surface while 3) inner-sphere interactions increased anion exchange capacity of the oxide surface. The new insights and data from this work has great potential for improving predictive modeling of carbon dynamics and specifically organic-mineral interactions in environmental and industrial systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Crystalline Order Yet Glass-Like Heat Transport Driven by Hidden Local Distortions as the Structural Origin of Ultralow Thermal Conductivity in AgErTe 2

Given their rich chemical diversity and the interplay among the p-, d-, and f-orbitals of chalcogens, transition metals, and lanthanides, respectively, rare-earth transition-metal chalcogenides exhibit a wide variety of structural, magnetic, and transport phenomena. As a result, they form a particularly appealing platform for investigating structure–property relationships, emergent electronic and magnetic behaviors, and thermal transport. Here we investigate AgErTe 2 as a model system to understand phonon-glass behavior in ordered crystalline solids, which establishes the design principles for thermal barrier coatings and next-generation thermoelectrics. The local bonding asymmetry and lattice softness suppress the inherently low lattice thermal conductivity, resembling the characteristics of amorphous materials. This suppression is significantly influenced by local off-centering of Ag atoms, which breaks lattice periodicity while maintaining global crystallinity. The presence of antibonding states just below the Fermi level, arising from Ag 4d and Te 5p orbital interactions, leads to lattice softening and destabilizes ideal tetrahedral coordination, resulting in a pseudo Jahn–Teller distortion. Furthermore, the coexistence of weaker, more polarizable Ag–Te bonds and stronger Er–Te bonds creates a complex vibrational landscape enriched with low-frequency modes and enhanced phonon scattering. A pronounced disparity in interatomic force constants gives rise to highly localized, low-energy optical phonons linked to Ag rattling. These flat vibrational modes exhibit strong coupling with transverse acoustic phonons, resulting in ultrashort phonon lifetimes and mean free paths approaching interatomic distances. These features collectively enhance phonon scattering across a broad range of length and energy scales. This work offers a framework for engineering suppressed thermal conductivity in crystalline systems without the introduction of alloying elements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Using strong lensing to detect subhaloes with steep inner density profiles

ABSTRACT The inner region of a subhalo’s density distribution is particularly sensitive to dark matter microphysics, with alternative dark matter models leading to both cored and steeply-rising inner density profiles. This work investigates how the lensing signature and detectability of dark matter subhaloes in mock HST-, Euclid-, and JWST-like strong lensing observations depend on the subhalo’s radial density profile, especially with regards to the inner power-law slope, $\beta$. We demonstrate that the minimum subhalo mass detectable along the Einstein ring of a system is strongly dependent on $\beta$. In particular, we show that subhaloes with $\beta = 2.2$ can be detected down to masses over an order-of-magnitude lower than their Navarro–Frenk–White (NFW) counterparts with $\beta = 1$. Importantly, we find that the detectability of subhaloes with steep inner profiles is minimally affected by increasing the complexity of the main lens galaxy’s mass model. This is a notable characteristic of these subhaloes, as those with NFW or shallower profiles become essentially undetectable when multipole perturbations are added to the lens model. The results of this work highlight how the underlying dark matter physics can significantly impact the expected number of subhalo detections from strong gravitational lensing observations. This is important for testing Cold Dark Matter against alternative models, such as Self-Interacting Dark Matter, that predict a diverse range of subhalo inner density profiles.

dark matter↗
DOE OSTI2025

CHARMM-GUI Bicelle Builder : An Extension of Membrane Builder for Modeling and Simulation of Bicelle Systems

Membrane mimetics, such as detergent micelles, nanodiscs, and amphipol complexes, which can provide membrane-like environments while retaining small and soluble features, have been utilized to study membrane proteins. A bicelle, composed of varying lipids and detergents, is a useful membrane mimetic because the lipid-to-detergent ratio, the q-value, can be adjusted to alter the properties of the aggregate, including the thickness and size of the bicelle. However, building a bicelle model for modeling and simulation studies requires nontrivial efforts, even for experts. We introduce CHARMM-GUI Bicelle Builder, a web-based platform that can generate various all-atom bicelle systems via a graphical user interface with all available lipids and detergents in Membrane Builder. To illustrate and validate Bicelle Builder with practical systems, we have modeled and simulated pure bicelles consisting of 1,2-dimyristoyl-sn-glycero-3-phosphocholine (DMPC) lipids with 1,2-dihexanoyl-sn-glycero-3-phosphocholine (C6DHPC) detergents and protein–bicelle complexes, composed of DMPC with C6DHPC, foscholine-10 (FOS10), and lysophosphatidylcholine-12 (LPC12) detergents. Our simulation results indicate that Bicelle Builder can generate reliable and robust bicelle models with and without proteins that retain DMPC bilayer characteristics. Bicelle Builder is expected to help researchers better understand not only bicelles themselves but also atomistic-level structures of protein–bicelle complexes that are often difficult to access through experimental approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Progress in development of characterization capabilities to evaluate candidate materials for direct air capture applications

As part of U.S. national efforts to combat the detrimental effect of global climate change, the National Institute of Standards and Technology (NIST) was recently tasked to support efforts in direct air capture (DAC) of carbon dioxide research and deployment. In order to develop test procedures, materials, and documentary standards, key characterization methods relevant to DAC materials have been investigated and used to identify desirable properties for a potential Standard Reference Material (SRM). Select amine-supported materials that previously showed potential for DAC applications have been characterized using commonly available laboratory methods. Further insights into the adsorption characteristics have been gained from developing and applying more specialized characterization tools ideal for probing low concentrations of carbon dioxide. A broad suite of capabilities that examine relevant properties under appropriate conditions gives the most profound insights into a material's specific performance. We advocate for even more specialized capabilities to be developed and standardized to quantitatively monitor the interactions of CO 2 with molecular species in complex and often disordered systems to advance DAC and support carbon dioxide reduction (CDR) in general.

carbon dioxide↗
DOE OSTI2024

N-Doped Graphene (N-G)/MOF(ZIF-8)-Based/Derived Materials for Electrochemical Energy Applications: Synthesis, Characteristics, and Functionality

In recent years, graphene-type materials originating from metal–organic frameworks (MOFs) or integrated with MOFs have exhibited notable performances across various applications. However, a comprehensive understanding of these complex materials and their functionalities remains obscure. While some studies have reviewed graphene/MOF composites from different perspectives, due to their structural–functional intricacies, it is crucial to conduct more in-depth reviews focusing on specific sets of graphene/MOF composites designed for particular applications. In this review, we thoroughly investigate the syntheses, characteristics, and performances of N-G/MOF(ZIF-8)-based/derived materials employed in electrochemical energy conversion and storage systems. Special attention is given to realizing their fundamental functionalities. The discussions are divided into three segments based on the application of N-G/ZIF-8-based/derived materials as electrode materials for batteries, electrodes for electrochemical capacitors, and electrocatalysts. As electrodes for batteries, N-G/MOF(ZIF-8) materials can mitigate issues like an electrode volume expansion for Li-ion batteries and the ‘shuttle effect’ for Li-S batteries. As electrodes for electrochemical capacitors, these materials can considerably improve the ion transfer rate and electronic conductivity, thereby enhancing the specific capacitance while maintaining the structural stability. Also, it was observed that these materials could occasionally outperform standard platinum-based catalysts for the electrochemical oxygen reduction reaction (ORR). The reported electrochemical performances and structural parameters of these materials were carefully tabulated in uniform units and scales. Through a critical analysis of the present synthesis trends, characteristics, and functionalities of these materials, specific aspects were identified that required further exploration to fully utilize their inherent capabilities.

Electrochemistry↗
DOE OSTI2024

The XRISM/Resolve View of the Fe K Region of Cyg X-3

The X-ray binary system Cygnus X-3 (4U 2030+40, V1521 Cyg) is luminous but enigmatic owing to the high intervening absorption. High-resolution X-ray spectroscopy uniquely probes the dynamics of the photoionized gas in the system. In this Letter, we report on an observation of Cyg X-3 with the XRISM/Resolve spectrometer, which provides unprecedented spectral resolution and sensitivity in the 2–10 keV band. We detect multiple kinematic and ionization components in absorption and emission whose superposition leads to complex line profiles, including strong P Cygni profiles on resonance lines. The prominent Fe xxv Heα and Fe xxvi Lyα emission complexes are clearly resolved into their characteristic fine-structure transitions. Self-consistent photoionization modeling allows us to disentangle the absorption and emission components and measure the Doppler velocity of these components as a function of binary orbital phase. We find a significantly higher velocity amplitude for the emission lines than for the absorption lines. The absorption lines generally appear blueshifted by ∼−500–600 km s −1 . We show that the wind decomposes naturally into a relatively smooth and large-scale component, perhaps associated with the background wind itself, plus a turbulent, denser structure located close to the compact object in its orbit.

Audard, Marc (ORCID:000000034721034X)↗
DOE OSTI2025

Speciation and diffusive dynamics in hydrated grain boundaries of complex oxide Gd2Ti2O7

Abstract Grain boundaries in polycrystalline materials significantly affect their properties, such as ionic transport, corrosion, and chemical durability. The pyrochlore compound (Gd 2 Ti 2 O 7 ) is employed as a model for complex oxides and is known for its diverse applications, including nuclear waste immobilization. Density functional theory-based first-principles molecular dynamics simulations were performed at different temperatures on the hydrated grain boundary system. The results show extensive transformations within the grain boundaries among hydrous water species (OH − , H 2 O, and H 3 O + ). The temperature dependence of self-diffusion coefficients follows Arrhenius behavior, with an activation energy of 35.9 kJ/mol for hydrogen and 46.3 kJ/mol for oxygen. The lifetime of OH − is about three to four times longer than that of H 2 O at temperatures from 800 to 2100 K, suggesting the greater stability of OH − over H 2 O, a unique characteristic of the grain boundaries. The estimated lifetime of the hydrous species decreases as the temperature increases, with an activation energy of 9.9 kJ/mol for OH − and 13.4 kJ/mol for H 2 O. While Gd 3 + is more mobile than Ti 4+ , both the Gd 3 + and Ti 4+ cations are orders of magnitude less mobile than the water species. The results suggest that water species are much more mobile within grain boundaries than in the bulk crystal and have the potential to penetrate deep into polycrystalline materials through grain boundaries, leading to grain boundary degradation and dissolution. The different mobilities of cations in complex oxides can lead to leaching of certain cations and incongruent dissolution during the chemical weathering of Earth and industrial materials.

B. Ghosh, Dipta↗
DOE OSTI2026

A Unified Wireless Charger, On-Board Charger, and Auxiliary Power Module for Electric Vehicle Charging Systems

This paper proposes a unified electric vehicle (EV) charging architecture that integrates wireless power transfer (WPT), an on-board charger (OBC), and an auxiliary power module (APM) within a single architecture. By sharing a multi-functional magnetic structure and active switch bridges, the proposed topology eliminates additional transformers and converter stages, reducing hardware complexity and improving power density. A multipurpose magnetic design achieves magnetic decoupling among the WPT, OBC, and APM functions while maintaining the required coupling for each mode. Through electrical reconfiguration, the WPT operates as an LCC-S converter, whereas the OBC and APM operate as dual-active-bridge (DAB) converters. The system supports multiple operating modes, including simultaneous high-voltage and lowvoltage battery charging. Finite-element and circuit simulations verify the magnetic characteristics and system operation, demonstrating the feasibility of the proposed unified architecture for EV charging applications.

Jo, Cheolhui [ORNL] (ORCID:0000000322692434)↗
DOE OSTI2025

An Advanced Machine Learning and Artificial Intelligence System for Demonstrating Radiation Regulatory Compliance in DOE Accelerator Facilities

In this Phase II proposal, Applied Research LLC (ARLLC), Thomas Jefferson National Accelerator Facility (Jefferson Lab), and Old Dominion University (ODU) propose the combination of domain knowledge (beam characteristics, fixed structural shielding, earthen burden (the soil and foliage added to the dome of the experimental halls as additional shielding), etc.), machine learning (ML) and/or artificial intelligence (AI) to correlate a variety of multi-modal onsite signals and the radiation fields seen in accessible areas of the accelerator site and the site boundary. The ML/AI will consider the complex influence of environmental parameters affecting the radon contribution of the measurements, focusing on actual data obtained from Jefferson Lab. In Phase I, the coded beam and location data were fed into a deep learning model to predict doses at several designated locations in Jefferson Lab’s facility. Moreover, a dense radiation map was generated using only a sparse collection of the samples in a facility. In Phase II, we will develop a software prototype containing a radiation prediction algorithm, dense radiation map algorithms, and background noise prediction algorithms, with actual data used to evaluate the prototype. This work will provide a framework for evaluation of radiation measurement results around the site based on learned responses. In addition, the proposed approach allows more granular mapping of radiation levels. Better understanding and communication of these levels is related to the overall approach in keeping doses to personnel ALARA.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Assessing the behavioral realism of energy system models in light of the consumer adoption literature

Effective policymaking to achieve net zero greenhouse gas emissions demands an understanding of the complex drivers of, and barriers to, consumer adoption behavior via behaviorally realistic energy system models. Existing models tend to oversimplify by focusing on homogenized financial factors while neglecting consumer heterogeneity and non-monetary influences. This study develops and applies a comprehensive framework for evaluating the behavioral realism of consumer adoption models, informed by the adoption literature. It introduces a typology for factors influencing low-carbon technology adoption decisions: monetary and non-monetary factors relating to household characteristics, psychology, technological attributes, and contextual conditions. Next, reviews of the consumer adoption and decision-making literature identify the most influential adoption factor categories for distributed solar photovoltaics, electric vehicles, and air-source heat pumps. Finally, the extent to which a selection of energy system models accounts for these adoption factors is assessed. Existing models predominantly emphasize the economic aspects of technology, which are generally identified as the most important factors. Where the models fall short — in considering moderately important factor categories — sector-specific and agent-based models can offer more behaviorally realistic insights. This study sheds light on which types of factors are most important for consumer adoption decisions and investigates how well current models rise to the challenge of behavioral realism. The end-to-end analysis presented enables internally consistent comparisons across models and energy technologies. This research advances timely conversations on consumer adoption. It could inform more behaviorally realistic energy system modeling, and thereby more effective decarbonization policymaking.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Enabling HPC Scientific Workflows for Serverless

The convergence of edge computing, big data analytics, and AI with traditional scientific calculations is increasingly being adopted in HPC workflows. Workflow management systems are crucial for managing and orchestrating these complex computational tasks. However, it is difficult to identify patterns within the growing population of HPC workflows. Serverless has emerged as a novel computing paradigm, offering dynamic resource allocation, quick response time, fine-grained resource management and auto-scaling. In this paper, we propose a framework to enable HPC scientific workflows on serverless. Our approach integrates a widely used traditional HPC workflow generator with an HPC serverless workflow management system to create benchmark suites of scientific workflows with diverse characteristics. These workflows can be executed on different serverless platforms. We comprehensively compare executing workflows on traditional local containers and serverless computing platforms. Our results show that serverless can reduce CPU and memory usage respectively by 78.11% and 73.92% without compromising performance.

Andrei da silva, Anderson↗