Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “compute workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Asynchronous Execution of Heterogeneous Tasks in ML-Driven HPC Workflows

Heterogeneous scientific workflows consist of numerous types of tasks that require execution on heterogeneous resources. Asynchronous execution of those tasks is crucial to improve resource utilization, task throughput and reduce workflows' makespan. Therefore, middleware capable of scheduling and executing different task types across heterogeneous resources must enable asynchronous execution of tasks. In this paper, we investigate the requirements and properties of the asynchronous task execution of machine learning (ML)-driven high-performance computing (HPC) workflows. We model the degree of asynchronicity permitted for arbitrary workflows and propose key metrics that can be used to determine qualitative benefits when employing asynchronous execution. Our experiments represent relevant scientific drivers, we perform them at scale on Summit, and we show that the performance enhancements due to asynchronous execution are consistent with our model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Scaling SQL to the Supercomputer for Interactive Analysis of Simulation Data

AI and simulation workloads consume and generate large amounts of data that need to be searched, transformed and merged with other data. With the goal of treating data as a first-class citizen inside a traditionally compute-centric HPC environment, we explore how the use of accelerators and high-speed interconnects can speed up tasks which otherwise constitute bottlenecks in computational discovery workflows. BlazingSQL is SQL engine that runs natively on NVIDIA GPUs and supports internode communication for fast analytics on terabyte-scale tabular data sets. We show how a fast interconnect improves query performance if leveraged through the Unified Communication X (UCX) middleware. We envision that future computing platforms will integrate accelerated database query capabilities for immediate and interactive analysis of large simulation data.

Glaser, Jens↗
DOE OSTI2025

Machine learned potential for high-throughput phonon calculations of metal—organic frameworks

Metal–organic frameworks (MOFs) are highly porous and versatile materials studied extensively for applications such as carbon capture and water harvesting. However, computing phonon-mediated properties in MOFs, like thermal expansion and mechanical stability, remains challenging due to the large number of atoms per unit cell, making traditional Density Functional Theory (DFT) methods impractical for high-throughput screening. Recent advances in machine learning potentials have led to foundation atomistic models, such as MACE-MP-0, that accurately predict equilibrium structures but struggle with phonon properties of MOFs. In this work, we developed a workflow for computing phonons in MOFs within the quasi-harmonic approximation with a fine-tuned MACE model, MACE-MP-MOF0. The model was trained on a curated dataset of 127 representative and diverse MOFs. The fine-tuned MACE-MP-MOF0 improves the accuracy of phonon density of states and corrects the imaginary phonon modes of MACE-MP-0, enabling high-throughput phonon calculations with state-of-the-art precision. The model successfully predicts thermal expansion and bulk moduli in agreement with DFT and experimental data for several well-known MOFs. These results highlight the potential of MACE-MP-MOF0 in guiding MOF design for applications in energy storage and thermoelectrics.

Elena, Alin Marin↗
DOE OSTI2022

Illuminating Ligand Field Contributions to Molecular Qubit Spin Relaxation via T 1 Anisotropy

Electron spin relaxation in paramagnetic transition metal complexes constitutes a key limitation on the growth of molecular quantum information science. However, there exist very few experimental observables for probing spin relaxation mechanisms, leading to a proliferation of inconsistent theoretical models. Here we demonstrate that spin relaxation anisotropy in pulsed electron paramagnetic resonance is a powerful spectroscopic probe for molecular spin dynamics across a library of highly coherent Cu(II) and V(IV) complexes. Here, neither the static spin Hamiltonian anisotropy nor contemporary computational models of spin relaxation are able to account for the experimental T 1 anisotropy. Through analysis of the spin-orbit coupled wavefunctions, we derive an analytical theory for the T 1 anisotropy that accurately reproduces the average experimental anisotropy of 2.5. Furthermore, compound-by-compound deviations from the average anisotropy provide a promising approach for observing specific ligand field and vibronic excited state coupling effects on spin relaxation. Finally, we present a simple density functional theory workflow for computationally predicting T 1 anisotropy. Analysis of spin relaxation anisotropy leads to deeper fundamental understanding of spin-phonon coupling and relaxation mechanisms, promising to complement temperature-dependent relaxation rates as a key metric for understanding molecular spin qubits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Netload Range Cost Curves for Coordinated Transmission-Distribution Planning Under DER Growth Uncertainty

The increasing penetration of distributed energy resources (DERs) requires better coordination between transmission and distribution (T&D) planning to ensure system security and cost efficiency. However, misaligned planning horizons, computational burdens, and privacy concerns hinder effective coordination, leading to either underutilized resources caused by overinvestments or reliability risks due to underinvestment. To address this challenge, we introduce netload range cost curves (NRCCs), a novel approach for managing long-term DER growth uncertainty through T&D coordination, while preserving existing data-sharing and regulatory structures. NRCCs provide pairs of (i) peak substation netload guarantees and (ii) corresponding distribution upgrade options and costs, enabling their seamless integration into transmission planning workflows. To compute NRCCs efficiently, we develop a transmission-aware distribution network planning (TADNP), which is subsequently integrated to an iterative computation procedure. These NRCCs are then embedded into an NRCC-informed transmission planning model to enable resource-efficient coordination. We illustrate our proposed approach with a case study based on realistic distribution and transmission systems in the San Francisco Bay Area, California. Our results indicate the possibility of dramatic savings in transmission investments by incorporating the proposed NRCC-integrated T&D coordination framework.

Li, Yujia↗
DOE OSTI2024

ExaWorks software development kit: a robust and scalable collection of interoperable workflows technologies

Scientific discovery increasingly requires executing heterogeneous scientific workflows on high-performance computing (HPC) platforms. Heterogeneous workflows contain different types of tasks (e.g., simulation, analysis, and learning) that need to be mapped, scheduled, and launched on different computing. That requires a software stack that enables users to code their workflows and automate resource management and workflow execution. Currently, there are many workflow technologies with diverse levels of robustness and capabilities, and users face difficult choices of software that can effectively and efficiently support their use cases on HPC machines, especially when considering the latest exascale platforms. We contributed to addressing this issue by developing the ExaWorks Software Development Kit (SDK). The SDK is a curated collection of workflow technologies engineered following current best practices and specifically designed to work on HPC platforms. We present our experience with (1) curating those technologies, (2) integrating them to provide users with new capabilities, (3) developing a continuous integration platform to test the SDK on DOE HPC platforms, (4) designing a dashboard to publish the results of those tests, and (5) devising an innovative documentation platform to help users to use those technologies. Our experience details the requirements and the best practices needed to curate workflow technologies, and it also serves as a blueprint for the capabilities and services that DOE will have to offer to support a variety of scientific heterogeneous workflows on the newly available exascale HPC platforms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Understanding and Leveraging the I/O Patterns of Emerging Machine Learning Analytics

The scientific community is currently experiencing unprecedented amounts of data generated by cutting-edge science facilities. Soon facilities will be producing up to 1 PB/s which will force scientist to use more autonomous techniques to learn from the data. The adoption of machine learning methods, like deep learning techniques, in large-scale workflows comes with a shift in the workflow’s computational and I/O patterns. These changes often include iterative processes and model architecture searches, in which datasets are analyzed multiple times in different formats with different model configurations in order to find accurate, reliable and efficient learning models. This shift in behavior brings changes in I/O patterns at the application level as well at the system level. These changes also bring new challenges for the HPC I/O teams, since these patterns contain more complex I/O workloads. In this paper we discuss the I/O patterns experienced by emerging analytical codes that rely on machine learning algorithms and highlight the challenges in designing efficient I/O transfers for such workflows. We comment on how to leverage the data access patterns in order to fetch in a more efficient way the required input data in the format and order given by the needs of the application and how to optimize the data path between collaborative processes. We will motivate our work and show performance gains with a study case of medical applications.

Gainaru, Ana↗
DOE OSTI2025

Multi-scale computational screening and mechanistic insights of cyclic amines as solvents for improved lignocellulosic biomass processing

A computational screening workflow for the efficient deconstruction of cellulose, lignin and hemicellulose fractions of lignocellulosic biomass using cyclic amines as solvents. Lignocellulosic biomass is a promising feedstock for production of affordable fuels and chemicals from renewable resources. Effective solubilization and subsequent deconstruction of its cellulose, hemicellulose, and lignin fractions is essential for the viability of future biorefineries. This study used quantum chemistry-based equilibrium thermodynamics methods to evaluate the potential of 650 cyclic amines to solubilize cellulose, hemicellulose, and lignin. The activity coefficients of solvent - biopolymer interactions were predicted using the COSMO-RS (COnductor-like Screening MOdel for Real Solvents) method and used to identify cyclic amines that can efficiently dissolve and extract selective fractions of biopolymers during biomass pretreatment. Among the 650 cyclic amines, 1-piperazineethanmaine was predicted to be an effective solvent for extracting all three polymers and was experimentally shown to achieve the highest lignin removal (97.1%). Non-covalent interaction, reduced density gradient and quantum chemical calculations were performed to elucidate the dissolution mechanism of lignin, cellulose and hemicellulose and gain further molecular level insights into the interactions between the cyclic amines and biomass polymers that promote efficient solubilization and extraction. These analyses indicated that 1-piperazineethanmaine and 1-methylimidazole make noncovalent van der Waals, electrostatic interactions and hydrogen bonding with lignin, leading to enhanced lignin removal, while the strong intramolecular hydrogen bonding interactions in cellulose and hemicellulose result in weaker solvent-biopolymer interactions. Overall, the computational approach provided an efficient method for identifying cyclic amines tailored for optimal biomass pretreatment and resulted in the identification of a potential new class of solvents for effective biomass pretreatment.

Kumar, Nikhil↗
DOE OSTI2021

ExaWorks: Workflows for Exascale

Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. These software combinations and integrations, however, are difficult to achieve due to challenges of coordination and deployment of heterogeneous software components on diverse and massive platforms. We present the ExaWorks project, which can address many of these challenges: ExaWorks is leading a co-design process to create a workflow Software Development Toolkit (SDK) consisting of a wide range of workflow management tools that can be composed and interoperate through common interfaces. We describe the initial set of tools and interfaces supported by the SDK, efforts to make them easier to apply to complex science challenges, and examples of their application to exemplar cases. Furthermore, we discuss how our project is working with the workflows community, large computing facilities as well as HPC platform vendors to sustainably address the requirements of workflows at the exascale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Automated Reaction Kinetics of Gas-Phase Organic Species over Multiwell Potential Energy Surfaces

Automation of rate-coefficient calculations for gas-phase organic species became possible in recent years and has transformed how we explore these complicated systems computationally. Kinetics workflow tools bring rigor and speed and eliminate a large fraction of manual labor and related error sources. In this paper we give an overview of this quickly evolving field and illustrate, through five detailed examples, the capabilities of our own automated tool, KinBot. Here we bring examples from combustion and atmospheric chemistry of C-, H-, O-, and N-atom-containing species that are relevant to molecular weight growth and autoxidation processes. The examples shed light on the capabilities of automation and also highlight particular challenges associated with the various chemical systems that need to be addressed in future work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Evaluating the active site-substrate interplay between x-ray crystal structure and molecular dynamics in chorismate mutase

Designing realistic quantum mechanical (QM) models of enzymes is dependent on reliably discerning and modeling residues, solvents, and cofactors important in crafting the active site microenvironment. Interatomic van der Waals contacts have previously demonstrated usefulness toward designing QM-models, but their measured values (and subsequent residue importance rankings) are expected to be influenceable by subtle changes in protein structure. Using chorismate mutase as a case study, this work examines the differences in ligand-residue interatomic contacts between an x-ray crystal structure and structures from a molecular dynamics simulation. Select structures are further analyzed using symmetry adapted perturbation theory to compute ab initio ligand-residue interaction energies. The findings of this study show that ligand-residue interatomic contacts measured for an x-ray crystal structure are not predictive of active site contacts from a sampling of molecular dynamics frames. In addition, the variability in interatomic contacts among structures is not correlated with variability in interaction energies. However, the results spotlight using interaction energies to characterize and rank residue importance in future computational enzymology workflows.

Chemistry↗
DOE OSTI2023

Metagenomics harvested genus-specific single-stranded DNA-annealing proteins improve and expand recombineering in Pseudomonas species

The widespread Pseudomonas genus comprises a collection of related species with remarkable abilities to degrade plastics and polluted wastes and to produce a broad set of valuable compounds, ranging from bulk chemicals to pharmaceuticals. Pseudomonas possess characteristics of tolerance and stress resistance making them valuable hosts for industrial and environmental biotechnology. However, efficient and high-throughput genetic engineering tools have limited metabolic engineering efforts and applications. To improve their genome editing capabilities, we first employed a computational biology workflow to generate a genus-specific library of potential single-stranded DNA-annealing proteins (SSAPs). Assessment of the library was performed in different Pseudomonas using a high-throughput pooled recombinase screen followed by Oxford Nanopore NGS analysis. Among different active variants with variable levels of allelic replacement frequency (ARF), efficient SSAPs were found and characterized for mediating recombineering in the four tested species. New variants yielded higher ARFs than existing ones in Pseudomonas putida and Pseudomonas aeruginosa, and expanded the field of recombineering in Pseudomonas taiwanensisand Pseudomonas fluorescens. These findings will enhance the mutagenesis capabilities of these members of the Pseudomonas genus, increasing the possibilities for biotransformation and enhancing their potential for synthetic biology applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Core energies of dislocations in bcc metals

Accurate methods and an efficient workflow for computing and documenting dislocation core energies are developed and applied to 1 2 ( 111 ) and ( 100 ) dislocations in five body-centered cubic (bcc) metals W, Ta, V, Mo, and α -Fe represented by 13 model interatomic potentials. For each dislocation type, dislocation core energies are extracted for a large number of dislocation characters thoroughly sampling the entire 2-space of crystallographic line orientations of the bcc lattice. Of particular interest, core energies of the 1 2 ( 111 ) { 110 } dislocations are found to be distinctly asymmetric with respect to the sign of the character angle, whereas core energies of ( 100 ) { 110 } junction dislocations exhibit marked cusps for line orientations vicinal to the closed-packed ( 111 ) directions. Overall, our findings furnish substantial insights for developing accurate models of dislocation core energies employed in mesoscale dislocation dynamics simulations of crystal plasticity.

36 MATERIALS SCIENCE↗
DOE OSTI2022

NOODLES [SWR-22-78]

NOODLES is a protocol specification for collaborative visualization. It allows software tools of any type to participate in an analysis or visualization session. Use cases include, but are not limited to, distributed analysis, workflow interoperability, computational steering, etc.

Brunhart-Lupo, Nicholas↗
DOE OSTI2023

Federated IRI Science Testbed (FIRST): A Concept Note

The Department of Energy’s (DOE’s) vision for an Integrated Research Infrastructure (IRI) is to empower researchers to smoothly and securely meld the DOE’s world-class user facilities and research infrastructure in novel ways in order to radically accelerate discovery and innovation. Performant IRI arises through the continuous interoperability of research workflows with compute, storage, and networking infrastructure, fulfilling researchers’ quests to gain insight from observational and experimental data. Decades of successful research, pilot projects, and demonstrations point to the extraordinary promise of IRI but also indicate the intertwined technological, policy, and sociological hurdles it presents. Creating, developing, and stewarding the conditions for seamless interoperability of DOE research infrastructure, with clear value propositions to stakeholders to opt into an IRI ecosystem, will be the next big step. Governance, funding, and resource allocation are beyond the scope of this document: it seeks to provide a high-level view of potential benefits, focus areas, and the working groups whose formation would further define the testbed’s design, activities, and goals.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Solar Spectrum Conversion for an Algae Bioreactor (CRADA Final Report)

This project focused on developing advanced optical coatings to improve solar energy utilization. The research aimed to create lanthanide-doped upconversion nanoparticles (UCNPs) capable of capturing unused near-infrared (NIR) light from the sun and converting it into visible light (blue and red photons) that can be used for photosynthesis. The primary goal was to identify, synthesize, and integrate highly efficient UCNPs into a transparent thin-film device. Through a comprehensive workflow involving computer simulations, high-throughput robotic synthesis, and detailed optical characterization, the project successfully developed a high-performance material. The key technical achievement was the creation of a core-shell UCNP (NaYF₄:20%Yb³⁺, 2%Er³⁺ coated with a 10 nm NaYF₄ shell) that demonstrated a quantum yield of 3.2% for converting 980 nm NIR light into visible light. Transparent thin films fabricated from these nanoparticles showed excellent optical properties, confirming their potential for practical applications. This research adds to the scientific understanding of energy transfer in lanthanide materials and demonstrates a technically effective method for creating efficient light-converting coatings. The primary benefit to the public lies in the potential for these coatings to enhance the efficiency of solar-driven processes, such as boosting the growth of algae in photobioreactors for biofuel production.

14 SOLAR ENERGY↗
DOE OSTI2026

Combining Generative Modeling and Advanced Control for Building Scenario Generation

Buildings make up a large portion of energy consumption in the U.S. today. Understanding their energy consumption patterns can improve their efficiency, but requires detailed models that rely on incomplete or unknown information. Previous work has shown that artificial intelligence (AI) can be used to predict missing information and even suggest upgrades to improve building efficiency. However, building upgrades may require undesirable upfront costs. Oppositely, advanced control could improve building efficiency with negligible upfront cost. To explore the tradeoffs between these two approaches, in this work we propose a workflow to compute optimal temperature setpoint schedules to minimize energy consumption and operational cost. Results show that modifying the temperature setpoints in a building using model predictive control (MPC) can effectively reduce its energy consumption and operational cost. This optimal operation cannot fully meet a desired goal. However, we show that by considering MPC in addition to component upgrades, a desired goal can be met with significantly less upfront costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Towards an HPC Complementary Computing Facility

This Letter considers the design for computing facilities that are complementary to the leadership class High Performance Computing (HPC) facilities. This design envisions a future where funding agencies are allocating greater resources for leadership class facilities and these facilities will provide a significant part of the total compute cycles for HEP Experiments. While a leadership class facility (LCF) may provide cycles and advanced architectures, the facility does not necessarily provide all of the services needed to help HEP users make the best use of the HPC facility, as well as the services needed to provide computing for workflows that are not a good fit for the HPC facilities. This Letter outlines some of the necessary components of a facility designed to provide those services and capabilities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗