SEARCH · Engineering Papers

Results for “Scientific Workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Final report- UFL - RAPIDS2: A SciDAC Institute for Computer Science, Data, and Artificial Intelligence

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Exascale workflow applications and middleware: An ExaWorks retrospective

Exascale computers offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. However, these software combinations and integrations are difficult to achieve due to the challenges of coordinating and deploying heterogeneous software components on diverse and massive platforms. Here, we present the ExaWorks project, which addresses many of these challenges. We developed a workflow Software Development Toolkit (SDK), a curated collection of workflow technologies that can be composed and interoperated through a common interface, engineered following current best practices, and specifically designed to work on HPC platforms. ExaWorks also developed PSI/J, a job management abstraction API, to simplify the construction of portable software components and applications that can be used over various HPC schedulers. The PSI/J API is a minimal interface for submitting and monitoring jobs and their execution state across multiple and commonly used HPC schedulers. We also describe several leading and innovative workflow examples of ExaWorks tools used on DOE leadership platforms. Furthermore, we discuss how our project is working with the workflow community, large computing facilities, and HPC platform vendors to address the requirements of workflows sustainably at the exascale.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

A Review of Extra-Terrestrial Regolith Excavation Concepts and Prototypes

Regolith is present on many extra-terrestrial bodies, and the crushed rock material it is made of contains many of the resources that are enabling for In-Situ Resource Utilization (ISRU). When extracted these resources can be used to provide consumables such as rocket propellant, human life support, working fluids and gases for industrial processes and feedstocks for manufacturing. In addition, the regolith can also be very beneficial for construction purposes as an aggregate which can be used for construction materials and shielding for radiation protection and micrometeorite impact. Binders for regolith concrete may also be made from geopolymers that may be in the regolith. The regolith can be melted and drawn out into glass fibers and used as reinforcements in a metal, polymer, or concrete matrix. In addition, there is tremendous scientific and geological knowledge that can only be obtained by studying samples of the regolith. However, none of these valuable activities can proceed without first acquiring the regolith granular material with some type of excavation device and method. Excavation is in the critical path of many workflows that will make up the capabilities required to establish a human and robotic presence in our solar system. While scientific in-situ sampling of regolith in small quantities has been achieved since the dawn of the space age in the 1960’s, large scale excavation for mining and construction on extra-terrestrial bodies has only been contemplated for many decades in works of scientific fact and also in fictional stories, but serious development and prototyping of excavation technologies for use in reduced gravity space environments was only started in the late 1990’s.This paper will review and document the evolution of extra-terrestrial excavation concepts and prototypes based on the available literature and the personal experience of the author who has been working on regolith excavation technology development since 1998.

ISRU↗

NASA NTRSDate not supplied

A Review of Extra-Terrestrial Regolith Excavation Concepts and Prototypes

Regolith is present on many extra-terrestrial bodies, and the crushed rock material it is made of contains many of the resources that are enabling for In-Situ Resource Utilization (ISRU). When extracted, these resources can be used to provide consumables such as rocket propellant, human life support, working fluids and gases for industrial processes and feedstocks for manufacturing. In addition, the regolith can also be very beneficial for construction purposes as an aggregate which can be used for construction materials and shielding for radiation protection and micrometeorite impact. Binders for regolith concrete may also be made from geopolymers that may be in the regolith. The regolith can be melted and drawn out into glass fibers and used as reinforcements in a metal, polymer, or concrete matrix. In addition, there is tremendous scientific and geological knowledge that can only be obtained by studying samples of the regolith. However, none of these valuable activities can proceed without first acquiring the regolith granular material with some type of excavation device and method. Excavation is in the critical path of many workflows that will make up the capabilities required to establish a human and robotic presence in our solar system. While scientific in-situ sampling of regolith in small quantities has been achieved since the dawn of the space age in the 1960’s, large scale excavation for mining and construction on extra-terrestrial bodies has only been contemplated, for many decades, but serious development and prototyping of excavation technologies for use in reduced gravity space environments was only started in the late 1990’s. This paper will review and document the evolution of extra-terrestrial excavation concepts and prototypes based on the available literature and the personal experience of the author who has been working on regolith excavation technology development since 1998.

Regolith↗

NASA NTRSDate not supplied

A Review of Extra-Terrestrial Regolith Excavation Concepts and Prototype

Regolith is present on many extra-terrestrial bodies, and the crushed rock material it is made of contains many of the resources that are enabling for In-Situ Resource Utilization (ISRU). When extracted, these resources can be used to provide consumables such as rocket propellant, human life support, working fluids and gases for industrial processes and feedstocks for manufacturing. In addition, the regolith can also be very beneficial for construction purposes as an aggregate which can be used for construction materials and shielding for radiation protection and micrometeorite impact. Binders for regolith concrete may also be made from geopolymers that may be in the regolith. The regolith can be melted and drawn out into glass fibers and used as reinforcements in a metal, polymer, or concrete matrix. In addition, there is tremendous scientific and geological knowledge that can only be obtained by studying samples of the regolith. However, none of these valuable activities can proceed without first acquiring the regolith granular material with some type of excavation device and method. Excavation is in the critical path of many workflows that will make up the capabilities required to establish a human and robotic presence in our solar system. While scientific in-situ sampling of regolith in small quantities has been achieved since the dawn of the space age in the 1960’s, large scale excavation for mining and construction on extra-terrestrial bodies has only been contemplated, for many decades, but serious development and prototyping of excavation technologies for use in reduced gravity space environments was only started in the late 1990’s. This paper will review and document the evolution of extra-terrestrial excavation concepts and prototypes based on the available literature and the personal experience of the author who has been working on regolith excavation technology development since 1998.

Regolith↗

DOE OSTI2017

Integrated simulations for fusion research in the 2030's time frame (white paper outline)

This white paper presents the rationale for developing a community-wide capability for whole-device modeling, and advocates for an effort with the expectation of persistence: a long-term programmatic commitment, and support for community efforts. Statement of 2030 goal (two suggestions): (a) Robust integrated simulation tools to aid real-time experimental discharges and reactor designs by employing a hierarchy in fidelity of physics models. (b) To produce by the early 2030s a capability for validated, predictive simulation via integration of a suite of physics models from moderate through high fidelity, to understand and plan full plasma discharges, aid in data interpretation, carry out discovery science, and optimize future machine designs. We can achieve this goal via a focused effort to extend current scientific capabilities and rigorously integrate simulations of disparate physics into a comprehensive set of workflows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2026

DTLMod: A simulation framework for in situ workflow optimization

In situ processing workflows have become essential for coping with the explosion in data volume and velocity in large-scale scientific computing, providing domain scientists with early insights at runtime. Multiple frameworks implement this paradigm through a data transport layer (DTL), offering different data access modes and deployment schemes, but researchers currently lack the appropriate tools to assess design and deployment options before committing to costly real experiments. We introduce DTLMod, an open-source simulated DTL that enables performance evaluation of in situ workflow configurations at scale. Built on SimGrid, it links into any SimGrid-based simulator and is available in C++ and Python. We evaluate DTLMod along four axes: scalability (tens of thousands of simulated processes across interconnected clusters in seconds, with linear memory scaling), versatility (three implementation variants trading fidelity for speed), accuracy (simulated times faithfully reflecting real behavior), and practical utility (two use cases demonstrating evidence-based workflow design decisions).

Suter, Fred [ORNL] (ORCID:0000000319021955)↗

DOE OSTI2014

The Science DMZ: A Network Design Pattern for Data-Intensive Science

The ever-increasing scale of scientific data has become a significant challenge for researchers that rely on networks to interact with remote computing systems and transfer results to collaborators worldwide. Despite the availability of high-capacity connections, scientists struggle with inadequate cyberinfrastructure that cripples data transfer performance, and impedes scientific progress. The Science DMZ paradigm comprises a proven set of network design patterns that collectively address these problems for scientists. We explain the Science DMZ model, including network architecture, system configuration, cybersecurity, and performance tools, that creates an optimized network environment for science. We describe use cases from universities, supercomputing centers and research laboratories, highlighting the effectiveness of the Science DMZ model in diverse operational settings. In all, the Science DMZ model is a solid platform that supports any science workflow, and flexibly accommodates emerging network technologies. As a result, the Science DMZ vastly improves collaboration, accelerating scientific discovery.

Dart, Eli↗

DOE OSTI2013

The Science DMZ: A Network Design Pattern for Data-Intensive Science

42 ENGINEERING↗

DOE OSTI2017

Performance Analysis of Large Scale HPC Workflows for Earth System Models

Climate assessment reports, such as the Intergovernmental Panel on Climate Change’s 5th assesment report [IPCC AR5; IPCC et al., 2014] or the United States National Climate Assessment [U.S. Global Change Research Program, 2014], increasingly rely on many-ensemble climate projections from fully-coupled Earth system models (ESM) to asses possible future climate states. ESM participate in a large set of Coupled Model Intercomparson Projects (CMIP) to better understand their models and the climate system, so that they may provide credible climate projections. However, fully participating in these intercomparison exercises represents an extremely large computational personnel burden for modeling centers [Eyring et al., 2016, Williams et al., 2016a]. However, there has been little attention within the climate modeling community paid to the in situ performance of ESMs up until now. Recently a computational performance model intercomparison project (CPMIP) for CMIP6 has begun [Balaji et al., 2017], but there has not yet been an effort to gather, process, and analyze the historical performance data that has been saved within archived log files from previous modeling efforts, nor the development of performance analysis system capable of providing detailed statistical analyses or visualizations of this performance data. Therefore, we’ve begun a joint effort to analyze the historical and current performance data on both GFDL and OLCF modeling systems. Here, we have developed a preliminary performance analysis system to captue, analyize, and visualize end-to-end in situ performance data and applied it to NOAA/GFDL’s post-processing system. Through the course of the project a number of performance improvements have been made, with the steps necessary to handle the expected volume of data (Big Data) likely to come out of the CMIP6 exercises (TB to PB) provided. We have also begun developing a statistical workload model that will allow modeling centers to determined their expected scientific throughput in the context of expected resource (computational and personnel) availability and accounting for typical workflow disruptions. This will allow them to develop a CMIP participation strategy and maximize their level of participation in the exercises. We expect this infrastructure, and the data it produces, to ultimately allow us to identify performance issues and workflow errors that exist across Earth system modeling centers, and possibly HPC modeling centers in general. Center-independent solutions to workflow or performance issues would help alleviate the computational burden for CMIP6+ modeling projects and should realize both labor and cost savings benefits throughout the CMIP community.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Large language model-driven database for thermoelectric materials

Thermoelectric materials have the ability to convert waste heat into electricity, offering a valuable solution for energy harvesting. However, their widespread use is hindered by low conversion efficiency, the reliance on expensive rare earth elements, and the environmental and regulatory concerns associated with lead-based materials. A fast and cost-effective way to identify highly efficient thermoelectric materials is through data-driven methods. These approaches rely on robust and comprehensive datasets to train models. Although there are several databases on thermoelectric materials, there is still a need to collect and integrate experimental data from peer-reviewed research articles to capture diverse compositions and properties of materials. Here, in this work, we developed a comprehensive database of 7,123 thermoelectric compounds, containing key information such as chemical composition, structural detail, seebeck coefficient, electrical and thermal conductivity, power factor, and figure of merit (ZT). We used the GPTArticleExtractor workflow, powered by large language models (LLM), to extract and curate data automatically from the scientific literature published in Elsevier journals. This process enabled the creation of a structured database that addresses the challenges of manual data collection. The open access database could stimulate data-driven research and advance thermoelectric material analysis and discovery.

Database↗

DOE OSTI2025

CalyxFlow

CalyxFlow is a lightweight agentic artificial intelligent workflow. This workflow demonstrates the use of AI LLMs to generate modeling and simulation inputs for a scientific simulation and manage execution and analysis of a suite of simulations.

Shipman, Galen↗

DOE OSTI2024

Cryogenic EM Across Length Scales for Li Metal Anode Batteries

An interfacial understanding is necessary for developing strategies to commercialize high-energy density rechargeable lithium metal anode batteries, as currently, the lithium anode/electrolyte interface is unstable with prolonged cycling. We have used several strategies to improve the cycling performance of lithium metal anodes, including reducing the parasitic reactions between lithium metal and the electrolyte, and improving the electrodeposited lithium metal morphology. These strategies have generated unconclusive electrochemical data, that has required the need for nanoscale interfacial characterization of these solid-liquid interfaces. Our team has used the cryogenic transfer workflow developed by Leica in collaboration with cryo-SEM/FIB tools by Thermo Fisher Scientific to cross-section lithium metal anodes and intact coin cell batteries to observe the interfacial structures, lithium morphology, and failure mechanisms relative to changes in electrode contract pressure and electrolyte chemistry. Cross-sectional SEM images and EDS maps of the lithium metal anodes have provided a better understanding of the electrodeposited lithium morphology, quantity of 'dead' lithium metal, and quantity of solid electrolyte interphase material that has formed alongside the lithium metal. In understanding lithium metal battery failure at the system level, we used a cryogenic stage in a laser plasma FIB to cross-section through the coin cell's cap for imaging/mapping the entire battery stack under cryogenic conditions. The tools, methods, and results of these studies will be detailed in this presentation.

characterization↗

NASA NTRSDate not supplied

Analytical Needs in a Sample Receiving Facility: Input from the MSR Operation Definition Team

The return of scientifically selected samples from Mars would provide a rare opportunity forinvestigation with the full range of the latest technology available, but to take full advantageof this opportunity, it is important to plan ahead to ensure the pristine nature of the samplesupon arrival within the Earth environment until scientific investigations can begin.The NASA/ESA science community-driven MSR Science Planning Group – Phase 2 (MSPG2)delivered recommendations and guidance regarding curation (1) and science (2, 3) activities tobe performed on the samples under containment. High-level requirements for the infrastruc-ture were also developed by MSPG2 (4). In order to prepare infrastructure-targeted input forthe ESA and NASA facility studies planned in the 2022-2023 timeframe, the agency-led MSROperational Scenarios Definition Team (MOSDT) was assembled to conceptualize the sampleoperations that will inform future architecture teams. Emphasis was placed on the respon-sibility of MOSDT to use community-defined requirements and to represent the view of the international scientific community.All necessary and sufficient instruments and analytical needs described in MSPG2 were inte-grated in MOSDT main deliverable, the operational workflow (see Hays et al, this conference).In MSPG2, notional instruments were split between curation analytical needs, and objective-driven (time-sensitive and sterilization-sensitive) science analytical needs. In MOSDT, whilethe first phases of curation, “pre-Basic Characterization” and “Basic Characterization” wererather streamlined and separate from other analytical needs, “Preliminary Examination” and“Science” instruments were not always physically segregated. In addition to the necessary andsufficient instruments described by MSPG2, the MOSDT recommended additional supportequipment for sterilization, cleanliness and contamination monitoring.It was sometimes necessary for the MOSDT to rely on assumptions to integrate instruments inthe activity workflow. In general, the assumptions were very conservative to limit contaminationand cross-contamination risks. It is expected that future work to refine limits of contaminationwill enable optimization of instrumentation.The community was consulted during the course of the MOSDT work. This abstract’s aimis two-fold: on one hand, inform the scientific community and overall MSR stakeholders, tobring their attention on the analytical needs currently considered as necessary and sufficient;on the other hand, to solicit feedback from a larger community audience to optimize and refineanalytical needs during the next phases of MSR ground-segment preparation.Disclaimer: The decision to implement Mars Sample Return will not be finalized until NASA’scompletion of the program’s National Environmental Policy Act (NEPA) process. This docu-ment is being made available for informational purposes only.[1] Tait et al. (2021) Preliminary planning for Mars Sample Return (MSR) curation activities ina Sample Receiving Facility (SRF). Astrobiology in press, doi:10.1089/ast.2021.0105. [2] Toscaet al. (2021) Time-sensitive aspects of Mars Sample Return (MSR) science. Astrobiologyin press, doi:10.1089/ast.2021.0115. [3] Velbel et al. (2021) Planning implications relatedto sterilization-sensitive science investigations associated with Mars Sample Return (MSR).Astrobiology in press, doi:10.1089/ast.2021.0113. [4] Carrier et al. (2021) Science and curationconsiderations for the design of a Mars Sample Return (MSR) Sample Receiving Facility (SRF).Astrobiology in press, doi:10.1089/ast.2021.0110.

Mars Sample Return↗

DOE OSTI2025

Accelerating discoveries at DIII-D with the Integrated Research Infrastructure

DIII-D research is being accelerated by leveraging high performance computing (HPC) and data resources available through the National Energy Research Scientific Computing Center (NERSC) Superfacility initiative. As part of this initiative, a high-resolution, fully automated, whole discharge kinetic equilibrium reconstruction workflow was developed that runs at the NERSC for most DIII-D shots in under 20 min. This has eliminated a long-standing research barrier and opened the door to more sophisticated analyses, including plasma transport and stability. These capabilities would benefit from being automated and executed within the larger Department of Energy Advanced Scientific Computing Research program’s Integrated Research Infrastructure (IRI) framework. The goal of IRI is to empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. For transport, we are looking at producing flux matched profiles and also using particle tracing to predict fast ion heat deposition from neutral beam injection before a shot takes place. Our starting point for evaluating plasma stability focuses on the pedestal limits that must be navigated to achieve better confinement. This information is meant to help operators run more effective experiments, so it needs to be available rapidly inside the DIII-D control room. So far this has been achieved by ensuring the data is available with existing tools, but as more novel results are produced new visualization tools must be developed. In addition, all of the high-quality data we have generated has been collected into databases that can unlock even deeper insights. This has already been leveraged for model and code validation studies as well as for developing AI/ML surrogates. The workflows developed for this project are intended to serve as prototypes that can be replicated on other experiments and can be run to provide timely and essential information for ITER, as well as next stage fusion power plants.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

ChemGraph as an agentic framework for computational chemistry workflows

Atomistic simulations are essential in chemistry and materials science but remain challenging to run due to the expert knowledge required for the setup, execution, and validation stages of these calculations. We present ChemGraph, an agentic framework powered by artificial intelligence and state-of-the-art simulation tools to streamline and automate computational chemistry and materials science workflows. ChemGraph leverages graph neural network-based foundation models for accurate yet computationally efficient calculations and large language models (LLMs) for natural language understanding, task planning, and scientific reasoning to provide an intuitive and interactive interface. We evaluate ChemGraph across 13 benchmark tasks and demonstrate that smaller LLMs (GPT-4o-mini, Claude-3.5-haiku, Qwen-2.5-14B) perform well on simple workflows, while more complex tasks benefit from using larger models. Importantly, we show that decomposing complex tasks into smaller subtasks through a multi-agent framework enables GPT-4o to reach perfect accuracy and smaller LLMs to match or exceed single-agent GPT-4o's performance in these benchmarks.

Computational chemistry↗

DOE OSTI2026

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗