Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Jobs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Customs: Inspect and Report Python Imports (customs) v1.0.0

We have developed a simple, minimally invasive monitoring framework that enables us to capture key metrics from Python user processes. This is part of a larger effort to collect data across our entire data-intensive science workload at NERSC. The approach for Python is inspired by a similar framework developed for Blue Waters at NCSA. Both frameworks leverage standard Python features, sitecustomize and atexit, to capture Python imports of interest and other job data. The customs package decomposes the information capture into separate inspection and reporting interfaces.

Thomas, Rollin↗
DOE OSTI2021

Multiscale Machine-Learned Modeling Infrastructure RAS

MuMMI RAS is the application component of the Multiscale Machine-Learned Modeling Infrastructure (MuMMI). It simulates RAS protein interactions at three scales of resolution coupled with ML-based selection and in-situ feedback. MuMMI RAS is particularly configured for massive scale, running thousands of simultaneous jobs with several terabytes of data on Lassen and Summit.

Moon, JosephY.↗
DOE OSTI2021

Clippy

Clippy (CLI + PYthon) is a Python language interface to HPC resources. Precompiled binaries that execute on HPC systems are exposed as methods to a dynamically-created Clippy Python object, where they present a familiar interface to researchers, data scientists, and others. Clippy allows these users to interact with HPC resources in an easy, straightforward environment - at the REPL, for example, or within a notebook - without the need to learn complex HPC behavior and arcane job submission commands.

Bromberger, SethA.↗
DOE OSTI2022

LLNL/cyme-launcher

Utility to help run CYME in an HPC environment. Ensures sufficient licenses are available for running CYME in as part of a batch job, and helps start CYME running under WINE on Linux.

Mast, Ryan [Lawrence Livermore National Lab. (LLNL↗
DOE OSTI2022

Kubernetes Bindings for the Flux Workload Manager

Flux is a framework for writing resource managers as well as a resource manager for HPC systems. It allows for hierarchical nesting and providing a portable interface for job scheduling across systems. The flux-k8s software provides an interface between Flux and Kubernetes so the two frameworks can use each other's functionality. The code is currently licensed under the LGPL-3.0 License, but we request to re-license the code to promote outside collaboration and community adoption.

Ahn, DongH↗
DOE OSTI2023

AIIO v0.0.1

AIIO uses Artificial Intelligence for Job-Level and Automatic I/O Performance Bottleneck Diagnosis.

Dong, Bin↗
DOE OSTI2022

QGLab v0.0.1

A software program for experimenting with holographic teleportation protocol on quantum computers. The code implements the protocol that was proposed in https://arxiv.org/abs/1911.06314. The code is an end-to-end software solution that facilitates conducting the holographic teleportation experiments on state-of-the-art and emergent generations of QPUs supported by the Qiskit and tket SDKs. The code bundles all stages of an experiment as a single configurable workflow allowing faster development and experimentation cycles. Features: 1. Easy switching between Qiskit and tket quantum compilers. 2. Semi-automatic facilities for finding optimal compilation solutions beyond what Qiskit and tket provide by default. 3. Experiment resolution scaling (based on automatic jobs' batching). 4. Automatic experiment scaling over qubits. 5. Automatic readout error mitigation. 6. Automatic reproducibility analysis. 7. Standalone error-mitigation tools (randomized compiling, mitigation with estimation circuits, zero-noise extrapolation)

Shapoval, Illya↗
DOE OSTI2022

EMSL-Computing/CoreMS-Portal

Software that orchestrate data processing and management for mass spectrometry workflows and data products. Stack presented contains a web application, data processing job scheduling, and data processing workers for data processing and management.

Corilo, Yuri↗
DOE OSTI2022

Podman-hpc v1.0

We have developed some scripts and tools that compliment an existing open-source product (Podman, https://podman.io/). This enables podman to function as a high-performance container solution. This capability is similar to Shifter and Singularity (both developed at LBNL). The advantage of leveraging Podman is it has greater support in the broader community outside of HPC and has capabilities missing from many of the HPC-only solutions. The specific enhancements we wish to share our how to enable Podman to scale to very large HPC jobs and our integrations we have done to utilize high-performance interconnects and GPUs.

Cannon, Richard↗
DOE OSTI2024

AiiDA-INQ plugin

The AiiDA-INQ plugin will allow the INQ code developed at the lab to utilize the AiiDA workflow manager which enables high-throughput workflows. This includes provenance tracking, restart capabilities, job calculators, and other capabilities

Keilbart, NathanD↗
DOE OSTI2023

YoDawg CI Runner

SAND2022-15186 O YoDawg CI Runner builds a container that hosts a Gitlab runner as a service. It provides the ability to run Podman in a nested fashion as part of a CI workflow (i.e., "Podman-in-Podman”). This allows CI jobs to be run on HPC resources by standard users through an on-demand batch scheduler. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Curry, Matthew↗
DOE OSTI2025

torc (Torc Workflow Management System) [SWR-24-127]

This software package orchestrates execution of a workflow of jobs on distributed computing resources. It is optimized for use on HPCs with Slurm, but also can be used in the cloud and on local computers. Please refer to the documentation at https://nrel.github.io/torc

Thom, Daniel [National Renewable Energy Laboratory↗
DOE OSTI2025

Meld: A project for exploring how to meet DUNE's framework needs

Existing data-processing frameworks for HEP experiments are largely based on collider-physics concepts, which may be based on rigid, event-based data hierarchies. These data organizations are not always helpful for neutrino experiments, which must sometimes work around such restrictions by manually splitting apart events into constructs that are better suited for neutrino physics. The purpose of Meld is to explore more flexible data organizations by treating a frameworks job as: (1) A graph of data-product sequences connected by (2) User-defined functions that serve as operations to (3) Framework-provided higher-order functions.

Knoepfel, KyleJ. [Fermi National Accelerator Labor↗
DOE OSTI2025

fife-utils

This is a collection of scripts related to the FIFE project at Fermilab, including utiltities for performing bulk oprations with our SAM and MetaCat (github)data handling systems. The most heavily used is the fife_launch/fife_wrap script pair, which is used to convert physics analysis executables into distributed grid jobs.

Mengel, Marc [Fermi National Accelerator Laborator↗
DOE OSTI2026

ML-AMD/exa-pd

Exa-pd is a highly parallelizable workflow for constructing multi-element phase diagrams (PDs). It uses standard sampling techniques—molecular dynamics (MD) and Monte Carlo (MC)—as implemented in the LAMMPS package, to simultaneously sample multiple phases on a fine temperature–composition mesh for free-energy calculations. The workflow uses Parsl as a global controller to manage the MD/MC jobs to achieve massive parallelization with almost ideal scalability. The resulting free energies of both liquid and solid phases (including solid solutions) are then fed to CALPHAD modeling using the PYCALPHAD package for the construction of a multi-element PD.

Zhang, Feng [Ames Laboratory (AMES), Ames, IA (Uni↗
DOE OSTI2026

MADA: Multi-Agent Design Assistant

MADA (Multi-Agent Design Assistant) is a Large Language Model (LLM) powered multi-agent framework that coordinates specialized agents for complex design workflows. The system was designed for HPC workflows with the following agents in mind: 1) A Job Management Agent (JMA) launches and manages ensemble simulations on HPC systems, 2) a Geometry Agent (GA) generates meshes, and 3) an Inverse Design Agent (IDA) proposes new designs informed by simulation outcomes. Our framework reduces cumbersome manual workflow setup, and enables automated design exploration at scale. However, the software also enables users to rapidly create new multi-agent systems. Simply define new agents in a configuration file, giving each their own set of tools (via MCP), and then chat and prompt your new multi-agent system. Is

Gunnarson, BrianS [Lawrence Livermore National Lab↗
DOE OSTI2026

mada-tools: MCP servers, configurations, skills, and examples for MADA

MADA-tools (Multi-Agent Design Assistant tools) is a library for defining MCP (Model Context Protocol) servers that can be used by AI agents in the MADA project. Each MCP server provides a focused set of tools that enhances an LLM's knowledge and capabilities for a specific domain, for example, how to launch jobs with Flux versus Slurm. The library makes it easy to configure and start multiple MCP servers using configuration files or command line options. Once running, these servers are intended to be consumed by one or more agents in the MADA ecosystem. The system is designed to be extensible so that future projects can contribute their own MCP servers, skills, and toolsets.

Gunnarson, BrianS [Lawrence Livermore National Lab↗
DOE OSTI2020

Mathematics: The Tao of Data Science

The two pieces, "Ten Research Challenge Areas in Data Science" by Jeannette M. Wing and “Challenges and Opportunities in Statistics and Data Science: Ten Research Areas” by Xuming He and Xihong Lin, provide an impressively complete list of data science challenges from luminaries in the field of data science. They have done an extraordinary job, so this response offers a complementary viewpoint from a mathematical perspective and evangelizes advanced mathematics as a key tool for meeting the challenges they have laid out. Notably, we pick up the themes of scientific understanding of machine learning and deep learning, computational considerations such as cloud computing and scalability, balancing computational and statistical considerations, and inference with limited data. We propose that mathematics is an important key to establishing rigor in the field of data science and as such has an essential role to play in its future.

97 MATHEMATICS AND COMPUTING↗