Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “containerization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

AQDrop Quantum Service (AQDrop) v1.0

AQDrop is a job management system designed to streamline access to the Advanced Quantum Testbed (AQT) at NERSC (National Energy Research Scientific Computing Center). It serves as a centralized middleware layer between researchers and quantum processing hardware. Key Features: AQDrop provides a FastAPI-based server backed by PostgreSQL for job submission, queue management, and role-based access control (members, operators, and administrators). Users submit Qiskit circuits via JSON payloads, which are queued, dispatched to the QPU through the Qubic API, and returned as measurement counts. A Python client library and web dashboard round out the interface options. Primary Use: Researchers submit quantum circuit jobs from a laptop or login node; an operator client executes those jobs on the AQT's physical QPU and returns results — all coordinated through the central API. Advantages: Compared to ad-hoc or direct hardware access, AQDrop adds structured queue management, auditable job-status tracking and OAuth2 authentication — reducing scheduling conflicts and unauthorized access. Its containerized deployment also improves reproducibility and scalability. Overall, AQDrop functions as a purpose-built quantum job broker tailored to NERSC's specific hardware and institutional access requirements.

Caplinger, Evan [Lawrence Berkeley National Labora↗
DOE OSTI2025

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science↗
DOE OSTI2023

AmeriFlux FLUXNET-1F US-HB3 Hobcaw Barony Longleaf Pine Restoration

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-HB3 Hobcaw Barony Longleaf Pine Restoration. This is the FLUXNET version of the carbon flux data for the site US-HB3 Hobcaw Barony Longleaf Pine Restoration produced by applying the standard ONEFlux (1F) software. Site Description - A mixed forest that was clearcut, herbicided and planted in containerized longleaf pine seedlings

Forsythe, Jeremy D.↗
DOE OSTI2026

Chemical Recommender System: Replacement Suggestions for Small Molecules

The Chemical Recommender System (CRS) is an open-source, high-performance toolkit that enables real-time similarity searches across the complete PubChem database (over 50 million molecules) using commodity hardware. The CRS addresses critical limitations in existing chemical informatics platforms through a novel vector database infrastructure, extensible model integration capabilities, and complete algorithmic transparency. The system implements a vector database deployment with partitioned indexing that achieves a ~60x speedup over traditional approaches. A containerized model integration framework allows researchers to seamlessly incorporate custom predictive models into the full-scale search and scoring pipeline, while complete configurability of search parameters, filtering logic, and scoring functions provides capabilities not available in existing black-box solutions. Beyond structural similarity, the CRS integrates OPERA QSAR models for thermophysical and toxicity predictions, RDKit synthetic accessibility scoring, and user-defined models to compute weighted final replacement scores. The complete system is accessible through an interactive web application supporting real-time progress monitoring, post-processing score re-weighting, automated PDF reporting, and batch processing capabilities.

Nair, Parthiv Anand [Sandia National Laboratories ↗
DOE OSTI2021

Execute BEE workflows on private cloud infrastructure (STNS01-22 BEE - FY21 P6-2)

Scope and objectives: BEE provides a portable, modular, HPC-focused workflow engine capable of managing containerized applications at scale. In FY21 BEE will expand its capabilities to provide more sophisticated handling of workflows. The ability to archive, clone, and re-run workflows will be added to BEE. The kinds of resources that BEE can use to execute workflow tasks will be expanded to include public and private clouds, such as Google Cloud Platform and OpenStack.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

STNS01-44 BEE – FY22-1: Enhanced BEE Client [Slide]

BEE provides a portable, modular, HPC-focused workflow engine capable of managing containerized applications at scale. In FY22 BEE is completing enhancements and refinements that will complete the major development work of the workflow system. The first major milestone is the development of a graphical client. The second milestone will be the ability for BEE to automatically restart checkpointed tasks. The final milestone for FY22 will be the ability to launch and manage multiple simultaneous workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Transient Efficiency Flexibility and Reliability Optimization of Coal-Fired Power Plants: Model-Predictive Control Library Development (Report)

This document pertains to the reporting requirements of DOE contract FE-0031767. The document covers the development of a model predictive control (MPC) library for implementing MPC for a general dynamic system. The library is implemented in a standardized manner in Matlab/Simulink, where core functions on model prediction, linearization and formulation and solution of a quadratic programming (QP) optimization problem is done in the core library - independent of the specific application. The user can provide the application-specific dynamic model in continuous and discrete time, to rapidly implement and test the MPC performance in a desktop simulation. The MPC optimization objective and constraints are also easily configured via an Excel file to allow iterative refinement as needed. Finally, the MPC library enables a rapid deployment to a target environment through auto C-code generation and containerization. The MPC library works seamlessly with the model based estimation (MBE) library to obtain the overall output feedback control solution. In this program, the reduced order model (ROM) of a coal-fired power plant (CFPP) is used to implement and test the MPC solution.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2022

Maritime Fuel Cell Generator Project [FY2018]

Fuel costs and emissions in maritime ports are an opportunity for transportation energy efficiency improvement and emissions reduction efforts. Ocean-going vessels, harbor craft, and cargo handling equipment are still major contributors to air pollution in and around ports. Diesel engine costs continually increase as tighter criteria pollutant regulations come into effect and will continue to do so with expected introduction of carbon emission regulations. Diesel fuel costs will also continue to rise as requirements for cleaner fuels are imposed. Both aspects will increase the cost of diesel-based power generation on the vessel and on shore. Although fuel cells have been used in many successful applications, they have not been technically or commercially validated in the port environment. One opportunity to do so was identified in Honolulu Harbor at the Young Brothers Ltd. wharf. At this facility, barges sail regularly to and from neighboring islands and containerized diesel generators provide power for the reefers while on the dock and on the barge during transport, nearly always at part load. Due to inherent efficiency characteristics of fuel cells and diesel generators, switching to a hydrogen fuel cell power generator was found to have potential emissions and cost savings. Deployment in Hawaii showed the unit needed greater reliability in the start-up sequence, as well as an improved interface to the end-user, thereby presenting opportunities for repairing/upgrading the unit for deployment in another locale. In FY2018, the unit was repaired and upgraded based on the Hawaii experience, and another deployment site was identified for another 6-month deployment of the 100 kW MarFC.

08 HYDROGEN↗
DOE OSTI2022

Flexible Siting Criteria and Staff Minimization for Micro-Reactors

The economic potential of micro-reactors is vast and underestimated. Commonly-emphasized applications include niche markets such as remote communities, mines and military bases. However, micro-reactors could be used as flexible energy generators also for larger markets, such as mobile and containerized agriculture and manufacturing facilities, district heating, micro-grids for data centers, sea ports, airports and hospitals. The implication is that micro-reactors may have to be deployed also in non-remote locations. Successful implementation of micro-reactors needs a navigable and predictable licensing process, technology-appropriate siting restrictions, risk-informed emergency and safety requirements, and practical operating and maintenance requirements. The primary goal of this project was to develop siting criteria that are tailored to micro-reactors deployable in densely-populated areas, e.g., urban environments. To achieve that goal, we compared the characteristics of the MIT research reactor (MITR) with those of leading micro-reactor concepts (e.g., eVinci, USNC, Aurora), and evaluated whether and how the MITR design basis (e.g., inherent safety features, engineered safety systems, source term, emergency planning and emergency operating procedures) and associated regulations may be applicable to these new micro-reactors as well. What makes MITR a unique analogue in this context is its small power rating (6 MWt) and physical size, mode of operations (24/7 with a somewhat more commercial flavor than typical university reactors), and especially its urban location. Of course significant differences exist, such as mission (power production vs. research) and the reactor design itself. Leveraging the MITR experience, this project was able to generate criteria that will allow micro-reactors to realize their full economic potential as flexible heat and electricity generators for a diverse portfolio of applications in non-remote locations. As such, the outcome of this project might encourage investment in and use of micro-reactors. A second goal of the project was to conceptualize a model of operations for micro-reactors that would minimize the staffing requirements, and thus reduce the cost of electricity and heat generated by these systems. Here too our approach was to systematically review the MITR experience and requirements, as well as survey the innovations in autonomous control technologies and monitoring (e.g., advanced sensors, drones, robotics, AI) that would permit a dramatic reduction in staffing at future micro-reactor installations. The scope of work was expanded after the start date to include also an evaluation of micro-reactor security, using the so-called consequence-based analysis, and the development of a methodology to perform dynamic risk assessment for micro-reactors, using system theory and modeling and simulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Evaluation of Expansion in ETF Grout Compositional Variants

In summary, the Base Case grout, Mix K, prepared according to the protocol provided (short stirring time after struvite precipitation of about 30 minutes) expanded when cured in a dry and damp sealed bag. Two variants, Mix M, 100 % slag in the dry mix, did not expand when prepared and cured under the same dry and damp conditions. Mix L, precipitated struvite removed, showed very slight expansion after curing 289 days for both dry and damp curing which was expressed as slight bulging at the bottom of the container. Mix N, 100 % dilution of the simulant, did not expand when cured under dry conditions or in a sealed container in damp conditions. However, a cylinder of Mix N cured in a container that was slit and taped back together did expand in damp conditions. This condition enabled the grout to be exposed to more moisture that the grout sample cured in the capped container and stored in the same zip top bag with the damp towel. This information is provided to support processing and containerization of the ETF ammonia grout.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Packaged Combined Heat and Power Technology Overview and Market Profile

Combined heat and power (CHP), sometimes referred to as cogeneration, is an efficient and clean approach to generating electric power and useful thermal energy onsite from a single fuel source, offering reliable and affordable energy services to businesses and institutions. Furthermore, CHP provides a cost effective opportunity to improve the environmental footprint and resilience of industrial and commercial facilities across the United States. CHP equipment can be custom-engineered or installed as a predesigned and assembled package. A packaged CHP system is a standardized, pre-engineered system that includes all equipment, piping, wiring, and ancillary components to deliver electricity and thermal energy to a host facility with minimal onsite engineering and design time. Packaged CHP systems can be shipped as single or multiple modules with standard interconnections (e.g., fuel; electrical; thermal—hot water, steam, and/or chilled water), which simplifies installation and reduces the costs associated with the project. Most containerized or single packaged CHP system offerings range from 10 kW to 3 MW in capacity. Packaged CHP systems are extending the operating, efficiency, and emissions benefits of CHP to nontraditional markets in commercial, institutional, multifamily, light manufacturing, government, and military applications. These markets tend to be served by smaller systems (less than 5 MW) that are conducive to pre-engineered packaging and/or modularization. Many of these sectors have limited CHP experience and technical resources to adequately evaluate, install, and maintain onsite CHP systems. The introduction of packaged CHP offerings from experienced CHP Packagers and Solution Providers has accelerated CHP adoption, lowered energy costs, reduced emissions, and strengthened energy resilience in these sectors. In 2019, the US Department of Energy (DOE) launched the Packaged CHP eCatalog to promote increased acceptance of efficient, cost-effective CHP in these applications. The Packaged CHP eCatalog is a web-based, searchable platform that hosts DOE-recognized packaged CHP systems with features designed to reduce economic and performance risks for designers, developers, owners, and facility operators interested in installing CHP. DOE established the Packaged CHP Accelerator at the same time to help launch and publicize the eCatalog, and to validate project performance, cost, and installation time of CHP packages across a variety of applications. Accelerator efforts documented installed cost reductions and installation time reductions of more than 20% for packaged CHP systems over 100 kW compared with custom-engineered systems. The Packaged CHP Accelerator and eCatalog established a peer-to-peer network connecting public and private sector partners including utilities, state energy offices, and energy efficiency program administrators interested in promoting cost-effective, efficient CHP systems, Packagers, and Solution Providers. Feedback from these partners, along with input from DOE’s CHP Technical Assistance Partnerships (CHP TAPs), was critical in understanding the current market for packaged CHP technologies, stimulating investment in these technologies, and guiding future directions for packaged CHP systems and their applications. This report provides background on packaged CHP systems, an overview of their benefits, a profile of current packaged CHP installations, and a summary of future market trends; this report is intended for facility owners, project developers, engineers, policymakers, and other stakeholders looking to increase the adoption of efficient, flexible, and resilient packaged CHP systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Performance Assessment of the Active Trenches in 200 East and 200 West Low-Level Burial Grounds at the Hanford Site

The purpose of this document is to provide the assessment of the long-term human health and environmental risk associated with the continued disposal of radioactive wastes in the active trenches of the 200 East and 200 West Area Low-Level Burial Grounds (LLBGs) at the Hanford Site (Figure ES-1), as required by DOE O 435.1, Radioactive Waste Management1. Since July 1, 2004, the only active trenches in the 200 West Area LLBGs are the lined Trenches 31 and 34 used for the disposal of containerized low-level waste and mixed low-level waste (Figure ES-2). The only active trench in the 200 East Area LLBGs is the unlined Trench 94 that was used for the disposal of naval reactor compartments (Figure ES-3). Trenches 31 and 34 are intended to be used until they reach their disposal capacity while Trench 94 will be used and expanded as necessary to meet the needs of the U.S. Navy.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

CLAS12 remote data-stream processing using ERSAP framework

Implementing a physics data processing application is relatively straightforward with the use of current containerization technologies and container image runtime services, which are prevalent in most high-performance computing (HPC) environments. However, the process is complicated by the challenges associated with data provisioning and migration, impacting the ease of workflow migration and deployment. Transitioning from traditional file-based batch processing to data-stream processing workflows is suggested as a method to streamline these workflows. This transition not only simplifies file provisioning and migration but also significantly reduces the necessity for extensive disk space. Data-stream processing is particularly effective for real-time processing during data acquisition, thereby enhancing data quality assurance. This paper introduces the integration of the JLAB CLAS12 event reconstruction application within the ERSAP data-stream processing framework that facilitates the execution of streaming event reconstruction at a remote data center and enables the return streaming of reconstructed events to JLAB while circumventing the need for temporary data storage throughout the process.

Gyurjyan, Vardan↗
DOE OSTI2024

Container Factories in the Oak Ridge Research Cloud

This technical report describes an implementation of a devops container factory utilizing ORNL ResearchCloud (ORC) birthright resources. Any researcher or project can implement the strategy described here fortheir CI/CD needs. This is a technology demonstration of using rootless podman as a direct replacementfor docker in a GitLab CI/CD context to enhance security. It is also a stepping stone towardsimplementation of the containerized software factory described in the DoD Enterprise DevSecOpsReference Design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

5G Securely Energized and Resilient: (5G-SER) (Final Report)

NREL's work on 5G integration with physical power systems (versus simulated systems demonstrated in task 3) under 5G-Securely Energized and Resilient (5G-SER) achieved a major milestone in with the completion of Task 4 activities. After many months (6+) of planning and development along with scaling challenges along the way, a full 5G end-to-end network with physical hardware components (physical inverter, physical power panel, physical battery, etc.) was deployed in a containerized environment. In parallel, a distributed controls architecture for a microgrid powering 5G resources was also successfully modified from its previous instantiation for a simulated environment to work with these physical components. These accomplishments set the stage to use newly setup 5G technology with physical microgrid components to test the feasibility of 5G wireless with physical systems to enable resilient communications between controls and distributed solar and storage resources while exploring ways to configure 5G components to survive power disturbances. The results detailed in the report below show that even utilizing physical components, 5G wireless systems were able to provide resilient results that were similar to the results from the simulated environment Task 3).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Harness the Power of AI and CI/CD to Fuel Scientific Discovery

The "Harness the Power of AI and CI/CD to Fuel Scientific Discovery" project aims to enhance and automate critical scientific computing systems used in large-scale experiments like CMS at LHC and DUNE at Fermilab. By leveraging GlideinWMS and HEPCloud, this initiative focuses on developing containerized CI/CD pipelines, integrating AI for code quality improvement, and automating security verifications. Participants will gain hands-on experience with distributed computing systems and implement secure communications, contributing to real-world scientific progress and the open-source community.

Nurcellari, Tea↗
DOE OSTI2024

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Integration of Waveform Simulation Methods

The generation of synthetic seismograms through simulation is a fundamental tool of seismology required to run quantitative hypothesis tests. A variety of approaches have been developed throughout the seismological community and each has their own specific user interface based on their implementation. This causes a challenge to researchers who will need to learn new interfaces with each new software they wish to use and create substantial challenges when attempting to compare results from different tools. Here we provide a unified interface that facilitates interoperability amongst several simulation tools through a modern containerized Python package. Further, this package includes post-processing analysis modules designed to facilitate end-to-end analysis of synthetic seismograms. In this report we present the conceptual guidance and an example implementation of the new Waveform Simulation Framework.

58 GEOSCIENCES↗