Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “containerized applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

28 records · Page 2

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗

Maritime Fuel Cell Generator Project [FY2018]

Fuel costs and emissions in maritime ports are an opportunity for transportation energy efficiency improvement and emissions reduction efforts. Ocean-going vessels, harbor craft, and cargo handling equipment are still major contributors to air pollution in and around ports. Diesel engine costs continually increase as tighter criteria pollutant regulations come into effect and will continue to do so with expected introduction of carbon emission regulations. Diesel fuel costs will also continue to rise as requirements for cleaner fuels are imposed. Both aspects will increase the cost of diesel-based power generation on the vessel and on shore. Although fuel cells have been used in many successful applications, they have not been technically or commercially validated in the port environment. One opportunity to do so was identified in Honolulu Harbor at the Young Brothers Ltd. wharf. At this facility, barges sail regularly to and from neighboring islands and containerized diesel generators provide power for the reefers while on the dock and on the barge during transport, nearly always at part load. Due to inherent efficiency characteristics of fuel cells and diesel generators, switching to a hydrogen fuel cell power generator was found to have potential emissions and cost savings. Deployment in Hawaii showed the unit needed greater reliability in the start-up sequence, as well as an improved interface to the end-user, thereby presenting opportunities for repairing/upgrading the unit for deployment in another locale. In FY2018, the unit was repaired and upgraded based on the Hawaii experience, and another deployment site was identified for another 6-month deployment of the 100 kW MarFC.

08 HYDROGEN↗

Packaged Combined Heat and Power Technology Overview and Market Profile

Combined heat and power (CHP), sometimes referred to as cogeneration, is an efficient and clean approach to generating electric power and useful thermal energy onsite from a single fuel source, offering reliable and affordable energy services to businesses and institutions. Furthermore, CHP provides a cost effective opportunity to improve the environmental footprint and resilience of industrial and commercial facilities across the United States. CHP equipment can be custom-engineered or installed as a predesigned and assembled package. A packaged CHP system is a standardized, pre-engineered system that includes all equipment, piping, wiring, and ancillary components to deliver electricity and thermal energy to a host facility with minimal onsite engineering and design time. Packaged CHP systems can be shipped as single or multiple modules with standard interconnections (e.g., fuel; electrical; thermal—hot water, steam, and/or chilled water), which simplifies installation and reduces the costs associated with the project. Most containerized or single packaged CHP system offerings range from 10 kW to 3 MW in capacity. Packaged CHP systems are extending the operating, efficiency, and emissions benefits of CHP to nontraditional markets in commercial, institutional, multifamily, light manufacturing, government, and military applications. These markets tend to be served by smaller systems (less than 5 MW) that are conducive to pre-engineered packaging and/or modularization. Many of these sectors have limited CHP experience and technical resources to adequately evaluate, install, and maintain onsite CHP systems. The introduction of packaged CHP offerings from experienced CHP Packagers and Solution Providers has accelerated CHP adoption, lowered energy costs, reduced emissions, and strengthened energy resilience in these sectors. In 2019, the US Department of Energy (DOE) launched the Packaged CHP eCatalog to promote increased acceptance of efficient, cost-effective CHP in these applications. The Packaged CHP eCatalog is a web-based, searchable platform that hosts DOE-recognized packaged CHP systems with features designed to reduce economic and performance risks for designers, developers, owners, and facility operators interested in installing CHP. DOE established the Packaged CHP Accelerator at the same time to help launch and publicize the eCatalog, and to validate project performance, cost, and installation time of CHP packages across a variety of applications. Accelerator efforts documented installed cost reductions and installation time reductions of more than 20% for packaged CHP systems over 100 kW compared with custom-engineered systems. The Packaged CHP Accelerator and eCatalog established a peer-to-peer network connecting public and private sector partners including utilities, state energy offices, and energy efficiency program administrators interested in promoting cost-effective, efficient CHP systems, Packagers, and Solution Providers. Feedback from these partners, along with input from DOE’s CHP Technical Assistance Partnerships (CHP TAPs), was critical in understanding the current market for packaged CHP technologies, stimulating investment in these technologies, and guiding future directions for packaged CHP systems and their applications. This report provides background on packaged CHP systems, an overview of their benefits, a profile of current packaged CHP installations, and a summary of future market trends; this report is intended for facility owners, project developers, engineers, policymakers, and other stakeholders looking to increase the adoption of efficient, flexible, and resilient packaged CHP systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Software Quality Assurance for High Performance Computing Containers

Software containers are a key channel for delivering portable and reproducible scientific software in high performance computing (HPC) environments. HPC environments are different from other types of computing environments primarily due to usage of the message passing interface (MPI) and drivers for specialized hard- ware to enable distributed computing capabilities. This distinction directly impacts how software containers are built for HPC applications and can complicate software quality assurance efforts including portability and performance. This work introduces a strategy for building containers for HPC applications that adopts layering as a mechanism for software quality assurance. The strategy is demonstrated across three different HPC systems, two of them petaflops scale with entirely different interconnect technologies and/or processor chipsets but running the same container. Performance consequences of the containerization strategy are found to be less than 5-14% while still achieving portable and reproducible containers for HPC systems.

97 MATHEMATICS AND COMPUTING↗

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗

Transient Efficiency Flexibility and Reliability Optimization of Coal-Fired Power Plants: Model-Predictive Control Library Development (Report)

This document pertains to the reporting requirements of DOE contract FE-0031767. The document covers the development of a model predictive control (MPC) library for implementing MPC for a general dynamic system. The library is implemented in a standardized manner in Matlab/Simulink, where core functions on model prediction, linearization and formulation and solution of a quadratic programming (QP) optimization problem is done in the core library - independent of the specific application. The user can provide the application-specific dynamic model in continuous and discrete time, to rapidly implement and test the MPC performance in a desktop simulation. The MPC optimization objective and constraints are also easily configured via an Excel file to allow iterative refinement as needed. Finally, the MPC library enables a rapid deployment to a target environment through auto C-code generation and containerization. The MPC library works seamlessly with the model based estimation (MBE) library to obtain the overall output feedback control solution. In this program, the reduced order model (ROM) of a coal-fired power plant (CFPP) is used to implement and test the MPC solution.

01 COAL, LIGNITE, AND PEAT↗

Scalable Generation of High-fidelity Synthetic Population Ensembles

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the U.S. via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. The study involves two scenarios: creating ensembles for (1) 17 U.S. metropolitan areas in 2019 and (2) full U.S. Census Divisions in 2023, with each scenario consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system within a research cloud, comprised of virtual containerizations, GPU-enhanced functionality, and orchestrated deployments of UrbanPop’s maturing Likeness Python ecosystem. Results demonstrate we maintained high-fidelity approximations of residential totals by areas of interest and the demographic characteristics of neighborhoods while reducing manual workflow burdens. Finally, we discuss plans to fine-tune and further develop our automated workflows for truly distributed job orchestration to increase computational efficiency, as well as provide an outlook for broadening applications of the ensembles.

Cluster computing↗

Producing High-fidelity Synthetic Population Ensembles at Scale

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the US via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. Our initial task involves creating ensembles for 17 US metropolitan areas, each consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system comprised of a research cloud, virtual containerization, GPU-enhanced functionality, and a dual API/CLI to interact with UrbanPop’s maturing Likeness Python ecosystem. We observe a reduction in theoretical execution time while maintaining high-fidelity approximations of residential totals by metropolitan area and the demographic characteristics of neighborhoods. We discuss expansion of our approach to produce synthetic population ensembles for the entire US, particularly plans to establish automated workflows for job orchestration to increase computational efficiency, as well as provide outlook for broadening applications of the ensembles.

Gaboardi, James [ORNL] (ORCID:0000000247766826)↗

Chemical Recommender System: Replacement Suggestions for Small Molecules

The Chemical Recommender System (CRS) is an open-source, high-performance toolkit that enables real-time similarity searches across the complete PubChem database (over 50 million molecules) using commodity hardware. The CRS addresses critical limitations in existing chemical informatics platforms through a novel vector database infrastructure, extensible model integration capabilities, and complete algorithmic transparency. The system implements a vector database deployment with partitioned indexing that achieves a ~60x speedup over traditional approaches. A containerized model integration framework allows researchers to seamlessly incorporate custom predictive models into the full-scale search and scoring pipeline, while complete configurability of search parameters, filtering logic, and scoring functions provides capabilities not available in existing black-box solutions. Beyond structural similarity, the CRS integrates OPERA QSAR models for thermophysical and toxicity predictions, RDKit synthetic accessibility scoring, and user-defined models to compute weighted final replacement scores. The complete system is accessible through an interactive web application supporting real-time progress monitoring, post-processing score re-weighting, automated PDF reporting, and batch processing capabilities.

Nair, Parthiv Anand [Sandia National Laboratories ↗

Virtual Framework for Development and Testing of Federation Software Stack

Softwarization of networked infrastructures combined with containerization of codes promises unprecedented computing capabilities distributed across the federations of computing systems and physical instruments. The development and testing of a software stack that implements these capabilities over an expensive physical production infrastructure is not cost-effective, and in the early stages, may potentially cause service disruptions. To address these aspects, we develop the Virtual Federated Science Instrument Environment (VFSIE), a digital twin of the physical infrastructure that emulates a multi-site federation. Each federated site is emulated using containers and virtual hosts that are connected over local-area networks, and the sites, in turn, are connected over an emulated wide-area network. We describe the framework design and implementation details. We also illustrate its application by emulating a federation of four laboratories that use Jupyter Notebook for computations and the EPICS software system for instrument control.

Al Najjar, Anees↗