Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operating systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Distributionally Robust Bilevel Optimization Model for Distribution Network With Demand Response Under Uncertain Renewables Using Wasserstein Metrics

Here, we consider a distribution network integrating demand response (DR) participants in the presence of uncertain renewable suppliers and outdoor temperatures. A bilevel optimization model is proposed to capture the intricate dynamics between price-incentivized DR participants and distribution system operations, including energy procurement and active/reactive power flows. The model is formulated as a distributional robust bilevel optimization using Wasserstein metrics. We show favorable data-driven properties including out-of-sample guarantee and asymptotic consistency. Furthermore, we present a tractable mixed-integer linear programming reformulation and characterize the worst-case distribution. Computational experiments are conducted on a modified 33-bus system. Our findings underscore the efficacy of the pricing strategies derived from the proposed bilevel optimization model. These strategies not only effectively manage DR participants' behavior but also bring equity considerations among households with various characteristics to light. The results contribute to a deeper understanding of the interplay between distribution system operators and DR participants.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

WM26 Paper Multi-Robot Collaboration for Hazardous Environments

Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.

42 - ENGINEERING↗
DOE OSTI2025

Explainable AI for Multivariate Time Series Pattern Exploration: Latent Space Visual Analytics With Temporal Fusion Transformer and Variational Autoencoders in Power Grid Event Diagnosis

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and interconnected nature of complex patterns, which hinder the understanding of their underlying physical processes. Existing AI methods often face limitations in interpretability, computational efficiency, and scalability, reducing their applicability in real-world scenarios. This paper proposes a novel visual analytics framework that integrates two generative AI models, Temporal Fusion Transformer (TFT) and Variational Autoencoders (VAEs), to reduce complex patterns into lower-dimensional latent spaces and visualize them in 2D using dimensionality reduction techniques such as PCA, t-SNE, and UMAP with DBSCAN. These visualizations, presented through coordinated and interactive views and tailored glyphs, enable intuitive exploration of complex multivariate temporal patterns, identifying patterns’ similarities and uncover their potential correlations for a better interpretability of the AI outputs. The framework is demonstrated through a case study on power grid signal data, where it identifies multi-label grid event signatures, including faults and anomalies with diverse root causes. Additionally, novel metrics and visualizations are introduced to validate the models and assess the performance, efficiency, and consistency of latent maps generated by VAE, which have been utilized in prior studies for latent space cartography and used as a benchmark in this study, and the emerging TFT architecture under various configurations. These analyses provide actionable insights for model parameter tuning and reliability improvements. Comparative results highlight that TFT achieves shorter run times and superior scalability to diverse time-series data shapes compared to VAE. This work advances fault diagnosis in multivariate time series, fostering explainable AI to support critical system operations.

Explainable AI↗
DOE OSTI2024

Simulation-Based Analysis of Feeder Operation with Different PV Smart Inverter Functions on an Actual Distribution System: Preprint

High penetration of photovoltaics (PV) in distribution feeders can cause problems, such as overvoltage, reverse power flow, and large net load changes. Traditional voltage regulation devices, such as capacitors and voltage regulators, can solve some of these problems but might have some delays. Today, smart inverters are gradually being used to provide voltage regulation and frequency support in distribution systems. Different smart inverter settings have been recommended in various rules and standards; however, the potential benefits and their impacts on distribution system operation are not well compared and studied. This paper presents a comparison of different smart inverter settings as applied to a distribution system. An actual feeder model from San Diego Gas & Electric Company is used to conduct the simulation. Additionally, a load disaggregation method is proposed to disaggregate the load and PV profile for each load location using advanced metering infrastructure net load measurements. Then, different smart inverter settings are applied to the PV systems in the feeder, and the simulation results are compared. The results show that the implementation of specific functions of smart inverters can reduce voltage exceedances, and the utility can determine the specific inverter setting based on its operational requirements.

distribution system↗
DOE OSTI2026

Single-Phase to Split-Phase Inverters with Advanced Grid Support Functions for Grid-Interactive Applications

This work presents a cost-effective single-phase to split-phase inverter with a reduced switch count, achieving grid interactive performance while maintaining operational efficiency. The proposed system integrates an Andronov-Hopf oscillator based secondary controller, which inherently embeds a nonlinear resistive droop architecture, ensuring rapid dynamic response. A Lyapunov energy function-based primary control enhances transient stability and regulation, while an internal model-based point of common coupling voltage estimation enables cost optimization without additional sensors. Equipped with advanced grid support functionalities, the inverter facilitates seamless distribution system operation with enhanced robustness. The effectiveness of the proposed architecture and control strategy is validated through MATLAB/Simulink and PLECS simulations, demonstrating its feasibility for high-performance grid-supportive applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

NLR HPC Eagle Jobs Data and Additional Energy Metrics

Overview: Anonymized job-level records from the Eagle high-performance computing (HPC) system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, resource utilization, CPU/GPU energy consumption, and efficiency metrics. Sensitive fields (user, account, job name) are replaced with cryptographic hashes. System & Timeframe: Eagle was a 2,000-node, 8-petaflop system operated at NLR from 2019–2024. Data covers the full operational lifetime of the system. Slurm data was processed nightly; timestamps are in Mountain Time. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.eagle.job-anon.zip — Core anonymized job records (Hive-partitioned Parquet) esif.hpc.eagle.job-anon-energy-metrics.zip — Same records with additional iLO and Ganglia energy metrics datacard.md — Full dataset documentation ~13.8 million rows, 62 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct through a pipeline: Eagle Jobs API → Redpanda → StreamSets → HPCMON API → PostgreSQL. Node-level power from iLO (HP Integrated Lights-Out); GPU power from Ganglia monitoring, joined to jobs via node lists and time ranges. Preprocessing: Anonymization of name, user, and account fields via cryptographic hashing Derived columns: queue_wait, cpu_eff, max_mem_eff Simplified job state mapping (e.g., "CANCELLED BY 12345" → "CANCELLED") QoS accounting rules (buy-in, standby, or Slurm QoS value) CPU energy estimated from TDP (200W, Intel Xeon Gold 6154, 18 cores) Timezone-aware columns (_tz) sourced from LEX accounting database to correctly handle DST transitions Key Variables: Scheduling: job_id, partition, state_simple, submit_time_tz, start_time_tz, end_time_tz, queue_waitResources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, node_energy_total_watt_hours (iLO), gpu0/1_energy_total_watt_hours (Ganglia) Partitions: bigmem, bigmem-8600, bigscratch, csc, dav, ddn, debug, gpu, haswell, long, mono, short, standard Job States: CANCELLED, COMPLETED, FAILED, NODE_FAIL, OUT_OF_MEMORY, PENDING, RUNNING, TIMEOUT QoS Levels: Unknown, normal, buy-in, debug, penalty, high, standby Important Notes: Non-_tz timestamp columns may be off by one hour across DST boundaries; use _tz columns for time difference calculations Energy fields are null for jobs without monitoring coverage Job step records and raw Slurm JSONB fields are excluded from this extract Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Grid-responsive hydrogen production: Capital utilization and current density vs. efficiency in variable electricity markets

To achieve low-cost hydrogen production from water electrolyzers, grid tied electrolysis may need to operate dynamically to minimize the cost of supplying energy to the electrolyzer stack and produce hydrogen during low-cost hours and turn off/down during high-cost hours. Operating systems in this way can decrease capital utilization (capacity factor) and electricity costs. This strategy would shift the dominant cost drivers away from electricity (and thus efficiency) to the capital costs of the system, due to the underutilized capital when operating at low-capacity factors. Increasing the operational current density of the system could, in effect, reduce the capital cost of the system while producing hydrogen at a lower efficiency on a per unit energy basis. In the variable electricity cost profiles analyzed in this paper, increasing the current density for liquid alkaline from 0.5 A/cm2 to 1.5 Ac/m2 and proton exchange membrane electrolyzers from 2 A/cm2 to 4 A/cm2 resulted in substantial reductions in the levelized cost of hydrogen. Additionally, as capacity factors and electricity costs decrease, the optimal operating current density of the electrolyzer systems analyzed increases. These findings suggest R&D efforts should focus on increasing the operational current densities, reducing the turn down ratios, and understanding the durability implications of those strategies on low-temperature liquid alkaline and proton exchange membrane electrolyzers.

08 HYDROGEN↗
DOE OSTI2025

CalTestBed - Delphire - Testing and Evaluation of Delphire Sentinel System (CRADA Final Report)

The Delphire Sentinel is a modular fire detection and communications system operating as a mobile field unit, with low voltage DC power supplied by onboard photovoltaics (PV) and batteries. The Sentinel addresses several aspects of fire detection, communications and data analysis. The Sentinel's mobility enables it to be rapidly deployed and operate independently of existing power and communications networks. The duration of independent operation depends critically on the energy consumption of the systems and performance of the onboard PV and battery. The purpose of this testing is to ascertain the power draw and energy consumption of the Delphire Sentinel prototype system under several operational states, including various data transfer packet sizes, transmission time and frequencies, and communication pathways (Wi-Fi, cellular, satellite) expected to be encountered in field deployments. It will also include procedures to test the ability of the Sentinel to operate for extended periods without loss of functionality. Based on results from energy and power measurements, and anticipated duty cycles in field deployments, we will model annual system autonomy (e.g. loss of load probability) for off-grid operation in representative locations.

47 OTHER INSTRUMENTATION↗
DOE OSTI2027

Market participation strategy of hybrid energy resources: A New York ISO case study

Drawing on existing market designs with independent resource participation in electricity markets, this study analyzes participation models for hybrid resources combining renewable generation and storage. Two models are considered: in the first, the components operate independently, with the Independent System Operator (ISO) managing the storage state of charge (SoC); in the second, the hybrid resource acts as an integrated unit, submitting offers as a “black box” and managing its SoC internally. Using a production cost model for the zonal New York Bulk Power System, we evaluate trade-offs in system reliability, market efficiency, and asset profitability. Our results provide several key insights for policymakers, showing that the ISO-managed granular model enhances social welfare through explicit SoC management, while the simpler integrated model is more computationally efficient, but may cause more real-time violations and lower overall profits.

Bansal, Rajni Kant↗
DOE OSTI2025

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗
DOE OSTI2024

Evolving Competitive Markets in SAPP: Leveraging Competitive Wholesale Electricity Markets to Drive Renewable Generation Capacity in the Southern African Power Pool (SAPP)

The SADC region has significant natural resource potential to increase renewable energy generation, improve electricity reliability, and support economic development. This research finds an apparent lack of confidence from electricity infrastructure investors in SAPP wholesale electricity markets, which increases risk perception and lowers the likelihood of capital deployment. With respect to free market fundamentals, competitive market obstacles and renewable energy development obstacles are characterized. Stakeholders identified the top obstacles to well-functioning competitive markets as insufficient transmission infrastructure for interconnection and regional movement of electricity, dominance of national single-buyer markets, and lack of or weak nation-state regulatory frameworks. Stakeholders prioritized the top three obstacles for renewable energy development as a lack of viable commercial arrangements for variable renewable energy (VRE) balancing, lack of functional and consistent nation-level regulations, and higher project costs related to reliance on imported equipment. With respect to potential solution options, stakeholders prioritized the development of new cost allocation and finance methods to facilitate new transmission expansion, training to educate new or potential new market entrants on SAPP processes, as well as modeling and analysis of regional SAPP participation benefits disaggregated to the nation-state level. From these perspectives, this research identified strategy options for consideration including transitioning SAPP to a regional transmission operator (RTO) for operation and planning of cross-border transmission facilities and market administration, shifting operations of SAPP member transmission systems to Independent System Operators (ISOs), establishing a regional regulatory authority and enhancing market data transparency. Implementing these reforms is expected to be challenging, but not insurmountable, given the domestic political, legal, and jurisdictional complexities of the SADC region.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

CRiSPPy: An advanced hydropower scheduling tool for the Colorado River Storage Project

The Western Area Power Administration (WAPA) plays a vital role in delivering reliable and cost-effective hydroelectric power to millions of customers across the western United States. The Colorado River Storage Project (CRSP) carries out WAPA’s mission in Arizona, Utah, Colorado, New Mexico, Nevada, Wyoming and Texas. Achieving this mission requires effective management of the Colorado River system, and depends on the use of advanced analytical tools and modeling methodologies. For many years, CRSP has relied on the Generation and Transmission Maximization Superlite (GTMax SL) model for its mid-term and long-term hydroscheduling needs. However, the evolving energy market, power system operations, environmental rules, and hydrology conditions, coupled with advancements in computational capabilities, have necessitated the development of a more modern and robust solution. This report introduces the Colorado River Storage Project Python-based (CRiSPPy) model, a new, advanced hydropower scheduling tool developed to address CRSP ever-evolving challenges. CRiSPPy represents a significant leap forward in our ability to model and optimize the operation of the Colorado River system. It incorporates state-of-the-art optimization algorithms, enhanced data management capabilities, and an advanced graphical user interface, providing WAPA CRSP personnel with unprecedented insights and decision-making support. This document details the development, capabilities, and implementation of CRiSPPy. It is intended to serve as a comprehensive resource for WAPA staff, stakeholders, and anyone interested in the future of hydropower scheduling in the Colorado River Basin. We are confident that CRiSPPy will enhance WAPA's mission while adapting to the challenges of a dynamic and increasingly complex environment. The version of CRiSPPy described in this report is the version 2.3. New versions of CRiSPPy will be developed as the tool keeps evolving to address CRSP challenges.

13 HYDRO ENERGY↗
DOE OSTI2025

Connecting Minds: AI Use Cases to Bridge Power Systems and Large Language Models for Practical Applications

Recent advances in artificial intelligence (AI) and development of large language models (LLMs) present the opportunity to develop a new generation of power systems applications. In contrast with early power system AI applications based on structured numerical data, LLMs offer unique capabilities to perform logical reasoning using text documents, unstructured data, and application programming interface (API) calls to computational software. This paper seeks to bridge the knowledge gap between power systems engineers and LLM developers through a crosscutting explanation of use cases, characteristics, requirements, practical considerations from the perspectives of both LLM capabilities and industry needs. Specific focus is given to applications that can be realistically deployed by electric utilities. After introducing the architecture of LLMs and unique challenges of the power systems domain, this paper proposes twenty representative LLM applications grouped into categories of 1) power system operations, 2) asset management, 3) system planning and analytics, and 4) energy management and protection systems. Five use cases are presented within each category with descriptions of the motivation, objectives, approaches, example inputs / outputs, and benefits of each use case.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

A hierarchical framework for aggregating grid-interactive buildings with thermal and battery energy storage

The behind-the-meter (BTM) thermal and battery energy storage can help improve energy efficiency, reduce energy costs, and enhance energy resilience, particularly in rural areas and for disadvantaged communities. Aggregating numerous BTM energy storage systems can act as a price influencer with a significant source of load shifting and peak demand reduction. An integrated and scalable control mechanism is required to effectively utilize energy storage systems and flexible building loads to maximize the economic benefits, considering various distribution system constraints. Here, this paper presents an innovative hierarchical coordination framework for energy storage and flexible load in buildings, considering various factors such as electricity prices, thermal comfort, and distribution system modeling and constraints. At the upper level, a distribution system operator optimizes the power flow to minimize its power procurement costs from the electricity wholesale market, while at the lower level, aggregators determine the optimal dispatch of battery and thermal energy storage systems in multiple buildings on behalf of end-users to minimize operating costs according to the power prices. These problems are solved using a game-theoretic approach through negotiations between the distribution system operator and aggregators as a bi-level decision model. Simulation case studies have been performed for a test distribution network with a number of building end-users using energy storage systems to quantify the performance of aggregators. The results demonstrate that the proposed strategy can reduce peak load for a reliable electricity distribution network while saving electricity bills for customers.

25 ENERGY STORAGE↗
DOE OSTI2025

Multistage economic MPC for systems with a cyclic steady state: A gas network case study

Multistage model predictive control (MPC) provides a robust control strategy for dynamic systems with uncertainties and a setpoint tracking objective. Moreover, extending MPC to minimize an economic cost instead of tracking a pre-calculated optimal setpoint improves controller performance. This paper presents a novel multistage economic nonlinear model predictive control (E-NMPC) framework for dynamic systems operating under uncertainty, with specific application to natural gas transmission networks. A key innovation lies in the integration of cyclic steady-state (CSS) constraints within the multistage MPC formulation, enabling the controller to manage periodic operating conditions commonly observed in energy systems. A Lyapunov-based descent condition is enforced to ensure robust stability of the controller. The multistage economic MPC framework is validated on two gas pipeline case studies, where it successfully minimizes net energy consumption, respects operational constraints under uncertain demand profiles, and guides the network to optimal cyclic operation. The Lyapunov function remains bounded in both case studies, validating the robust stability of multistage E-NMPC.

03 NATURAL GAS↗
DOE OSTI2025

Tightest Mixed-Integer Programming Formulations for Quadratic SCUC Optimization

In this project, we developed new, tighter Mixed-Integer Programming (MIP) formulations for the combined Alternating Current (AC) Security-Constrained Unit Commitment (SCUC) and Security-Constrained Optimal Power Flow (SCOPF). The work addresses a critical challenge in power system operations: efficiently determining which generation units to commit and how to optimally dispatch them while maintaining network reliability constraints for both normal and contingency scenarios. Our efforts: 1. Advance the Understanding of SCUC/SCOPF Modeling: By introducing tighter MIP formulations and leveraging cutting-edge optimization tools (Julia/JuMP, PowerModels.jl), this project has pushed forward the state of the art in efficient power systems scheduling. 2. Enhance Technical and Economic Feasibility: The methods developed provide more accurate and potentially faster solutions to large-scale, realistic scheduling and dispatch problems in electric power systems, which can translate into improved reliability and potentially lower costs for grid operations. 3. Benefit to the Public: Greater efficiency in power system operations leads to cost savings for utilities and end-users. Improved reliability and integration of advanced modeling approaches can facilitate the adoption of clean energy resources and better accommodate uncertainties in renewable generation. Because this technology could impact bulk power markets and reliability, these innovations have far-reaching public benefits in terms of cost savings, reliability, and sustainability.

24 POWER TRANSMISSION AND DISTRIBUTION↗