Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

torc (Torc Workflow Management System) [SWR-24-127]

This software package orchestrates execution of a workflow of jobs on distributed computing resources. It is optimized for use on HPCs with Slurm, but also can be used in the cloud and on local computers. Please refer to the documentation at https://nrel.github.io/torc

Thom, Daniel [National Renewable Energy Laboratory↗

C4.jl [SWR-25-106]

A proof-of-concept software framework for integrating capacity expansion and production cost optimization with probabilistic resource adequacy assessment and sending feedback signals between the models.

Stephen, Gordon [National Renewable Energy Laborat↗

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗

Optimal Network Reconfiguration and Scheduling With Hardware-in-the-Loop Validation for Improved Microgrid Resilience

With the increased occurrence of various major extreme weather events, power outages and prompt power system restorations have recently drawn more attention to the resilience and recovery of power systems. From the perspective of a more resilient power delivery at the distribution grid, system restoration using network topology reconfiguration together with optimal scheduling of distributed energy resources are adopted in this paper. The proposed optimization model aims at minimizing the total load shedding cost and other operational costs, in which linearized topological constraints borrowed from graph theory and linearized DistFlow models are respectively used to maintain the radial network topology and power flow balance after system contingencies. To demonstrate the applicability of the proposed strategy, a real-world case study of a networked three-microgrid system in Adjuntas, Puerto Rico, is used with the consideration of different independent/interconnected microgrid scenarios, contingencies, and fairness settings. Furthermore, hardware-in-the-loop testing is conducted for the same three-microgrid network, where the closely matched results with the simulated ones have validated the effectiveness of the proposed restoration strategy, which is now ready to move one step forward towards field deployment. Finally, to test the proposed restoration strategy in a larger networked system, the modified IEEE-33 bus test distribution system is considered, and the results show a more resilient power delivery for critical loads under three and four line outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Microgrid design and multi-year dispatch optimization under climate-informed load and renewable resource uncertainty

Microgrids are an increasingly popular solution to provide energy resilience in response to increasing grid dependency and the growing impacts of climate change on grid operations. However, existing microgrid models do not currently consider the uncertain and long-term impacts of climate change when determining a set of design and operational decisions to minimize long-term costs or meet a resilience threshold. In this paper, we develop a novel scenario generation method that accounts for the uncertain effects of (i) climate change on variable renewable energy availability, (ii) extreme heat events on site load, and (iii) population and electrification trends on load growth. Additionally, we develop a two-stage stochastic programming extension of an existing microgrid design and dispatch optimization model to obtain uncertainty-informed and climate-resilient energy system decisions that minimizes long-term costs. Use of sample average approximation to validate our two case studies illustrates that the proposed methodology produces high-quality solutions that add resilience to systems with existing backup generation while reducing expected long-term costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Plan It Together: Optimizing Across Generation, Transmission, Distribution, and Distributed Energy Resources

Integrated planning holds the promise of unlocking lower total system cost solutions by connecting previously siloed planning processes. This article summarizes the state of bulk and local grid planning today and details multiple new analytical approaches that can enable more holistic planning methods to develop comprehensive solutions to generation, transmission, distribution, and distributed energy resource needs. These include both iterative approaches as well as cooptimization techniques. In addition to the benefits of these methods, the technical and institutional challenges and associated solutions are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep Reinforcement Learning for Microgrid Cost Optimization Considering Load Flexibility

This paper proposes a novel Soft-Actor-Critic (SAC) based Deep Reinforcement Learning (DRL) method for optimizing the cost of microgrid operation by leveraging load flexibility. The proposed SAC-DRL method is designed to coordinate the control of distributed energy resources (DERs) and flexible load, addressing practical energy billing formation by power distribution utilities. Key contributions include an innovative reward function to mitigate sparse reward challenges and a mixed control strategy for discrete and continuous variables, ensuring radial network topology and minimizing power loss. We evaluate the proposed method on the model of a real microgrid located in Southern California, U.S.. The SAC-DRL model is tested to demonstrate its efficacy in reducing grid dependence, optimizing resource use, and minimizing costs. The results highlight the potential of DRL in modern energy systems, offering a sustainable and economically efficient solution for energy management in microgrids.

deep reinforcement learning↗

A Review of Quantum Computing Technologies in Power System Optimization

As modern power grids increasingly integrate variable renewable generation, distributed energy resources, and energy storage systems, classical optimization techniques are facing unprecedented challenges. This review examines the emerging application of quantum computing to overcome these challenges in power system optimization, including optimal power flow (OPF), unit commitment (UC), economic dispatch (ED), and intelligent switching and topology optimization (IS-TO). Recent research has introduced various quantum methodologies—such as gate-based, annealing-based, variational algorithms, and quantum-inspired algorithms—to address the combinatorial complexity inherent in grid reconfiguration and energy management. The review summaries the quantum algorithms, quantum devices and the power system test cases, highlighting hybrid quantum–classical strategies that leverage the complementary strengths of both paradigms. Some quantum advantages have been observed, including theoretical speedup, accurate simulation results, scalable qubit usage, efficient QUBO mapping. In particular, the review emphasizes the importance of integrating quantum optimization techniques with classical control frameworks, these hybrid approaches demonstrate the potential to improve real-time grid management and operational reliability. A significant portion of the analysis is devoted to the practical limitations of current quantum devices. Present-day quantum hardware, operating in the noisy intermediate-scale quantum (NISQ) era, remains highly sensitive to noise and limited in qubit connectivity, which constrains the scale and accuracy of implemented algorithms. The review delves into specific challenges such as the need for qubit-efficient encoding techniques and error mitigation strategies that are critical for handling real-world grid optimization problems. In addition, the work draws attention to the performance discrepancies between theoretical quantum speedups and experimental validations, underscoring the importance of rigorous benchmark studies using representative power grid test cases. In summary, this review highlights both the promise and limitations of quantum computing for power system optimization. It provides a comprehensive overview of the state-of-the-art technologies, categorizes recent advancements in algorithm design, and discusses practical considerations for implementation, and serves as an informative resource on current research. Future research directions include developing robust hybrid frameworks, advancing qubit-efficient formulations, and scaling up experimental demonstrations to confirm the theoretical advantages of quantum methods in large-scale power system operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Surrogate Neural Architecture Codesign Package (SNAC-Pack)

Neural Architecture Search is a powerful approach for automating model design, but existing methods struggle to accurately optimize for real hardware performance, often relying on proxy metrics such as bit operations. We present Surrogate Neural Architecture Codesign Package (SNAC-Pack), an integrated framework that automates the discovery and optimization of neural networks focusing on FPGA deployment. SNAC-Pack combines Neural Architecture Codesign's multi-stage search capabilities with the Resource Utilization and Latency Estimator, enabling multi-objective optimization across accuracy, FPGA resource utilization, and latency without requiring time-intensive synthesis for each candidate model. We demonstrate SNAC-Pack on a high energy physics jet classification task, achieving 63.84% accuracy with resource estimation. When synthesized on a Xilinx Virtex UltraScale+ VU13P FPGA, the SNAC-Pack model matches baseline accuracy while maintaining comparable resource utilization to models optimized using traditional BOPs metrics. This work demonstrates the potential of hardware-aware neural architecture search for resource-constrained deployments and provides an open-source framework for automating the design of efficient FPGA-accelerated models.

Weitz, Jason [UC, San Diego] (ORCID:00090004631535↗

Digital twin framework for PIP-II linac: AI-driven multi-scale modeling from ion source to 800 MeV

The PIP-II superconducting linac at Fermilab is designed to deliver multi-megawatt proton beams for neutrino physics and other high-intensity applications. To expedite commissioning and enhance operational reliability, we have developed an EPICS-based data flow framework that seamlessly integrates digital twins (DT) with physical twins (PT). These digital twins comprise high-fidelity beam dynamics models or data-driven surrogate models connected to their physical counterparts through real-time diagnostics and advanced machine-learning algorithms.Central to this framework is Linac_Gen, an accelerated simulation tool that incorporates convolutional neural networks, random forests, and genetic algorithms to provide up to a tenfold speedup in optimizing the accelerator geometry model. An EPICS translator layer ensures interoperability by efficiently mapping lattice parameters across diverse simulation platforms.Our EPICS-based framework supports multiple operational modes—monitoring, passive learning, closed-loop control, and online learning—covering the entire machine lifecycle. By leveraging HPC resources and multi-objective optimization techniques, the digital twin enables adaptive trajectory correction, real-time fault detection, and predictive modeling of beam stability. This comprehensive approach paves the way for robust, high-intensity operation and data-driven accelerator R&D at Fermilab.

Pathak, Abhishek [Fermilab]↗

Swarm Intelligence Based Optimal Design of Local Volt/Var Control Function for Distributed Energy Resources

The increasing penetration of renewable based distributed energy resources (DERs) in distribution network (DN) leads to larger and more frequent voltage variation in distributions network (DN), thus posing challenges on voltage control. Real-time local voltage control method is a promising solution for the above issue. However, the local voltage control function needs to be customized and optimized according to real distribution system condition. In this paper, a swarm intelligence based Volt/Var control optimal design method (SO-VVC) is proposed to optimize the control function. Compared with existing approaches, the proposed method can not only represent the nonlinear behaviour of power flow but is also computation efficient. The performance of the proposed SO-VVC is demonstrated by case studies on a modified IEEE-123 bus system.

Zhang, Zhengfa [University of Tennessee, Knoxville↗

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize multiple performance metrics, including job wait time and system throughput. Traditional heuristic-based scheduling algorithms increasingly struggle and lack the efficiency needed to meet the demands and address the complexity and scale of modern HPC systems. Consequently, recent research efforts have focused on leveraging advancements in Artificial Intelligence (AI) and Deep Learning (DL), particularly Reinforcement Learning (RL), to develop more adaptable and intelligent scheduling strategies. Previous RL-based scheduling approaches have explored a range of algorithms, from Deep Q-Networks (DQN) to Proximal Policy Optimization (PPO), and more recently, hybrid methods that integrate Graph Neural Networks (GNNs) with RL techniques. However, a common limitation across these methods is their reliance on relatively small datasets, with few methods being evaluated using large-scale, multi-million-job trace datasets representative of real-world HPC workloads. Moreover, existing RL schedulers face scalability issues due to centralized policy updates, which hinder training efficiency and performance when applied to large datasets. This study introduces a novel RL-based scheduler utilizing Decentralized Distributed Proximal Policy Optimization (DD-PPO) algorithm, which supports large-scale distributed training across multiple workers without requiring parameter synchronization at every step. By eliminating reliance on centralized updates to a shared policy, the DD-PPO scheduler enhances scalability, training efficiency, and sample utilization. Experimental validation using a large real-world dataset containing over 11.5 million job traces collected from petascale HPC systems over six years assesses the influence of dataset scale on training effectiveness and compares DD-PPO performance to traditional and advanced scheduling approaches. The experimental results demonstrate improved scheduling performance in comparison to both heuristic-based schedulers and existing RL-based scheduling algorithms.

AI↗

A modeling study of ocean thermal energy conversion resource and potential environmental effects around Kailua-Kona, Hawaii

Ocean Thermal Energy Conversion (OTEC) offers a promising renewable energy solution through a heat exchange process using the temperature difference between warm surface seawater and cold deep seawater. Because accurate resource characterization is critical for the optimal design and implementation of OTEC systems, a high-resolution numerical model is employed to better characterize the OTEC resource at Kona, Hawaii. Our model provides detailed spatial and temporal variability of the thermal gradient, which is essential for assessing the viability and efficiency of OTEC systems. The model results reveal distinct patterns and dynamics not captured by existing observations or models (e.g., lower-resolution information). These findings highlight the importance of using high-resolution models for accurate predictions of thermal gradient variability, ultimately supporting more efficient and sustainable OTEC deployment. Additionally, the study investigates the impacts of mixed water discharge from OTEC plants that can cause shock to organisms living in the surface water and potentially destabilize the water column. Understanding these effects is vital for minimizing any potential negative environmental consequences and ensuring the long-term viability of OTEC operations. Further, our model improves OTEC resource characterization, which can lead to optimal design and deployment of OTEC systems. The analysis of OTEC water discharge impacts can accelerate the development of OTEC technologies, overcoming permitting/consenting challenges. These findings contribute to the broader adoption of high-resolution modeling in ocean energy resource characterization, particularly for OTEC applications.

30 DIRECT ENERGY CONVERSION↗

Characterizing in-stream turbulent flow for tidal energy converter siting in Cook Inlet, Alaska

Cook Inlet in Alaska is the most promising location for tidal energy development in the U.S. due to its significant tidal range of approximately 10 meters and high volume flux. The inlet's unique geometry and flow characteristics make it the most energetic tidal stream in the nation, with GW-scale potential energy capacity. With the growing interest in tidal energy converter (TEC) deployment in this area, we implemented a regional-scale, 3D hydrodynamic modeling framework to predict tidal current and turbulence characteristics that can assist TEC designers and project managers. We validated the model results extensively using various datasets collected with bottom-mounted acoustic Doppler current profilers and velocimeters. The comparison between the model outputs and observational data highlighted the effectiveness of the 3D FVCOM model and the Mellor-Yamada Level 2.5 Turbulence Model in accurately assessing macro-scale kinetic energy, turbulence intensity, and the production and dissipation rates at a prospective TEC site. Using two months of model simulation data, we examined the channel cross-section for TEC deployment, focusing on undisturbed power density and macro-scale turbulent properties. Further, our findings indicate that understanding the turbulence characteristics and flow properties can enhance Stage I/II resource characterization by identifying optimal locations for TECs and their layouts within the channel. Furthermore, we demonstrated that TEC designers can utilize macro-scale turbulence data from 3D coastal models as boundary conditions for other turbulence models, allowing for a more detailed resolution of the turbulence structure at TEC siting locations. Ultimately, this work emphasizes the importance of estimating flow and turbulence conditions in energetic systems to understand turbulent sites better and improve resource characterization.

16 TIDAL AND WAVE POWER↗

Optimal Management of Grid-Interactive Efficient Buildings via Safe Reinforcement Learning

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety consequences. Besides, in GEB control applications, most existing safe RL approaches rely only on the regularisation parameters in neural networks or penalty of rewards, which often encounter challenges with parameter tuning and lead to catastrophic constraint violations. To provide enforced safety guarantees in controlling GEBs, this paper designs a physics-inspired safe RL method whose decision-making is enhanced through safe interaction with the environment. Different energy resources in GEBs are optimally managed to minimize energy costs and maximize customer comfort. The proposed approach can achieve strict constraint guarantees based on prior knowledge of a set of developed hard steady-state rules. Simulations on the optimal management of GEBs, including heating, ventilation, and air conditioning (HVAC), solar photovoltaics, and energy storage systems, demonstrate the effectiveness of the proposed approach.

Huo, Xiang↗

Microbiome Adaptation Could Amplify Modeled Projections of Global Soil Carbon Loss With Climate Warming

Warming alters soil microbial traits through ecological and evolutionary processes, directly influencing the decomposition of organic matter, which significantly affects global soil carbon emissions. Yet, soil carbon models largely ignore these processes and their implications for global responses to warming. Here, we incorporate eco-evolutionary theory into a mechanistic model describing microbial soil carbon decomposition to address the question of whether such processes could have consequential effects on climate carbon feedbacks globally. We assume that a key trait of microbes, their resource allocation to production of exoenzymes (which facilitate decomposition of organic matter)—is optimized to environmental temperatures by natural selection. We find that eco-evolutionary optimization results in microbes allocating more resources to enzyme production under warming. When applied at the global scale, eco-evolutionary optimization enhances the biological realism of soil carbon models and significantly amplifies global soil carbon loss by 2100. Our results highlight the significant potential of microbial eco-evolutionary responses to influence carbon cycle feedbacks to climate change, and motivate an urgent need for more comprehensive data to accurately quantify the adaptive potential of microbiomes in response to climate change.

Biodiversity & Conservation↗

Optimizing Energy Use in Pulp & Paper with DOE’s Energy Intensive Industries Resources

The U.S. pulp and paper industry is the third-largest energy consumer in manufacturing, accounting for roughly 10% of sector energy use. Improving energy efficiency reduces operating costs and strengthens competitiveness. To support this effort, the U.S. Department of Energy (DOE), through Oak Ridge National Laboratory (ORNL), launched the Energy Intensive Industries (EII) Initiative. A two-year pilot across 45 industrial sites identified more than 4 trillion Btu/year in potential energy savings. This presentation outlines plans for a follow-up technical assistance program tailored to pulp and paper mills. Available resources include a cost-savings scoping tool, implementation planning guidance, and technical support for applying advanced methods such as Pinch Analysis for integrated process-utilities optimization. The session introduces key Pinch Analysis principles and highlights case studies demonstrating measurable improvements. ORNL also seeks industry feedback on barriers to efficiency improvements, including technology gaps and resource needs. DOE’s broader objective is to accelerate productivity and economic competitiveness across U.S. energy-intensive industries.

Kamath, Dipti [ORNL] (ORCID:0000000278739994)↗

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗