Agent Path Optimizations with PADL on 2D Grids: Behavioral Analysis, Performance Metrics, and Stability Considerations
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
The development of efficient and sustainable hydrogen storage materials is a key challenge for realizing hydrogen as a clean and flexible energy carrier. Among various options, metal hydrides offer high volumetric storage density and operational safety, yet their application is limited by thermodynamic, kinetic, and compositional constraints. In this work, we investigate the potential of machine learning (ML) to predict key thermodynamic properties—equilibrium plateau pressure, enthalpy, and entropy of hydride formation—based solely on alloy composition using Magpie-generated descriptors. We significantly expand an existing experimental dataset from ~400 to 806 entries and assess the impact of dataset size and data augmentation, using the PADRE algorithm, on model performance. Models including Support Vector Machines and Gradient Boosted Random Forests were trained and optimized via grid search and cross-validation. Results show a marked improvement in predictive accuracy with increased dataset size, while data augmentation benefits are limited to smaller datasets and do not improve accuracy in underrepresented pressure regimes. Furthermore, clustering and cross-validation analyses highlight the limited generalizability of models across different material classes, though high accuracy is achieved when training and testing within a single hydride family (e.g., AB2). The study demonstrates the viability and limitations of ML for accelerating hydride discovery, emphasizing the importance of dataset diversity and representation for robust property prediction.
As machine learning becomes more integrated into atmospheric science, XGBoost has gained popularity for its ability to assess the relative contributions of influencing factors in the atmospheric boundary layer height. To examine how these factors vary across seasons, a seasonal analysis is necessary. However, dividing data by season reduces the sample size, which can affect result reliability and complicate factor comparisons. To address these challenges, this study replaces default parameters with grid search optimization and incorporates cross-validation to mitigate dataset limitations. Using XGBoost with four years of data from the atmospheric radiation measurement (ARM) (Southern Great Plains (SGP) C1 site, cross-validation stabilizes correlation coefficient fluctuations from 0.3 to within 0.1. With optimized parameters, the R value can reach 0.81. Analysis of the C1 site reveals that the relative importance of different factors changes across seasons. Lower tropospheric stability (LTS, ~0.53) is the dominant factor at C1 throughout the year. However, during DJF, latent heat flux (LHF, 0.44) surpasses LTS (0.22). In SON, LTS (0.58) becomes more influential than LHF (0.18). Further comparisons among the four long-term SGP sites (C1, E32, E37, and E39) show seasonal variations in relative importance. Notably, during JJA, the differences in the relative importance of the three factors across all sites are lower than in other seasons. This suggests that boundary layer development in the summer is not dominated by a single factor, reflecting a more intricate process likely influenced by seasonal conditions such as enhanced convective activity, higher temperatures, and humidity, which collectively contribute to a balanced distribution of parameter impacts. Furthermore, the relative importance of LTS gradually increases from morning to noon, indicating that LTS becomes more significant as the boundary layer approaches its maximum height. Consequently, the LTS in the early morning in autumn exhibits greater relative importance compared to other seasons. This reflects a faster development of the mixing layer height (MLH) in autumn, suggesting that it is easier to retrieve the MLH from the previous day during this period. The findings enhance understanding of boundary layer evolution and contribute to improved boundary layer parameterization.
Explore the source record for details and available documents.
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.
Recent research has shown the effectiveness of reinforcement learning (RL) in coordinating electric vehicles (EVs) with vehicle-to-grid capabilities for grid services. However, many of these studies rely on lookup table and deep Q-network techniques, which can be impractical when dealing with continuous states and actions. In addition, existing RL designs inadequately account for battery aging effects, EV user satisfaction, uncertain departure and arrival time, and trip distance, which may compromise effective coordination. This paper aims to bridge these gaps by developing an innovative deep deterministic policy gradient-based RL framework for optimal coordination of EVs. Case studies were carried out using a test system with 100 EVs, and numerical analysis results showed that the proposed RL framework can effectively coordinate EVs to maximize economic benefits and user satisfaction while ensuring the expected battery lifespan.
The electrical distribution landscape is rapidly transforming due to the proliferation of distributed energy resources (DERs) such as solar panels, wind turbines, battery storage systems, combined heat and power units, and electric vehicles, introducing variability and uncontrollability that traditional grid operators are ill-equipped to manage. This transformation is further accelerated by advancements in Information and Communication Technology infrastructure that connects control centers with end devices, demanding automation and a deeper understanding of new technologies by utility personnel. Advanced grid control techniques using system-level optimization, Artificial Intelligence, and Machine Learning at the enterprise level and distributed level are evolving to address these issues. There is also an opportunity to utilize the enormous data created by these new DER technologies in the grid. Advanced Distribution Management Systems (ADMS) and Distributed Energy Resource Management Systems (DERMS) are critical in addressing these challenges by automating grid operations and enhancing reliability. Given the relatively recent development of ADMS and DERMS, and the still relatively low level of ADMS and DERMS deployment in the industry, there is a notable deficiency in the comprehensive understanding of the challenges and benefits associated with these new technologies, especially with their complementary natures and integration architectures. This paper aims to bridge the knowledge gap in ADMS and DERMS integration, presenting three distinct integration architectures currently available, and discussing the challenges and benefits of each architecture to guide utilities, industry professionals, and researchers in optimizing grid management and decision-making processes for a resilient and efficient energy future.
Explore the source record for details and available documents.
This talk goes into the algorithmic work done under the Forest project in order to solve expensive power grid models. We explore multiple fidelities of models that balance accuracy and computational expense. We use bundling strategies and progressive hedging in order to parallelize large stochastic programs.
This paper describes early experiences and example use cases applying multi-disciplinary design analysis and optimization (MDO) to the integrated design of power grids. Adapted from aerospace, MDO enables combining multiple existing tools into a coordinated optimization. Here we use MDO to simultaneously capture integrated transmission-distribution and investment-engineering trade-offs in an automated framework. Example use cases showcase prototype interactions among existing grid models using MDO and hint at the types of integrated analyses enabled by this approach. In addition, we share experiences and thoughts on grid-specific challenges and opportunities to help advance further work in this area.
This study provides a comparative analysis of grid-connected PV-integrated battery storage at individual and community scales. The paper addresses the challenge of managing energy demand-generation mismatch by using a battery energy storage optimization algorithm, which minimizes operational costs while accounting for battery degradation. Also, this work introduces a broader evaluation basis that includes seasonal variability, grid exchange smoothness, and scalability across different battery capacities. Results show that community-scale storage more effectively dampens grid exchange power fluctuations and reduces system costs, particularly with moderate price differences between electricity buying and selling prices and low battery capacities. The paper also analyzes the impacts of static control versus cost-optimized battery system management. Here, it is shown that the gap in system costs between the cost-optimized and static control scenarios widens as the price difference increases.
Seaports are vital economic hubs that allow the United States to compete on a global scale. But the heavy vehicles and cargo equipment that enable their operations also emit harmful air pollutants and greenhouse gas emissions. For nearly two decades, National Renewable Energy Laboratory (NREL) researchers have worked toward comprehensive seaport decarbonization. They fuse world-class analysis with deep vehicle and transportation systems knowledge to guide strategic deployment of low- and zero-emissions vehicles, charging and refueling infrastructure, and grid improvements. Together, these capabilities can enable sustainable port operations. This fact sheet outlines major seaport and airport decarbonization capabilities across the laboratory, including: fleet research, energy data, and insights for decarbonization; comprehensive hydrogen infrastructure deployment; optimized charging through grid integration; strategic blueprinting for clean, optimized technology deployment; and integrating diversity, equity, inclusion, and accessibility considerations into decarbonization efforts.
With Measurements of grid voltage and current are essential for the optimal operation of the grid protection and control (P&C) systems. Grid parameters vary through time during the faults and especially in the converter interfaced resources (CIRs) rich power grid, and thus accurate estimation is critical to avoid the mis-operation of the P&C systems. In this paper, a moving horizon estimation (MHE) as an observer is devised and applied to estimate the grid line parameters and grid voltages for protection enhancement. Due to the proprietary and confidentiality of CIRs, the proposed approach uses the black-box model to represent their dynamics. Leveraging the easily accessible measurements of output current from the black-box model of CIR and voltage at the point of common coupling, the proposed method estimates the grid impedance and grid voltage during normal and faulty operating conditions. The performance shows that the optimization-based observer was able to closely observe the accurate states and parameters, which can be utilized by the P&C systems.
Traditional monofacial photovoltaic (mPV) systems are commonly adopted and well-documented because of their lower upfront costs in comparison to bifacial photovoltaic (bPV) systems. This study investigates how PV technologies impact energy storage in grid-scale hybrid renewable systems, focusing on optimizing and assessing the performance of mPV and bPV technologies integrated with pumped storage hydropower. Using Ludington City, Michigan as a case study and analyzing real-world data such as solar irradiance, ambient temperature, and utility-scale load profiles, the research highlights the operational and economic benefits of bPV systems. The results reveal that bPV systems can pump approximately 10.38% more water annually to the upper reservoir while achieving a lower levelized cost of energy ($0.0578/kWh for bPV vs. $0.0672/kWh for mPV). This study underscores the outstanding potential of bPV systems in enhancing energy storage and management strategies, contributing to a more sustainable and resilient renewable energy future.
SAND2026-19433O The nnopf tool addresses the optimal power flow (OPF) problem by optimizing electricity delivery from generating plants to consumers. At the same time, it minimizes costs and adheres to power grid constraints. While traditional methods for solving OPF can be computationally intensive, the tool mitigates this challenge by training neural networks on power grids to predict optimal solutions for the OPF problem. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.
Conventional dual fuel heat pumps lack the intelligent control mechanisms to efficiently manage the switch between heat pump and furnace, leading to sub-optimal energy usage and, in some cases, increased operating costs. To resolve this gap, this study applies optimized control on hybrid heat pumps. With a focus on equipment control strategies, we compare the performances of five spacing heating equipment, including a conventional heat pump (HP), a conventional furnace, a dual fuel heat pump (DFHP) with conventional control, a dual fuel heat pump with smart control, and a novel seamlessly fuel flexible heat pump (SFFHP). While DFHP runs on either gas or electricity at any given moment, SFFHP concurrently consumes gas and electricity by continuously optimizing the proportion of each. In this research, a co-simulation framework is developed by integrating a building envelope model with a physics-based heat pump simulation model to analyze the benefits of grid-responsive controls of DFHP and SFFHP. The model-based optimal controls adjust the operation of the heat pump and gas furnace based on utility price signals and marginal grid emission to minimize utility cost and CO 2 emissions for multiple climate zones, different utility tariffs, and marginal grid emission scenarios. Case studies in Chicago and Los Angeles demonstrate that SFFHP and DFHP, with model-based optimal control, can deliver significant reductions in peak demand, utility cost, and CO 2 emission. In Chicago, SFFHP and smart controlled DFHP yield up to 64.7% and 61.7% utility cost reduction and up to 15.7% and 8.5% CO 2 emission reduction compared to the gas furnace. In Los Angeles, SFFHP and smart controlled DFHP achieve up to 43.6% and 40.1% utility cost reduction and up to 13.8% and 14.1% CO2 emission reduction compared to conventional heat pumps. In conclusion, by leveraging the fuel flexibility nature of dual fuel heat pumps, the model-based control optimization approach makes dual fuel heat pump an attractive option for demand response programs.
Reducing buildings’ carbon emissions is an important sustainability challenge. While scheduling flexible building loads has been previously used for a variety of grid and energy optimizations, carbon footprint reduction using such flexible loads poses new challenges since such methods need to balance both energy and carbon costs while also reducing user inconvenience from delaying such loads. This paper highlights the potential conflict between electricity prices and carbon emissions and the resulting trade-offs in carbon-aware and cost-aware load scheduling. To address this trade-off, we propose GreenThrift, a home automation system that leverages the scheduling capabilities of smart appliances and knowledge of future carbon intensity and cost to reduce both the carbon emissions and costs of flexible energy loads. At the heart of GreenThrift is an optimization technique that automatically computes schedules based on user configurations and preferences. We evaluate the effectiveness of GreenThrift using real-world carbon intensity data, electricity prices, and load traces from multiple locations and across different scenarios and objectives. Our results show that GreenThrift can replicate the offline optimal and retains 97% of the savings when optimizing the carbon emissions. Moreover, we show how GreenThrift can balance the conflict between carbon and cost and retain 95.3% and 85.5% of the potential carbon and cost savings, respectively.
Wastewater treatment plants (WWTPs) offer opportunities to optimize resource utilization and enhance energy efficiency. Here, this study provides a comprehensive analysis of using the polygeneration approach in WWTPs to reduce grid energy dependence, optimize energy distribution, and utilize surplus energy for hydrogen (H 2 ) and ammonia (NH 3 ) production. Several models were employed, including photovoltaic (PV) cells, parabolic trough collectors (PTCs), steam methane reforming, and polymer electrolyte membranes, to assess the feasibility of this approach. Three scenarios were evaluated and compared: Scenario 1 (Baseline) represents the current situation, Scenario 2 maximizes the Net Present Value (NPV), and Scenario 3 minimizes NH 3 production costs. Real data from As-Samra WWTP in Jordan was used to accurately assess the feasibility of each scenario. The results show that Scenario 2 offers the highest profitability and efficiency, with a NPV of 87.48 million USD and an annual NH 3 production of 15,417 tons, reducing both grid dependency and biogas fuel consumption. Both Scenarios 2 and 3 demonstrate the ability to meet thermal demands efficiently while generating significant revenue from NH 3 production. Scenario 3, in particular, achieves competitive H 2 and NH 3 production costs. Environmentally, Scenario 2 significantly reduces annual greenhouse gas emissions by 12.66 kilotons of CO 2eq , with near-zero carbon intensity for thermal energy due to solar reliance. In conclusion, the polygeneration approach offers a promising pathway for WWTPs to achieve greater sustainability, economic gains, and reduced environmental impact, providing valuable insights for decision-makers.