Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “grid optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Ten questions concerning reinforcement learning for building energy management

As buildings account for approximately 40% of global energy consumption and associated greenhouse gas emissions, their role in decarbonizing the power grid is crucial. The increased integration of variable energy sources, such as renewables, introduces uncertainties and unprecedented flexibilities, necessitating buildings to adapt their energy demand to enhance grid resiliency. Consequently, buildings must transition from passive energy consumers to active grid assets, providing demand flexibility and energy elasticity while maintaining occupant comfort and health. This fundamental shift demands advanced optimal control methods to manage escalating energy demand and avert power outages. Reinforcement learning (RL) emerges as a promising method to address these challenges. Here, in this paper, we explore ten questions related to the application of RL in buildings, specifically targeting flexible energy management. We consider the growing availability of data, advancements in machine learning algorithms, open-source tools, and the practical deployment aspects associated with software and hardware requirements. Our objective is to deliver a comprehensive introduction to RL, present an overview of existing research and accomplishments, underscore the challenges and opportunities, and propose potential future research directions to expedite the adoption of RL for building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine learning and deep learning for mineralogy interpretation and CO 2 saturation estimation in geological carbon Storage: A case study in the Illinois Basin

Carbon capture and storage (CCS) is a promising approach to simultaneously maintaining energy security and reducing carbon dioxide (CO 2 ) emissions under the current energy portfolio that is dominated by fossil fuel energy. Pre-injection formation characterization and post-injection CO 2 monitoring are two critical tasks to guarantee storage efficiency in CCS. The CCS projects in the Illinois Basin, the first large-scale CO 2 injection into saline aquifers in the United States, employed conventional and the latest pulsed neutron logging (PNL) tools for mineralogy interpretation and CO 2 saturation estimation, which provide valuable references for future CCS projects. Because of the inherent fuzziness of petrophysical measurements and complex subsurface heterogeneity, interpreting well-logging data is time-consuming, and its accuracy can be user-biased. In recent years, data-driven methods have been widely used to capture the non-linear patterns between input features and interpretation results. This work applied and evaluated four commonly used machine learning (ML) models, including ridge regression (RR), random forest (RF), gradient boosting regression (GBR), support vector regression (SVR), and one deep learning (DL) model, the artificial neural network (ANN). We optimized the hyperparameters of the four ML models and the DL model using the simulated annealing algorithm and the grid search strategy, respectively. The input features of the mineralogy interpretation models were eleven conventional well-logging parameters, and the label data (i.e., ground truth) were the porosity and volumetric fractions of six minerals, including quartz, feldspar, dolomite, calcite, clay, and iron minerals. The results demonstrated that the GBR and RF models were superior in predicting volumetric fractions of minerals and porosity; label data with low coefficient of variation (CV) values tended to yield better performance. For CO 2 saturation estimation, the RF was the best-performing model, followed by SVR, ANN, GBR, and RR. Furthermore, we conducted feature importance ranking using the permutation importance algorithm and found that the formation sigma and well pressure were the most important features in this study. In conclusion, the study of CCS projects in the Illinois Basin bridges the gap between the limited knowledge and understanding of geological carbon storage and the increasing demand for reliable, cost-effective, and sustainable energy solutions.

58 GEOSCIENCES↗

Reaction Mechanism of Electrodeposited ε-MnO 2 : A Proton-Centered Pathway in Aqueous Zn-Ion Systems

Aqueous Zn/MnO 2 batteries have garnered significant interests owing to their abundance, high theoretical specific capacity, safety, and low cost. However, large-scale application of these systems is limited by the incomplete understanding of the MnO 2 reaction chemistry. The different crystal lattice structures among MnO 2 polymorphs contribute to the variations in reported reaction mechanisms. Among them, ε-MnO 2 polymorph, the dominant phase in electrolytic manganese dioxide (EMD), is notably observed during the charge cycles of aqueous Zn/MnO 2 batteries. Here, in this work, we investigate the electrochemical behavior of an ε-MnO 2 cathode synthesized via electrodeposition from a ZnSO 4 and MnSO 4 electrolyte, onto a 3-dimensional carbon cloth substrate. Proton intercalation emerges as the dominant charge storage mechanism, critically enabling the reversibility of ε-MnO 2 during cycling, as revealed by operando synchrotron X-ray diffraction and X-ray absorption spectroscopy. Additionally, a proton-coupled dissolution/redeposition pathway operates alongside minor Zn 2+ intercalation, as quantified by Rietveld refinement. Morphological and chemical heterogeneities are studied by transmission X-ray microscopy further validates this reaction mechanism. These mechanistic insights provide the foundation for rationally designing Zn/MnO 2 batteries with optimized proton dynamics and charge transfer, advancing these systems as a viable solution for safe, cost-effective grid-scale energy storage.

36 MATERIALS SCIENCE↗

Data-driven deconvolution for large eddy simulations of Kraichnan turbulence

In this article, we demonstrate the use of artificial neural networks as optimal maps which are utilized for convolution and deconvolution of coarse-grained fields to account for sub-grid scale turbulence effects. Here, we demonstrate that an effective eddy-viscosity is predicted by our purely data-driven large eddy simulation framework without explicit utilization of phenomenological arguments. In addition, our data-driven framework precludes the knowledge of true sub-grid stress information during the training phase due to its focus on estimating an effective filter and its inverse so that grid-resolved variables may be related to direct numerical simulation data statistically. The proposed predictive framework is also combined with a statistical truncation mechanism for ensuring numerical realizability in an explicit formulation. Through this, we seek to unite structural and functional modeling strategies for modeling non-linear partial differential equations using reduced degrees of freedom. Both a priori and a posteriori results are shown for a two-dimensional decaying turbulence case in addition to a detailed description of validation and testing. A hyperparameter sensitivity study also shows that the proposed dual network framework simplifies learning complexity and is viable with exceedingly simple network architectures. Our findings indicate that the proposed framework approximates a robust and stable sub-grid closure which compares favorably to the Smagorinsky and Leith hypotheses for capturing the theoretical k -3 scaling in Kraichnan turbulence.

42 ENGINEERING↗

Phasor Based Control with the Distributed, Extensible Grid Control Platform

This paper describes how to implement Phasor Based Control (PBC) using the Distributed, Extensible Grid Control (DEGC) Platform. PBC is a novel method for controlling distributed energy resources (DER) that coordinates a centralized optimization with distributed feedback controllers to enforce voltage phasor targets. DEGC is an open source software and communication platform designed for general DER control. We deployed PBC at Lawrence Berkeley Lab's FLEXLAB test site, conducting multiple hardware-in-the-loop test runs. Here, we describe how DEGC was used to implement PBC on hardware, and results demonstrating successful deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PMU and Communication Infrastructure Restoration for Post-Attack Observability Recovery of Power Grids

This paper is concerned about recovering the observability of cyber-physical power grids after massive cyber attacks, which helps to achieve the cyber-physical resilience of the grids. For recovering the observability of the grid, the measurability of the Phasor Measurement Units (PMUs) and the connectivity of the communication network are needed to be restored. The PMU and communication infrastructure restoration problem is jointly formulated as a Mixed Integer Linear Programming (MILP) problem to minimize the observability loss of the grid over time after a cyber attack while considering the constraint of limited resources. The efficacy of the proposed optimal restoration strategy is verified by comparing with heuristic methods on the IEEE 57-bus system.

cyber security↗

Generic Discretization Library

The GenDiL library is a collection of C++ software abstractions designed to discretize and solve partial differential equations (PDEs) for high-performance computing (HPC) applications. Its primary focus is on modern C++ generic programming, which helps ensure portability across various hardware architectures. The central idea behind the library is to provide building blocks for numerical algorithms-such as discretization methods and iteration patterns-so that domain experts can focus on the math, rather than the low-level details of hardware or implementation. By defining abstractions for data types, iteration over computational grids, and scheduling of operations, the library isolates the high-level PDE algorithms from the platform-specific optimizations needed to achieve efficient performance.

Dudouit, Yohann [Lawrence Livermore National Labor↗

Direct Drive Wave Energy Buoy

This Project aims to satisfy objectives of the DOE’s Water Power Program by completing a system detailed design (SDD) and other important activities in the first phase of a utility-scale grid-connected ocean wave energy demonstration. In early 2012, Columbia Power (CPwr) had determined that further cost and performance optimization was necessary in order to commercialize its StingRAY wave energy converter (WEC). CPwr’s progress toward commercialization, and the requisite technology development path, were focused on transitioning toward a commercial-scale demonstration. This path required significant investment to be successful, and the justification for this investment required improved annual energy production (AEP) and lower capital costs. Engineering solutions were developed to address these technical and cost challenges, incorporated into a proposal to the US Department of Energy (DOE), and then adapted to form the technical content and statement of project objectives of the resulting Project (DE-EE0005930). Through Project cost-sharing and technical collaboration between DOE and CPwr, and technical collaboration with Oregon State University (OSU), National Renewable Energy Lab (NREL) and other Project partners, we have demonstrated experimentally that these conceptual improvements have merit and made significant progress towards a certified WEC system design at a selected and contracted deployment site at the Wave Energy Test Site (WETS) at the Marine Corps Base in Oahu, HI (MCBH).

16 TIDAL AND WAVE POWER↗

Igiugig Site Visit Report

The National Renewable Energy Laboratory (NREL) team conducted a site visit during January 23-25, 2019 with the Igiugig Village Council (IVC) and other stakeholders to assist the community of Igiugig in refining their long-term energy strategy. The agenda included a tour of the village, data collection, presentations, long-term visioning exercises, identification of energy scenarios, and a school presentation. Participants in the site visit activities spanned a range of local, regional, government, and industry participation. There were 24 attendees at the all-day community workshop on Thursday, January 24th, with participants from the IVC, NREL, Bristol Bay Native Association (BBNA), Bristol Bay Native Corporation (BBNC), Lake and Peninsula Borough, Alaska Energy Authority, Intergrid, ORPC, Deer Stone Consulting, the Southwest Alaska Municipal Conference, and University of Alaska Fairbanks - Alaska Center for Energy and Power. Igiugig is a well-organized rural Alaskan community, with a leadership team that appears to have broad community support. The use of consensus-based decision making is one tangible example of how the leadership team actively invokes and promotes community-focused thinking. The NREL team observed anecdotal evidence of how this approach seems to be strengthening the community: active participation in the visioning exercise, a student hosted fund-raiser dinner at the school, a clean and organized landfill, and well-maintained roads and buildings. Igiugig has wind, solar, and river hydrokinetic resources readily available within the community. Wind has shown to be a promising resource in the region, and has been integrated into microgrids around the state, but the community has had mixed success with wind technologies: some devices failed quickly and others continue to operate. The economics of solar energy are improving in Alaska, and economical solar projects are being installed around the state. Considering that economic activity in Igiugig peaks during the summer sport fishing season, solar could prove to be a valuable supplement to the electrical system. Igiugig has been a test site for two different river hydrokinetic devices, and they have began a third project to operate ORPC's RivGen device, which is delivering valuable device performance data, operations and maintenance experience, and design refinement information. Already, this device has made over 7-million revolutions, and delivered over 8 MWh of power to the community. Igiugig's river resource is fairly unique because it is available year-round and has the potential to provide reliable base-load power for months at a time. A preliminary investigation of this diverse resource mix suggests that Igiugig could achieve very high levels (70% or more) of annual renewable generation contributions. A critical step in pursuing this path is identifying the mix of energy assets (generation and storage) that best meets the community's budget, needs, and goals. The assets that a community installs early in their grid-modernization initiative can constrain the options that are economical at later stages, which may lead to sub-optimal solutions. This is where technical and economic analysis of potential scenarios (i.e., distinct mixes of energy assets) can be useful in identifying the most promising pathways so that a community can make informed and strategic decisions about the assets they install. These analyses are most accurate and informative when they are based on actual technology performance and cost data. As the RivGen project continues to operate and generate this data, we will be better prepared to evaluate the technology's long-term viability and to identify research areas that would improve it. Igiugig's energy projects are at the cutting edge of two intersecting technology areas: 1) deploying an operational river hydrokinetic turbine, and 2) integrating renewable energy sources to achieve very high percent renewables. If these projects are successful, the lessons learned and technologies developed could be valuable for other microgrids around the world. Igiugig's unique resource mix make it an ideal location for this work, and the community's organizational strength make it an ideal partner in this ground-breaking work. Ongoing support for technical assistance to manage and address technical challenges along the way will maximize the probability of project success.

13 HYDRO ENERGY↗

Hardware-in-the-Loop Evaluation for Potential High Limit Estimation-Based PV Plant Active Control: Preprint

This paper validates the effectiveness of an Artificial Intelligence (AI)-driven PV plant control and optimization approach, namely, the Automated Learner for Intermittency Control by Extrapolation (ALICE), in empowering PV plant as a dependable grid reliability service provider. The validation is performed in a realistic laboratory controller-hardware-in-the-loop (CHIL) environment, leveraging accurate PV plant modeling and standard industrial communication protocol. Simulation results, considering both varying weather conditions and active control scenarios, demonstrate the superior performance of ALICE in improving the grid service delivery precision and reducing the over-curtailment compared to a state-of-the-art approach, i.e., reference-control grouping based approach. Such a work could help mitigate risks and provide practical guidance during the field deployment of ALICE, while establishing a standardized testing framework for evaluating various PV active control strategies.

hardware-in-the-loop↗

Mapped Moments to a Cartesian Grid (MMCG) Value-Added Product Report

Objective analysis (OA) is a method of mapping unstructured data to a structured grid. In the context of scanning radar data, OA is used to interpolate data in antenna coordinates (range, azimuth, and elevation) onto a regularly spaced Cartesian grid (Trapp and Doswell 2000). The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Mapped Moments to a Cartesian Grid (MMCG) Value-Added Product (VAP) uses the Python ARM Radar Toolkit (Py-ART), a data model-driven interactive architecture for working with weather radar data, to map the data to a Cartesian grid (Helmus and Collis 2016). MMCG, with Py-ART built in, has the ability to take radar data in antenna coordinates and map the gates to a Cartesian grid using inverse distance weight functions such as Cressman (square) and Barnes (exponential), but also can filter the data during the interpolation. MMCG also allows arbitrary formulations for the radius of influence, which are matched to particular radar scanning strategies. This creates a complex parameter space for optimizing the retention of storm structure detail while minimizing artifacts. MMCG takes data processed with ARM’s Corrected Precipitation Radar Moments in Antenna Coordinates (CMAC) VAP and maps it to a Cartesian grid as the output product. A variety of fields that have been mapped to the Cartesian grid are then saved to plots to complement each grid file.

54 ENVIRONMENTAL SCIENCES↗

Co-optimized trading of hybrid wind power plant with retired EV batteries in energy and reserve markets under uncertainties

To be competitive in the electricity markets, various technologies have been reported to increase profits of wind farm owners. Combining battery storage system, wind farms can be operated as conventional power plants which promotes the integration of wind power into the power grid. However, high expenses on batteries keep investors away. Retired EV batteries, fortunately, still have enough capacity to be reused and could be obtained at a low price. In this work, a two-stage optimization of a wind energy retired EV battery-storage system is proposed. The economic performance of the proposed system is examined concerning its participation in the frequency containment normal operation reserve (FCR-N) market and the spot market simultaneously. To account uncertainties in the wind farm output, various electricity market prices, and up/down regulation status, a scenario-based stochastic programming method is used. The sizing of the equipment is optimized on top of daily operations of the hybrid system which formulates a mixed-integer linear programming (MILP) problem. Scenarios are generated with the Monte Carlo simulation (MCS) and Roulette Wheel Mechanism (RWM), which are further reduced with the simultaneous backward method (SBM) to increase computational efficiency. A 21 MW wind farm is selected as a case study. Here, the optimization results show that by integrating with a retired EV battery-storage system (RESS) and a bi-directional inverter, the wind farm can increase its profits significantly when forwarding bids in both of the aforementioned electricity markets.

17 WIND ENERGY↗

A Fast Dynamic Internal Predictive Power Scheduling Approach for Power Management in Microgrids: Preprint

This paper presents a Dynamic Internal Predictive Power Scheduling (DIPPS) approach for optimizing power management in microgrids, particularly focusing on external power exchanges among diverse prosumers. DIPPS utilizes a dynamic objective function with a time-varying binary parameter to control the timing of power transfers to the external grid, facilitated by efficient usage of energy storage for surplus renewable power. The microgrid power scheduling problem is modeled as a mixed-integer nonlinear programming (MINLP-PS) and subsequently transformed into a mixed-integer linear programming (MILPPS) optimization through McCormick's relaxation to reduce computational complexity. A predictive window window with 6 data points is solved at an average of 0.92s, a 97.6% improvement over the 38.27s required for the MINLP-PS formulation, implying the numerical feasibility of the DIPPS approach for real-time implementation. Finally, the approach is validated against a static objective using real-world load data across three case studies with different time-varying parameters, demonstrating the ability of DIPPS to optimize power exchanges and efficiently utilize distributed resources while shifting the external power transfers to specified time durations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Real-Time Control of an Ensemble of Heterogeneous Resources

This paper focuses on the problem of controlling an ensemble of heterogeneous resources connected to an electrical grid at the same point of common coupling (PCC). The controller receives an aggregate power setpoint for the ensemble in real time and tracks this setpoint by issuing individual optimal setpoints to the resources. The resources can have continuous or discrete nature (e.g., heating systems consisting of a finite number of heaters that each can be either switched on or off) and/or can be highly uncertain (e.g., photovoltaic (PV) systems or residential loads). A naive approach would lead to a stochastic mixed-integer optimization problem to be solved at the controller at each time step, which might be infeasible in real time. Instead, we allow the controller to solve a continuous convex optimization problem and compensate for the errors at the resource level by using a variant of the well-known error diffusion algorithm. We give conditions guaranteeing that our algorithm tracks the power setpoint at the PCC on average while issuing optimal setpoints to individual resources. We illustrate the approach numerically by controlling a collection of batteries, PV systems, and discrete loads.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Mid-Atlantic Offshore Wind Interconnection and Transmission (MAOWIT)

This project has carried out a detailed analysis to evaluate the pros and cons of offshore transmission, a possible method to decrease balance-of-system costs and permitting time identified in the DOE Office Wind Strategic Plan (DOE, 2011). It also addresses questions regarding the adequacy of existing transmission infrastructure and the ability of existing generating resources to provide the necessary Ancillary Services (A/S) support (spinning and contingency reserves) in the ISO territory. This project has completed the tasks identified in the proposal: 1. Evaluation of the offshore wind resource off PJM, then examination of offshore wind penetrations consistent with U.S. Department of Energy’s (DOE) targets and with their assumed resource size (DOE, 2011). 2. Comparison of piecemeal radial connections to the Independent System Operator (ISO) with connections via a high-voltage direct current (HVDC) offshore network similar to a team partner. 3. High-resolution examination of power fluctuations at each node due to wind energy variability 4. Analysis of wind power production profiles over the Eastern offshore region of the regional ISO to assess the effectiveness of long-distance, North- South transmission for leveling offshore wind energy output 5. Analysis of how the third and fourth items affect the need for ISO grid upgrades, congestion management, and demand for Ancillary Services (A/S) 6. Analysis of actual historic 36-hr and 24-hr forecasts to solve the unit commitment problem and determine the optimal mix of generators given the need to respond to both wind variability and wind forecasting uncertainties.

17 WIND ENERGY↗

The Demand-Side Opportunity: The Roles of Distributed Solar and Building Energy Systems in a Decarbonized Grid

Building energy systems represent a significant and largely untapped demand-side grid resource. Buildings use about 75% of electricity in the United States, including around 80% of peak demand, meaning that changes in building energy use have significant implications for grid operations. Building energy technologies-including energy-efficient devices, flexible loads, and energy storage-can be coordinated and aggregated to perform similar functions as centralized grid assets. Recent advances in information and communication (ICT) technologies have significantly improved building energy technology automation, coordination, and aggregation capabilities. With declining costs and technological advances, building energy systems can increasingly compete with conventional grid assets such as natural gas plants. Building energy technologies enable the deployment of distributed solar photovoltaics (DPV). Energy-efficient buildings allow DPV to meet greater shares of building load while flexible loads and energy storage can reshape building load profiles to optimize the on-site use of DPV. Optimized on-site use of DPV increases the value proposition for DPV adoption and can help utilities cost-effectively integrate higher levels of DPV penetration. Together, DPV and building energy technologies could help grids achieve deep decarbonization more quickly and cost-effectively.

14 SOLAR ENERGY↗

Optimal Solar PV Arrays Integration for Distributed Generation

Solar photovoltaic (PV) systems hold great potential for distributed energy generation by installing PV panels on rooftops of residential and commercial buildings. Yet challenges arise along with the variability and non-dispatchability of the PV systems that affect the stability of the grid and the economics of the PV system. This paper investigates the integration of PV arrays for distributed generation applications by identifying a combination of buildings that will maximize solar energy output and minimize system variability. Particularly, we propose mean-variance optimization models to choose suitable rooftops for PV integration based on Markowitz mean-variance portfolio selection model. We further introduce quantity and cardinality constraints to result in a mixed integer quadratic programming problem. Case studies based on real data are presented. An efficient frontier is obtained for sample data that allows decision makers to choose a desired solar energy generation level with a comfortable variability tolerance level. Sensitivity analysis is conducted to show the tradeoffs between solar PV energy generation potential and variability.

Omitaomu, Olufemi A↗