Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

New approach based on group technology for the consolidation problem in cloud computing-mathematical model and genetic algorithm

Resource management is a hotspot issue in distributed systems like cloud computing (CC). It means how to prepare the computational resources, i.e., servers and virtual machines (VMS), to execute the tasks. This paper offers a new approach based on Group Technology (GT)—known as a powerful philosophy for the resource management in cellular manufacturing systems—to deal with the resource management problem in CC. We develop a mathematical model to optimally consolidate the VMs, servers and tasks simultaneously to control several important factors such as task migrations and server load variation, as well as the number of VMs. To test the validity of our proposed model, several small problems are generated randomly and solved by LINGO 9 software. Furthermore, to cope with larger problems, which cannot be solved optimally, a genetic algorithm is proposed. We, finally, compare our methods with the most well-known algorithms in this context, round robin (RR) and first-come, first-served (FCFS) algorithms.

97 MATHEMATICS AND COMPUTING↗

Use of DAGMan in CRAB3 to improve the splitting of CMS user jobs

CRAB3 is a workload management tool used by CMS physicists to analyze data acquired by the Compact Muon Solenoid (CMS) detector at the CERN Large Hadron Collider (LHC). Research in high energy physics often requires the analysis of large collections of files, referred to as datasets. The task is divided into jobs that are distributed among a large collection of worker nodes throughout the Worldwide LHC Computing Grid (WLCG). Splitting a large analysis task into optimally sized jobs is critical to efficient use of distributed computing resources. Jobs that are too big will have excessive runtimes and will not distribute the work across all of the available nodes. However, splitting the project into a large number of very small jobs is also inefficient, as each job creates additional overhead which increases load on infrastructure resources. Currently this splitting is done manually, using parameters provided by the user. However the resources needed for each job are difficult to predict because of frequent variations in the performance of the user code and the content of the input dataset. As a result, dividing a task into jobs by hand is difficult and often suboptimal. In this work we present a new feature called “automatic splitting” which removes the need for users to manually specify job splitting parameters. We discuss how HTCondor DAGMan can be used to build dynamic Directed Acyclic Graphs (DAGs) to optimize the performance of large CMS analysis jobs on the Grid. We use DAGMan to dynamically generate interconnected DAGs that estimate the processing time the user code will require to analyze each event. This is used to calculate an estimate of the total processing time per job, and a set of analysis jobs are run using this estimate as a specified time limit. Some jobs may not finish within the alloted time; they are terminated at the time limit, and the unfinished data is regrouped into smaller jobs and resubmitted.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning-enhanced model-based scenario optimization for DIII-D

Abstract Scenario development in tokamaks is an open area of investigation that can be approached in a variety of different ways. Experimental trial and error has been the traditional method, but this required a massive amount of experimental time and resources. As high fidelity predictive models have become available, offline development and testing of proposed scenarios has become an option to reduce the required experimental resources. The use of predictive models also offers the possibility of using a numerical optimization process to find the controllable inputs that most closely achieve the desired plasma state. However, this type of optimization can require as many as hundreds or thousands of predictive simulation cases to converge to a solution; many of the commonly used high fidelity models have high computational burdens, so it is only reasonable to run a handful of predictive simulations. In order to make use of numerical optimization approaches, a compromise needs to be found between model fidelity and computational burden. This compromise can be achieved using neural networks surrogates of high fidelity models that retain nearly the same level of accuracy as the models they are trained to replicate while reducing the computation time by orders of magnitude. In this work, a model-based numerical optimization tool for scenario development is described. The predictive model used by the optimizer includes neural network surrogate models integrated into the fast Control-Oriented Transport simulation framework. This optimization scheme is able to converge to the optimal values of the controllable inputs that produce the target plasma scenario by running thousands of predictive simulations in under an hour without sacrificing too much prediction accuracy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Energy flexibility of residential buildings: A systematic review of characterization and quantification methods and applications

With building electric demand becoming increasingly dynamic, and a growing percentage of intermittent renewable power generation from solar photovoltaics and wind turbines, the power grid is facing increasing challenge to manage the real time balance between the supply and demand. With advancements in smart sensing and metering, smart appliances, electric vehicles, and energy storage technologies, demand side management of residential buildings can help the grid to improve stability by optimizing flexible loads. This paper reviews recent studies on residential building demand side management, with a focus on characterization and quantification of energy flexibility covering various types of flexible loads, metrics, methods, and applications. The reviewed studies showed four levels of applications: building level (45%), district or community level (29%), system level (19%), and building sector level (7%). Shifting loads is the dominant flexibility type in 60% of applications, followed by shedding (19%), generation (16%), and modulating (6%). Depending on the technology and application scope, flexible operations have a wide range of performance, with peak power reductions of 1%~65%, energy savings up to 60%, operational cost reduction of 1%~48%, and greenhouse gas emission reductions of up to29%. More than half (51%) of the studies employed control strategies to achieve flexibility; among those 72% used optimal controls, while 28% used rule-based controls. About 58% of the studies used mathematical formulation to quantify energy flexibility. Most studies were based on simulation, while less than 15% of the studies had measurements from experiments or field tests. The review reveals research opportunities to address significant gaps in the existing literature: (1) establishing a common definition and performance metrics for energy flexibility of buildings that are technology and application agnostic, (2) developing an ontology to standardize representation of flexibility resources for interoperability, (3) integrating occupant impacts into the quantification and optimization of energy flexibility, and (4) developing requirements and credits of energy flexibility in building energy codes and standards. Findings from the review can inform future research and development of energy flexible buildings which are essential to a reliable and resilient power grid.

Li, H↗

A Systematic Review on Coordinated Restoration Strategies for Power Distribution Grids

Power distribution grids are increasingly exposed to High-Impact Low-Probability (HILP) events, which cause widespread disruptions with severe societal and economic impacts. The growing complexity of modern grids, driven by the integration of distributed energy resources and smart grid technologies, has introduced new challenges to effective service restoration. While significant research has explored individual restoration strategies, such as network reconfiguration and microgrid formation, limited attention has been given to methods in which they can be effectively coordinated. Furthermore, the absence of systematic review papers addressing this issue hampers the development of cohesive restoration frameworks capable of addressing the operational complexities of modern grids. This paper presents a systematic review synthesizing existing knowledge on power grid restoration, identifying key limitations, and highlighting opportunities for coordinated strategies. By addressing research gaps and emphasizing the integration of diverse approaches, this study provides critical insights for advancing grid resiliency and recovery, offering a foundation for future research and practical applications in the face of HILP events.

Systematic review↗

Coordinated Inverter Control to Increase Dynamic PV Hosting Capacity: A Real-Time Optimal Power Flow Approach

High penetrations of distributed photovoltaics (PV) could cause adverse grid impacts, such as voltage violations. The recent development in inverter technologies provides the opportunity to develop control systems to realize effective PV governance and thus to improve dynamic PV hosting capacity for distribution grids. In this paper, a novel distributed energy resource management system (DERMS) solution is proposed by adopting the real-time optimal power flow (OPF) approach for coordinated control of the distributed PV inverters. The proposed approach eliminates the dependence on load knowledge via measurement feedback correction, and it can be implemented in real time. One challenge is that the technique is sensitive to the data availability and integrity of voltage measurements. Therefore, a decentralized DERMS approach is developed by leveraging the concepts of state estimation. The framework and the effectiveness of the solution approach are numerically demonstrated on a real distribution feeder in Southern California.

14 SOLAR ENERGY↗

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Assessing the Optimality of LinDist3Flow for Optimal Tap Selection of Step Voltage Regulators in Unbalanced Distribution Networks: Preprint

The adoption of distributed energy resources such as photovoltaics (PVs) has increased dramatically during the previous decade. The increased penetration of PVs into distribution networks (DNs) can cause voltage fluctuations that have to be mitigated. One of the key utility assets employed to this end are step-voltage regulators (SVRs). It is desirable to include tap selection of SVRs in optimal power flow (OPF) routines, a task that turns out to be challenging because the resultant OPF problem is nonconvex with added complexities stemming from accurate SVR modeling. While several convex relaxations based on semi-definite programming (SDP) have been presented in the literature for optimal tap selection, SDP based schemes do not scale well and are challenging to implement in large-scale planning or operational frameworks. This paper deals with the optimal tap selection (OPTS) problem for wye-connected SVRs using linear approximations of power flow equations. Specifically, the LinDist3Flow model is adopted and the effective SVR ratio is assumed to be continuous–enabling the formulation of a problem called LinDist3Flow-OPTS, which amounts to a linear program. The scalability and optimality gap of LinDist3Flow-OPTS are evaluated with respect to existing SDP-based and nonlinear programming techniques for optimal tap selection in three standard feeders, namely, the IEEE 13-bus, 123-bus, and 8500-node DNs. For all DNs considered, LinDist3Flow-OPTS achieves an optimality gap of approximately 1% or less while significantly lowering the computational burden.

linear approximations↗

Microgrid Energy Management System Integration with Advanced Distribution Management System

The Integrated Distribution Management System (IDMS) project was initiated to demonstrate the interactive operation of microgrid systems and the distribution systems with which they interconnect. The key technologies for this are the microgrid management system and the utility distribution management system. The IDMS project successfully demonstrated that a utility’s advanced distribution management system/distributed energy resources management system (ADMS/DERMS) could effectively manage microgrids to provide visibility and control functionalities as well as use the microgrid as a dispatchable resource to support the utility grid. The DERMS accomplishes this by determining active and reactive power needs at the point of common coupling (PCC) using advanced applications like volt/VAR watt optimization (VVWO) and load relief (LR) with the underlying core applications state estimation (SE) and load flow (LF). The ADMS/DERMS can use the microgrid as a resource to resolve and prevent violations in the grid and to optimize the operational working state of the grid. The IDMS project demonstrated that a utility-operated ADMS with embedded DERMS functionality can flexibly manage a variety of microgrids and other aggregated distributed energy resources (DER) in concert with the wider distribution grid. Microgrids can provide grid services in any number of different ways to meet the operational needs of the distribution utility. The manner of aggregation — microgrid or virtual power plant — is not necessarily relevant to the utility as long as the grid services from the aggregated DER are available and can be managed by its ADMS/DERMS for the stability and reliability of the grid. The IDMS project demonstrated this integrated ADMS concept by combining hardware/software-in-the-loop testing with commercial products from different vendors and a utility’s network model. The project integrated the Schneider Electric EcoStruxure™ ADMS with DERMS with the Schweitzer Engineering Laboratories (SEL) POWERMAX ® Microgrid Control System, and the simulated resources with energy company PECO’s model of a utility-owned microgrid, establishing an operational relationship in which the utility manages the operational functionality of a microgrid at the PCC and that provides the utility with the capability to control the comprehensive power system, inclusive of the macrogrid and microgrid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

MARS: Malleable Actor-Critic Reinforcement Learning Scheduler

In this paper, we introduce MARS, a new scheduling system for HPC-cloud infrastructures based on a cost-aware, flexible reinforcement learning approach, which serves as an intermediate layer for next generation HPC-cloud resource manager. MARS ensembles the pre-trained models from heuristic workloads and decides on the most cost-effective strategy for optimization. A whole workflow application would be split into several optimizable dependent sub-tasks, then based on the pre- defined resource management plan, a reward will be generated after executing a scheduled task. Lastly, MARS updates the Deep Neural Network (DNN) model based on the reward. MARS is designed to optimize the existing models through reinforcement mechanisms. MARS adapts to the dynamics of workflow applications, selects the most cost-effective scheduling solution among pre-built scheduling strategies (backfilling, SJF, etc.) and self- learning deep neural network model at run-time. We evaluate MARS with different real-world workflow traces. MARS can achieve 5%-60% increased performance compare to state-of-the- art approaches.

Baheri, Betis↗

EPA's Suite of Tools for Managing Waste Following a Large-Scale Incident - 19420

Large-scale disasters have the potential to generate a significant amount of waste. For example, Hurricane Katrina and the Joplin Missouri tornado resulted in 100 million and 1.5 million cubic yards of waste respectfully. Man-made chemical, biological, radiological or nuclear (CBRN) incidents either by way of terrorism, war, or accidents have the potential to generate as much or more hazardous waste. Recovery is profoundly impacted by waste management issues. The quantification, segregation, transportation, and storage of waste can be an arduous and costly undertaking. Furthermore, these processes are intricately linked with decisions made throughout the recovery timeline. Therefore, the remediation, including waste management, must be holistically considered. Understanding these complex interactions can be facilitated by using models and tools that adhere to the 'system-of-systems' approach. To better understand and predict waste management issues the Environmental Protection Agency's (EPA's) Homeland Security Research Program (HSRP) is developing a suite of tools and resources for planning and recovery purposes. The waste management suite consists of four tools: - Incident Waste Decision Support Tool (I-WASTE): characterizes and produces order-of-magnitude estimates for the weight and volume of waste materials that may require management and/or disposal, as well as identifies and locates potential treatment and disposal facilities. - Waste Estimation Support Tool (WEST): estimates waste generated from remediation and cleanup activities following a wide-area radiological or biological incident; - Waste Storage and Staging Tool: identifies and prioritizes potential locations for staging and storing waste; - Waste Logistics Tool: estimates optimal routes with consideration to cost, time, and logistical requirements (e.g., resource demand, transportation type, access limitations, etc.) associated with transporting large volumes of waste from disaster-stricken areas to intermediate waste staging/temporary storage/on-site processing sites to off-site waste management facilities; and This paper will present EPA's waste management suite of tools, their purpose and application to large-scale incidents, and a case study demonstrating their use in a hypothetical scenario. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Optimal operation of multi-plant steam district heating systems for enhanced efficiency and sustainability

Despite their crucial role in supplying heat and power to universities, industries, and healthcare facilities, many steam-based district heating systems rely on outdated control methods. Among these, multi-central plant districts are particularly challenging due to the complexities of coordinating multiple plants, optimizing load distributions, and managing system downtime. In response, new operational strategies are developed to enhance the efficiency and sustainability of steam districts while utilizing existing resources. These strategies include reducing plant operational pressure without compromising the reliable supply to buildings and optimizing load allocation across multiple plants. The load allocation considers boiler part-load efficiency, runtime, network losses, and building pressure set points, and is compared with traditional multi-boiler controls. To support this exploration, new dynamic Modelica models are developed. In addition, methods to reduce modeling complexities are incorporated, enhancing their suitability for practical applications. A holistic district-wide analysis using a real university case study demonstrates a 4.7% fuel savings by lowering boiler operational pressure from 900 kPa to 600 kPa, along with a 13.3% reduction in condensation losses across the distribution network. Furthermore, the load allocation approach results in a 13.1% reduction in fuel consumption during peak winter periods and 15.3% during shoulder periods, with corresponding decreases in carbon emissions and fuel costs. This approach can also save maintenance costs by reducing the boiler runtime by 49.6%. In conclusion, this research underscores the benefits of retrofitting aging steam district heating systems, offering immediate operational improvements by enhancing efficiency, meeting regulatory compliance, and extending infrastructure lifespans while delaying costly overhauls.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Applications of Optimal Building Energy System Selection and Operation

Berkeley Lab has been developing the Distributed Energy Resources Customer Adoption Model (DER-CAM) for several years. Given load curves for energy services requirements in a building microgrid (u grid), fuel costs and other economic inputs, and a menu of available technologies, DER-CAM finds the optimum equipment fleet and its optimum operating schedule using a mixed integer linear programming approach. This capability is being applied using a software as a service (SaaS) model. Optimisation problems are set up on a Berkeley Lab server and clients can execute their jobs as needed, typically daily. The evolution of this approach is demonstrated by description of three ongoing projects. The first is a public access web site focused on solar photovoltaic generation and battery viability at large commercial and industrial customer sites. The second is a building CO2 emissions reduction operations problem for a University of California, Davis student dining hall for which potential investments are also considered. And the third, is both a battery selection problem and a rolling operating schedule problem for a large County Jail. Together these examples show that optimization of building u grid design and operation can be effectively achieved using SaaS.

25 ENERGY STORAGE↗

Optimal simulation of a perfect entangler

A 2 x 2 unitary operation is called a perfect entangler if it can generate a maximally entangled state from some unentangled input. We study the following question: How many runs of a given two-qubit entangling unitary operation are required to simulate some perfect entangler with one-qubit unitary operations as free resources? We completely solve this problem by presenting an analytical formula for the optimal number of runs of the entangling operation. Our result reveals an entanglement strength of two-qubit unitary operations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Resilient Disaster Recovery Logistics of Distribution Systems: Co-Optimize Service Restoration With Repair Crew and Mobile Power Source Dispatch

Repair crews (RCs) and mobile power sources (MPSs) are critical resources for distribution system (DS) outage management after a natural disaster. However, their logistics have not been well investigated. We propose a resilient scheme for disaster recovery logistics to co-optimize DS restoration with the dispatch of RCs and MPSs. A novel co-optimization model is formulated to route RCs and MPSs in the transportation network, schedule them in the DS, and reconfigure the DS for microgrid formation coordinately, etc. The model incorporates different timescales of DS restoration and RC/MPS dispatch, the coupling of transportation and power networks, etc. To ensure radiality of the DS with variable physical structure and MPS allocation, we also model topology constraints based on the concept of spanning forest. The model is convexified equivalently and linearized into a mixed-integer linear programming. To reduce its computation time, preprocessing methods are proposed to preassign a minimal set of repair tasks to depots and reduce the number of candidate nodes for MPS connection. Resilient recovery strategies thus are generated to enhance service restoration, especially by dynamic formation of microgrids that are powered by MPSs and topologized by repair actions of RCs and network reconfiguration of the DS. Case studies demonstrate the proposed methodology.

Disaster recovery logistics↗

Chance Constraints for Improving the Security of AC Optimal Power Flow

This paper introduces a scalable method for improving the solutions of ac optimal power flow (AC OPF) with respect to deviations in predicted power injections from wind and other uncertain generation resources. The aim of this paper is on providing solutions that are more robust to short-term deviations, and that optimize both the initial operating point and a parametrized response policy for control during fluctuations. We formulate this as a chance-constrained optimization problem. To obtain a tractable representation of the chance constraints, we introduce a number of modeling assumptions and leverage recent theoretical results to reformulate the problem as a convex, second-order cone program, which is efficiently solvable even for large instances. Our experiments demonstrate that the proposed procedure improves the feasibility and cost performance of the OPF solution, while the additional computation time is on the same magnitude as a single deterministic AC OPF calculation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reinforcement Learning-based Traffic Control to Optimize Energy Usage and Throughput (CRADA report)

The US roadways are critical to meeting the mobility and economic needs of the nation. The United States uses 28% of its energy in moving goods and people, with approximately 60% of that utilized by cars, light trucks, and motorcycles. Thus, improved transportation efficiency is vital to America’s economic progress. The increasing congestion and energy resource requirements of transportation systems for metropolitan areas require research in methods to improve and optimize control methods. Coordinating and optimizing traffic in urban areas may introduce hundreds of thousands of vehicles and traffic management systems, which can require high performance computing (HPC) resources to model and manage. In this work, we seek to use machine learning, computer vision, and HPC to improve the energy efficiency aspects of traffic control by leveraging GRIDSMART traffic cameras as sensors for adaptive traffic control, with a sensitivity to the fuel consumption characteristics of the traffic in the camera’s visual field. Traffic control use cases using reinforcement learning have been published and achieved good results. Surveys from DOE national laboratories estimate that the fuel cost of idling is 6 billion gallons wasted annually [Argonne National Laboratory, 2019]. GRIDSMART cameras—an existing, fielded commercial product—sense the presence of vehicles at intersections and replace more conventional sensors (such as inductive loops) to issue calls to traffic control. These cameras, which have horizon-to-horizon view, offer the potential for an improved view of the traffic environment which can be used to generate better control algorithms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Assessing uncertainty in the timing of energy use during cost-optimal distributed energy technology selection and sizing

This paper empirically derives uncertainty ranges in cost-optimal solar PV and storage sizing by comparing results from the REopt Lite optimization platform from metered data and a set of simulated Department of Energy Commercial Reference Building (CRB) profiles at 65 sites. We find load profile shape alone does not explain a site’s optimal configurations (i.e., PV, Storage, PV and Storage, No System). Still, load profile shape does introduce uncertainty to optimal PV and storage capacities. Across all cases where PV is part of an optimal configuration, we find the average ratio of power capacities derived from metered loads to capacities derived from CRB profiles to be 0.97 (and as high as 1463), where 1 would be a perfect match in system size. For storage, the ratio is 1.6 (and as high as 42). We also assess how, in the absence of complete metered data, a CRB profile can be selected that would be expected to yield the most similar solar PV and storage capacities. From those metrics that can be available from billing data (i.e., peak demand, monthly load totals), we find that uncertainty is most reduced by selecting the CRB’s with an annual peak occurring at the most similar time, or those with the lowest average root mean square error (RMSE) among monthly peak loads. This research can help improve the implementation and interpretation of results derived from simulated load profiles and is an important next step in advancing smart grid solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗