Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Control allocation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Observational Study Designs for Comparative Effectiveness Research: An Alternative Approach to Close Evidence Gaps in Head-and-Neck Cancer

Comparative effectiveness research (CER) has emerged as an approach to improve quality of care and patient outcomes while reducing healthcare costs by providing evidence to guide healthcare decisions. Randomized controlled trials (RCTs) have represented the ideal study design to support treatment decisions in head-and-neck (H and N) cancers. In RCTs, formal chance (randomization) determines treatment allocation, which prevents selection bias from distorting the measure of treatment effects. Despite this advantage, only a minority of patients qualify for inclusion in H and N RCTs, which limits the validity of their results to the broader H and N cancer patient population seen in clinical practice. Randomized controlled trials often do not address other knowledge gaps in the management of H and N cancer, including treatment comparisons for rare types of H and N cancers, monitoring of rare or late toxicity events (eg, osteoradionecrosis), or in some instances an RCT is simply not feasible. Observational studies, or studies in which treatment allocation occurs independently of investigators' choice or randomization, may address several of these gaps in knowledge, thereby complementing the role of RCTs. This critical review discusses how observational CER studies complement RCTs in generating the evidence to inform healthcare decisions and improve the quality of care and outcomes of H and N cancer patients. Review topics include a balanced discussion about the strengths and limitations of both RCT and observational CER study designs; a brief description of design and analytic techniques to handle selection bias in observational studies; examples of observational studies that inform current clinical practices and management of H and N cancers; and suggestions for relevant CER questions that could be addressed by an observational study design.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Transactive Energy System Deployment Over Insecure Communication Links

Here, in this paper, the privacy and security issues associated with the transactive energy system (TES) deployment over insecure communication links are addressed. In particular, it is ensured that 1) individual agents’ bidding information is kept private throughout hierarchical market-based interactions; and 2) any extraneous data injection attack can be quickly and easily detected. An implementation framework is proposed to enable the cryptography-based enhancement of privacy and security for the deployment of any general hierarchical systems including TESs. Under the proposed framework, a unified cryptography-based approach is developed to achieve both privacy and security simultaneously. Specifically, privacy preservation is realized by an enhanced Paillier encryption scheme, where a block design is proposed to significantly improve computational efficiency. Attack detection is further achieved by an enhanced Paillier digital signature scheme, where a stamp-concatenation mechanism is proposed to enable detection of data replace and reorder attacks. Simulation results verify the effectiveness of the proposed cyber-resilient design for transactive energy systems. Note to Practitioners—This paper is motivated by addressing the issues of cyber resiliency for practically deploying transactive energy system (TES) but it is also applicable to the problem of enhancing the privacy and security for any general hierarchical control systems. TES is an emerging control approach that engages energy suppliers and customers through market operations and uses the price to optimally allocate energy resources. While it has been shown to be promising for power system applications, the underlying market-based interactions raise significant concerns of privacy (data leakage) and security (data tampering). However, existing TES works only focus on the coordination mechanism instead of privacy and security issues. This paper proposes a new cryptography-based TES design for practical deployment. Specifically, to protect privacy, individual supply and demand amounts to be exchanged are all encrypted in a particular way such that the original amounts cannot be inferred from the encrypted amounts, while the desired computation for setting the market clearing price can be carried out over the encrypted amounts, thus generating an encrypted result which, when decrypted, matches that of the same computation over the original amounts. To achieve security, for each exchanged data, its sender generates a particular digital signature which is exchanged together with the data. This enables the receiver to automatically detect the integrity by checking whether a mathematical relationship holds for the pair of data and signature. In our future research, we will investigate more challenging scenarios where some suppliers and customers themselves could be corrupted and purposely submit distorted amounts.

97 MATHEMATICS AND COMPUTING↗

Bisphosphonates do not Alter the Rate of Secondary Mineralization

Bisphosphonates function to reduce bone turnover, which consequently increases the mean degree of tissue mineralization at an organ level. However, it is not clear if bisphosphonates alter the length of time required for an individual bone-modeling unit (BMU) to fully mineralize. We have recently demonstrated that it takes {approx}350 days (d) for normal, untreated cortical bone to fully mineralize. The aim of this study was to determine the rate at which newly formed trabecular BMUs become fully mineralized in rabbits treated for up to 414 d with clinical doses of either risedronate (RIS) or alendronate (ALN). Thirty-six, 4-month old virgin female New Zealand white rabbits were allocated to RIS (n=12; 2.4 {mu}g/kg body weight), ALN (n=12; 2.4 {mu}g/kg body weight), or volume-matched saline controls (CON; n=12). Fluorochrome labels were administered at specific time intervals to quantify the rate and level of mineralization of trabecular bone from the femoral neck (FN) by Fourier transform infrared microspectroscopy (FTIRM). The organic (collagen) and inorganic (phosphate and carbonate) IR spectral characteristics of trabecular bone from undecalcified 4 micron thick tissue sections were quantified from fluorescently labels regions that had mineralized for 1, 8, 18, 35, 70, 105, 140, 210, 280, and 385 d (4 rabbits per time point and treatment group). All groups exhibited a rapid increase in mineralization over the first 18 days, the period of primary mineralization, with no significant differences between treatments. Mineralization continued to increase, at a slower rate up, to 385 days (secondary mineralization), and was not different among treatments. There were no significant differences between treatments for the rate of mineralization within an individual BMU; however, ALN and RIS both increased global tissue mineralization as demonstrated by areal bone mineral density from DXA. We conclude that increases in tissue mineralization that occur following a period of bisphosphonate treatment is a function of the suppressed rate of remodeling that allows for a greater number of BMUs to obtain a greater degree of mineralization.

59 BASIC BIOLOGICAL SCIENCES↗

Thermal Transport Gen3 Liquid-Pathway Funds Re-Allocation Proposal

Further development of the Gen3 Liquid-Pathway project is necessary to address technical engineering challenges with respect to incorporation of a flow control valve and sodium system for the 2.0 MWth Pilot-Scale system. For the Thermal Transport development task 1.3, Sandia National Laboratories (SNL) originally set aside $\$$388,425 for the development of a heat trace test bed, however while the team felt that this work is necessary to de-risk a number critical design-related issues the team also has identified items that require more near-term attention. These items largely pertain to the Chloride molten salt values development, with operation up to 720°C, as well as operational mode/system design development as it pertains to the sodium system design, which is currently not included as part of the system design work. The Gen 3 project team requests the ~$\$$388k of funds be used to address these issues, where the previous work requested may be addressed with the 300kWth chloride molten salt loop. These funds would only be spent during the remainder of the Phase 1 budget period, in preparation of final design work for the Phase 2 portion of the project. For the Budget Summary below, please note that the values are burdened values and not raw values, so the actual values going to the entities will be less due to National Laboratory tax costs.

14 SOLAR ENERGY↗

Nutrient Dynamics in a Coupled Terrestrial Biosphere and Land Model (ELM-FATES-CNP)

We present a representation of nitrogen and phosphorus cycling in the Functionally Assembled Terrestrial Ecosystem Simulator, a demographic vegetation model within the Energy Exascale Earth System land model. This representation is modular, and designed to allow testing of multiple hypothetical approaches for carbon-nutrient coupling in plants. Novel model hypotheses introduced in this work include, (a) the controls on plant acquisition of aqueous mineralized nutrients in the soil and (b) fairly straight forward methods of allocating nutrients to specific plant organs and their losses through live plant turnover as well as litter fluxes generated through plant mortality. This combines the new with pre-existing hypotheses (such as nitrogen fixation and soil decomposition) into a system that can accommodate plant-soil dynamics for a large number of size- and functional-type-resolved plant cohorts within a time-since-disturbance-resolved ecosystem. Root uptake of nutrients is governed by fine root biomass, and plants vary in their fine root biomass allocation in order to balance carbon and nutrient limitations to growth. We test the sensitivity of the model to a wide range of parameter variations and structural representations, and in the context of observations at Barro Colorado Island, Panama. A key model prediction is that plants in the high-light-availability canopy positions allocate more carbon to fine roots than plants in low-light understory environments, given the widely different carbon versus nutrient constraints of these two niches within a given ecosystem. This model provides a basis for exploring carbon-nutrient coupling with vegetation demography within Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Dynamic Channel and Power Assignment for Cognitive Networks

In this paper, we develop a unifying optimization formulation to describe the Dynamic Channel and Power Assignment (DCPA) problem and evaluation method for comparing DCPA algorithms. DCPA refers to the allocation of transmit power and frequency channels to links in a cognitive network so as to maximize the total number of feasible links while minimizing the aggregate transmit power. We apply our evaluation method to five algorithms representative of DCPA used in literature. This comparison illustrates the tradeoffs between control modes (centralized versus distributed) and channel/power assignment techniques. We estimate the complexity of each algorithm. Through simulations, we evaluate the effectiveness of the algorithms in achieving feasible link allocations in the network, as well as their power efficiency. Our results indicate that, when few channels are available, the effectiveness of all algorithms is comparable and thus the one with smallest complexity should be selected. The Least Interfering Channel and Iterative Power Assignment (LICIPA) algorithm does not require cross-link gain information, has the overall lowest run time, and highest feasibility ratio of all the distributed algorithms; however, this comes at a cost of higher average power per link.

42 ENGINEERING↗

Investigation of instrumentation containing an embedded digital device - 257

The U.S. nuclear power industry primarily relies on mature, well-proven analog technology as the basis for most instrumentation and control (I and C) equipment employed in its nuclear power plants (NPPs). However, the market for this legacy instrumentation is very small and availability of such equipment for spare parts or replacement is increasingly limited. Frequently, modern I and C equipment contains embedded digital devices (EDDs), such as microprocessors and programmable logic devices. While the enhanced functional capabilities provided by the digital components offer improved performance, reliability, and maintainability, the corresponding complexity of sophisticated digital implementations also exacerbate concerns about an increased potential for undetected systematic faults, which can lead to common-cause failure (CCF). As part of a research project sponsored by the U.S. Department of Energy, an investigation has been conducted of commercially available instrumentation marketed for nuclear or industrial application. The objective was to identify the usage of EDDs and to determine the types of functional roles allocated to the devices. Examples of the equipment surveyed include smart sensors, sequencers for emergency diesel generators, pumps, valve actuators, motor control centers, breakers, priority logic modules, and uninterruptible power sources. Where sufficient detail was found, an evaluation was performed to ascertain the nature and role of the digital technology implemented in the instrumentation. The information gained through this investigation serves as technical input for defining a classification approach for EDDs based on the functional impact of the device. For example, the role of an EDD can involve any of the following functions: performance monitoring and diagnostics, information extraction and communication, instrument condition monitoring and protection, or execution of core instrument functions. Classifying digital devices according to their role in the operation of the instrumentation in which they are embedded can enable determination of the potential functional impact of failure of that device and contribute to determination of the potential safety significance of a CCF event disabling all instances of that device. This paper will report on the findings of the investigation of instrumentation with EDDs and indicate considerations for the emerging classification approach. The higher-level goal of this effort is to determine whether a graded approach to qualification testing may be possible based on classification. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Measurement-Based Adaptive Voltage Regulation Method Considering Topology Changes

This paper proposes an online adaptive data-driven distributed energy resource (DER) dispatch optimization method for voltage control considering topology changes. By using a local sensitivity factor (LSF)-enabled voltage control, traditional DER control can be reformulated into a linear programming (LP) problem, leading to faster computation speeds. Power injection alteration and topology changes are two common operational changes in the distribution network that can affect the LSF and voltage control performance. To address this issue, a robust estimation method is developed to adjust the sensitivity matrix at each time step for the time-varying power injection changes. When topology changes occur, only the allocated predominant LSF submatrices are updated based on measurement data, allowing for a fast adaptation to the system reconfiguration. Results obtained from a real distribution feeder in Southern California demonstrate its robustness as compared to traditional volt-var control and constant LSF matrix dispatch control methods.

DERs↗

Machine Learning-Based Prediction of Distribution Network Voltage and Sensor Allocation

Increasing penetration of fast-varying energy resources may negatively affect power systems' operation. At the same time, sensor deployment throughout distribution networks improves system awareness and enables the development of new and advanced voltage control solutions. Such control techniques rely on accurate prediction in anticipation to voltage violation scenarios. This paper analyzes various approaches for voltage prediction in a distribution system; it is shown that combining multiple techniques into a single regressor improves its predictive power. Moreover, a two-step regressor is proposed, where initial predictions based on a global regressor are refined by local regressors; in this case, prediction errors decrease significantly. Additionally, a clustering approach is employed for performing sensor allocation, so that only the most influential buses are selected for monitoring without diminishing prediction accuracy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Management of Sentinel Lymph Node Metastasis in Merkel Cell Carcinoma: Completion Lymphadenectomy, Radiation, or Both?

Background: Approximately 30% of patients with clinically localized Merkel cell carcinoma (MCC) show nodal involvement on sentinel lymph node biopsy (SLNB). Optimal management of SLNB-positive disease has not been defined. This study compared outcomes after completion lymphadenectomy (CLND), radiation, and combined CLND plus radiation after a positive SLNB. Methods: All patients treated at a single institution for SLNB-positive MCC (1998–2015) were retrospectively evaluated, with examination of patient demographics, clinicopathologic characteristics, outcomes, and regional toxicity. Results: The study identified 71 evaluable patients with SLNB-positive disease. The median age of these patients was 76 years, and 76.1% were men. Of the 71 patients, 11 (15.5%) underwent CLND, 40 (56.3%) received radiation, and 20 (28.2%) underwent CLND plus postoperative radiation. Lymphovascular invasion was significantly more common in the radiation-alone cohort (p = 0.04). For the three cohorts, the median percentages of nodal involvement were respectively 2, 10, and 30% (p = 0.06). After a median follow-up period of 22.3 months, four patients had recurrence in their regional nodal basin (3 radiation-alone patients and 1 CLND + radiation patient). The three cohorts did not differ significantly in the development of distant metastases (p = 0.68) or overall survival (p = 0.72). Six patients experienced surgical-site infections (2 CLND and 4 CLND + radiation patients), and three patients experienced symptomatic lymphedema (1 CLND patient and 2 CLND + radiation patients). Conclusions: Regional failure was infrequent (≤ 10%) regardless of treatment, and morbidity appeared to be low with all approaches. Given that multiple treatment approaches can be successful in treating micrometastatic MCC, future efforts should be directed at refining criteria for allocating patients to a specific method, or possibly no further nodal basin treatment, in an effort to maximize regional control at the lowest cost and morbidity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Fast and accurate influenza forecasting in the United States with Inferno

Infectious disease forecasting is an emerging field and has the potential to improve public health through anticipatory resource allocation, situational awareness, and mitigation planning. By way of exploring and operationalizing disease forecasting, the U.S. Centers for Disease Control and Prevention (CDC) has hosted FluSight since the 2013/14 flu season, an annual flu forecasting challenge. Since FluSight’s onset, forecasters have developed and improved forecasting models in an effort to provide more timely, reliable, and accurate information about the likely progression of the outbreak. While improving the predictive performance of these forecasting models is often the primary objective, it is also important for a forecasting model to run quickly, facilitating further model development and improvement while providing flexibility when deployed in a real-time setting. In this vein I introduce Inferno, a fast and accurate flu forecasting model inspired by Dante, the top performing model in the 2018/19 FluSight challenge. When pseudoprospectively compared to all models that participated in FluSight 2018/19, Inferno would have placed 2nd in the national and regional challenge as well as the state challenge, behind only Dante. Inferno, however, runs in minutes and is trivially parallelizable, while Dante takes hours to run, representing a significant operational improvement with minimal impact to performance. Forecasting challenges like FluSight should continue to monitor and evaluate how they can be modified and expanded to incentivize the development of forecasting models that benefit public health.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Duke FACE -- Forest-Atmosphere Carbon Transfer and Storage (FACTS I)

The Duke FACE experiment increases atmospheric [CO 2 ] to a height of 25 m in four 30-m diameter plots, each containing ~100 canopy trees and many sub-canopy individuals. The experiment was initiated in 1994 with CO 2 fumigation of the prototype plot, and reached full CO 2 -fumigation capacity in 1996 when three additional FACE plots came on line. All elevated plots enriched the atmospheric CO 2 concentration by 200 ppmv relative to paired, ambient-CO 2 plots. Formalizing the analysis of CO 2 x N interactions, in March of 2005 each of the six FACE plots established in 1996 was trenched in half, and one half plot fertilized with nitrogen (N) at a rate of 11 g m -2 yr -1 , following the approach established in 1998 in the prototype and its reference plot. The δ 13 C of the fumigated plots’ atmosphere was -42.6‰, and while the 15 N of the fertilizer did not affect the δ 15 N of tissues directly it greatly reduced the effect of a 15 N tracer study on tissue δ 15 N. The CO 2 enrichment was completed in early November, 2010. Prior to termination of fumigation, 1-8 branches from 4-5 Pinus taeda individuals in each half plot were harvested, as well as most Juniperus occidentalis and broadleaved individuals <2 cm in diameter (1.4 m aboveground), including vine and herbaceous individuals. Following the termination, all individuals <8 cm in diameter, followed by all remaining individuals were harvested in half of each plot (a quarter in each CO 2 X N treatment). In all, 189 m 3 of dry material and 826 m 3 of wet material, or a total of 1014 m 3 of material is stored in various suited settings. The project quantified the effect of CO 2 X N on carbon uptake, allocation to various pools, accumulation of carbon in these pools, the release of carbon to the atmosphere, and factors controlling these processes. The project also assessed the effect of CO 2 X N on the components of the water budget, and related processes, as well as on the amount and diversity of understory vegetation.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the effect of alternative carbon allocation schemes in a land surface model (CLM4.5) on carbon fluxes, pools, and turnover in temperate forests

Abstract. How carbon (C) is allocated to different plant tissues (leaves, stem, and roots) determines how long C remains in plant biomass and thus remains a central challenge for understanding the global C cycle. We used a diverse set of observations (AmeriFlux eddy covariance tower observations, biomass estimates from tree-ring data, and leaf area index (LAI) measurements) to compare C fluxes, pools, and LAI data with those predicted by a land surface model (LSM), the Community Land Model (CLM4.5). We ran CLM4.5 for nine temperate (including evergreen and deciduous) forests in North America between 1980 and 2013 using four different C allocation schemes: i. dynamic C allocation scheme (named "D-CLM4.5") with one dynamic allometric parameter, which allocates C to the stem and leaves to vary in time as a function of annual net primary production (NPP); ii. an alternative dynamic C allocation scheme (named "D-Litton"), where, similar to (i), C allocation is a dynamic function of annual NPP, but unlike (i) includes two dynamic allometric parameters involving allocation to leaves, stem, and coarse roots; iii.&ndash;iv. a fixed C allocation scheme with two variants, one representative of observations in evergreen (named "F-Evergreen") and the other of observations in deciduous forests (named "F-Deciduous"). D-CLM4.5 generally overestimated gross primary production (GPP) and ecosystem respiration, and underestimated net ecosystem exchange (NEE). In D-CLM4.5, initial aboveground biomass in 1980 was largely overestimated (between 10 527 and 12 897 g C m −2 ) for deciduous forests, whereas aboveground biomass accumulation through time (between 1980 and 2011) was highly underestimated (between 1222 and 7557 g C m −2 ) for both evergreen and deciduous sites due to a lower stem turnover rate in the sites than the one used in the model. D-CLM4.5 overestimated LAI in both evergreen and deciduous sites because the leaf C–LAI relationship in the model did not match the observed leaf C–LAI relationship at our sites. Although the four C allocation schemes gave similar results for aggregated C fluxes, they translated to important differences in long-term aboveground biomass accumulation and aboveground NPP. For deciduous forests, D-Litton gave more realistic C stem ∕ C leaf ratios and strongly reduced the overestimation of initial aboveground biomass and aboveground NPP for deciduous forests by D-CLM4.5. We identified key structural and parameterization deficits that need refinement to improve the accuracy of LSMs in the near future. These include changing how C is allocated in fixed and dynamic schemes based on data from current forest syntheses and different parameterization of allocation schemes for different forest types. Our results highlight the utility of using measurements of aboveground biomass to evaluate and constrain the C allocation scheme in LSMs, and suggest that stem turnover is overestimated by CLM4.5 for these AmeriFlux sites. Understanding the controls of turnover will be critical to improving long-term C processes in LSMs.

54 ENVIRONMENTAL SCIENCES↗

A Visual Atlas on Strategic Trade

Strategic trade concerns global trade flows of items with strategic military value. Items include goods with exclusive military use, but also dual-use items that can have both military and civil uses. Many countries require licenses for trade in strategic items as a measure of non-proliferation. For example, items listed for trade control by multilateral export control arrangements, such as the Nuclear Suppliers Group (NSG), typically are considered strategic goods. Analysts and officials involved in strategic trade control often lack quantitative global understanding of relevant trade patterns that would help them focus control and enforcement efforts, select companies for outreach and audit, target transactions for verification and inspection, and assess the potential economic impact of trade control policies. Many are unaware of available open source data on international trade that can inform these issues. Many do not know how to make use of such data or lack the tools necessary to do so. A book of charts dubbed a ‘Strategic Trade Atlas’ was developed to illustrate global trade flows of strategic goods and raise awareness of the availability and utility of open source trade data. The Atlas was prepared for the World Customs Organization (WCO) and its Member States to support their planning and execution of Strategic Trade Control Enforcement (STCE) operations. It offers macroscopic graphical representations of global trade flows classified under Harmonized System (HS) codes associated by the WCO with commodities described in its STCE Implementation Guide. While these HS codes are understood to also encompass many non-strategic items, they nevertheless provide a good overview of potentially strategic trade flows. These include HS codes covering nuclear and nuclear-related commodities listed by the NSG, such as uranium, heavy water, graphite, carbon fiber, nickel powder, beryllium, aluminum tubes, vacuum pumps, valves, machine tools, cameras, and many others. The Atlas uses trade data from the Base pour l’Analyse du Commerce International (BACI), a statistical elaboration of public UN Comtrade data. BACI data reconciles trade flows, taking into account asymmetries in import and export trade valuation. The data visualization approach facilitates rapid sense making, pattern recognition, and anomaly detection. Country-based profiles summarize vast amounts of data into readily understandable graphical representations of each country’s primary strategic imports and exports and their main trading partners. Commodity-based profiles provide a global view of major exporters, importers, and trade patterns for each commodity. These insights can inform the risk management approach employed by customs to allocate enforcement and compliance efforts.

customs controls↗

Machine Learning-Based Prediction of Distribution Network Voltage and Sensors Allocation: Preprint

Increasing penetration of fast-varying energy resources may negatively affect power systems' operation. At the same time, sensor deployment throughout distribution networks improves system awareness and enables the development of new and advanced voltage control solutions. Such control techniques rely on accurate prediction in anticipation to voltage violation scenarios. This paper analyzes various approaches for voltage prediction in a distribution system; it is shown that combining multiple techniques into a single regressor improves its predictive power. Moreover, a two-step regressor is proposed, where initial predictions based on a global regressor are refined by local regressors; in this case, prediction errors decrease significantly. Additionally, a clustering approach is employed for performing sensor allocation, so that only the most influential buses are selected for monitoring without diminishing prediction accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learning-Based Prediction of Distribution Network Voltage and Sensor Allocation

Increasing penetration levels of fast-varying energy resources might negatively affect power system operation. At the same time, sensor deployment throughout distribution networks improves system awareness and enables the development of new and advanced voltage control solutions. Such control techniques rely on accurate prediction in anticipation of voltage violation scenarios. This paper analyzes various approaches to voltage prediction in a distribution system, and it is shown that combining multiple techniques into a single regressor improves its predictive power. Moreover, a two-step regressor is proposed in which initial predictions based on a global regressor are refined by local regressors; in this case, prediction errors decrease significantly. Additionally, a clustering approach is employed to perform sensor allocation so that only the most influential buses are selected for monitoring without diminishing prediction accuracy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks

We consider the power allocation problem over shared spectrum for millimeter-Wave (mmWave) cellular downlink. Existing approaches usually find sub-optimal solutions by solving a non-convex optimization which leads to scalability issues due to centralized control. Therefore, distributed and adaptive approaches are desirable. Recently, model-free Deep Reinforcement Learning (DRL) has achieved success in such wireless resource management tasks. By modeling the radio environment as a Markov Decision Process (MDP) with the base stations (BSs) being the agents, power allocation can be automated at the agent level with comparable throughput performance to conventional centralized schemes. The multi-agent setting presents new challenges as the radio environment is impacted by the joint actions of the agents and is no longer stationary from any individual agent’s perspective. Existing literature bypasses this non-stationarity violation by ignoring it which may cause performance degradation. To tackle this issue, we propose a distributed continuous power allocation scheme based on a modified version of multi-agent Deep Deterministic Policy Gradient (MADDPG) that is tailored for the distributed multiple-agent setting. The proposed scheme employs a centralized-training distributed-execution framework where Q-functions are trained over subsets of BSs while each BS determines its transmit power based only on its own local observation. It admits constant per-BS communication and computation complexity and is thus scalable to large networks. Numerical evaluation shows that the proposed scheme adapts well to a wide range of interference conditions and can achieve comparable or better performance than several state-of-the-art non-learning approaches.

99 GENERAL AND MISCELLANEOUS↗

Transactive Energy Rationing in Islanded Electric Power Systems

Extreme weather events, many of which are climate change related, are occurring with increasing frequency and intensity and causing catastrophic outages. One of the major modern-day concerns of utilities is dealing with such extreme outages and consequently, its repercussions on the lives of people in society and social aspects. Traditionally, operators have been using rolling blackouts as a contingency plan to serve critical loads during such events when electricity supply is scarce. However, such blackouts practices are executed on a last-minute mandatory basis, depriving customers having low-capacity high priority loads (i.e. refrigeration, water, telecommunication, etc) that should also be serviced if at all possible. Historically, policymakers have often adopted quota-based regulatory actions or rationing for other commodities (such as gasoline, butter, sugar) to handle scarcity situations. Motivated from such quota based systems, our contribution presented in this work is an alternative transactive rationing mechanism that would provide some minimum level of service to all of the customers and serve the critical loads using market-based control during such scarcity-based contingencies. This is in contrast to the state-of-art TE mechanisms that allocate resources to customers solely based on their willingness-to-pay. The effectiveness of the proposed mechanism is demonstrated through simulation-based evaluation on two real-life use cases having feeder-level and microgrid-level configurations respectively. The simulation results clearly demonstrate the capability of the rationing scheme to serve customers’ high-priority loads through prolonged outages even during extreme scarcity scenarios.

42 ENGINEERING↗