Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Wind Systems Integration Workshop

The U.S. Department of Energy’s Wind Energy Technologies Office (WETO) Wind Systems Integration Workshop was held to facilitate an exchange of information and to solicit feedback to inform WETO’s near- to mid-term research priorities and to accelerate near-term, rapid deployment and integration of wind technologies at both the transmission and distribution levels. Workshop participants identified key research challenges and opportunities for grid services, power electronics, modeling and decision-support tools, transmission and distribution system coordination, and applying energy equity principles to wind grid integration research.

17 WIND ENERGY↗

Effects of Borate and Organics on U(VI) Solubility in WIPP Brine

The solubility of uranium (VI) in Waste Isolation Pilot Plant (WIPP)-relevant brine was determined to support ongoing WIPP recertification activities. This research was performed by the Los Alamos National Laboratory Carlsbad Operations (LANL-CO) Actinide Chemistry and Repository Science Program (ACRSP). The WIPP Actinide Source Term Program (ASTP) did not develop a model for the solubility of actinides in the VI oxidation state. The solubility of UO 2 2+ , in the absence of WIPP specific data, is presently set to be equal to a conservatively high 1 mM within the WIPP Performance Assessment (PA) for all expected WIPP conditions (SOTERM, 2019) as selected at the recommendation of the Environment Protection Agency (EPA) (EPA, 2005). According to the current WIPP chemistry model assumptions and conditions, the expected pC H+ is about 9.5 and controlled by MgO buffering CO 3 2- . The goal of this study is to perform screening experiments that account for the contributions of organics and borate on uranium solubility. In this report, the solubility of U(VI) was determined at pC H+ 9 WIPP brine in the absence or presence of borate and organics at under-saturation approach. Experiments were equilibrated for about 135 days. Organic compounds present in WIPP waste can form strong complexes with actinides and can affect the oxidation states of actinides. The organic compounds addressed in WIPP performance assessment include EDTA (Ethylenediaminetetraacetic Acid), oxalate, citrate, and acetate (SOTERM, 2019). These data quantify the effects of WIPP-relevant concentrations of borate and organics effects on the solubility of U(VI) to challenge the predictions of the WIPP actinide model and inform decisions and recommendations made in the upcoming recertification of the WIPP (CRA-2024). The experiments performed were done according to the U.S. Department of Energy (DOE) approved Test Plan entitled “Experimental Strategy to Challenge Actinide Solubility Predictions” and designated LCO-ACP-26. All data reported were obtained under the LANL-CO Quality Assurance Program, which is compliant with the DOE Carlsbad Field Office, Quality Assurance Program Document (CBFO/QAPD) (QAPD, 2017).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Automated Adversary Emulation for Cyber-Physical Systems via Reinforcement Learning

Adversary emulation is an offensive exercise that provides a comprehensive assessment of a system’s resilience against cyber attacks. However, adversary emulation is typically a manual process, making it costly and hard to deploy in cyber-physical systems (CPS) with complex dynamics, vulnerabilities, and operational uncertainties. In this paper, we develop an automated, domain-aware approach to adversary emulation for CPS. We formulate a Markov Decision Process (MDP) model to determine an optimal attack sequence over a hybrid attack graph with cyber (discrete) and physical (continuous) components and related physical dynamics. We apply model-based and model-free reinforcement learning (RL) methods to solve the discrete-continuous MDP in a tractable fashion. As a baseline, we also develop a greedy attack algorithm and compare it with the RL procedures. We summarize our findings through a numerical study on sensor deception attacks in buildings to compare the performance and solution quality of the proposed algorithms.

Bhattacharya, Arnab↗

Use of a controlled experiment and computational models to measure the impact of sequential peer exposures on decision making

It is widely believed that one’s peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the “pattern” by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate social signal exposure in an online controlled experiment using a game with human participants. Each participant in the game decides among choices with differing utilities. We observe the following: (1) even in the presence of monetary risks and previously acquired knowledge of the choices, decision-makers tend to deviate from the obvious optimal decision when their peers make a similar decision which we call the influence decision, (2) when the quantity of social signals vary over time, the forwarding probability of the influence decision and therefore being responsive to social influence does not necessarily correlate proportionally to the absolute quantity of signals. To better understand how these rules of peer influence could be used in modeling applications of real world diffusion and in networked environments, we use our behavioral findings to simulate spreading dynamics in real world case studies. We specifically try to see how cumulative influence plays out in the presence of user uncertainty and measure its outcome on rumor diffusion, which we model as an example of sub-optimal choice diffusion. Together, our simulation results indicate that sequential peer effects from the influence decision overcomes individual uncertainty to guide faster rumor diffusion over time. However, when the rate of diffusion is slow in the beginning, user uncertainty can have a substantial role compared to peer influence in deciding the adoption trajectory of a piece of questionable information.

97 MATHEMATICS AND COMPUTING↗

Powering Circularity Through Data Reporting and Collection

Sustainability and Circular Economy have many metrics for evaluation. Calculating mass intensity, energy return on investment, financial payback, and recycling rate for proposed technology changes and lifecycle management can support decision making. Robust data with modeling tools can perform these calculations, informing good decision making. Analyses show that reliability is more critical than recyclability. Improved data gathering and tool accessibility will support our industry to make more circular choices for PV lifecycle management.

14 SOLAR ENERGY↗

Expanded modelling scenarios to understand the role of offshore wind in decarbonizing the United States

An assessment of decarbonization pathways in energy models reveals fundamental limitations in representing factors that are relevant for practical decision-making. Although these modelling limitations are widely acknowledged, their impact on the deployment of individual power generation types is not well understood. As a result, the societal value from such generation types could be vastly misrepresented. Here we explore a wide spectrum of factors that impact offshore wind deployment in the United States using a detailed capacity expansion model. Many factors prescribe a large future role for offshore wind, yet this diverges from what models often show. We extend the typically narrow modelling context through high spatial resolution, several cost and transmission possibilities and various energy-sector policies. Further, we estimate offshore wind to constitute 1-8% (31-256 gigawatts) of total US generation by 2050. This wide range suggests an uncertain but potentially important regional role. Our expansive scenarios demonstrate how to address many limitations of decarbonization modelling.

17 WIND ENERGY↗

Long-term survival and second malignant tumor prediction in pediatric, adolescent, and young adult cancer survivors using Random Survival Forests: a SEER analysis

Abstract Survival and second malignancy prediction models can aid clinical decision making. Most commonly, survival analysis studies are performed using traditional proportional hazards models, which require strong assumptions and can lead to biased estimates if violated. Therefore, this study aims to implement an alternative, machine learning (ML) model for survival analysis: Random Survival Forest (RSF). In this study, RSFs were built using the U.S. Surveillance Epidemiology and End Results to (1) predict 30-year survival in pediatric, adolescent, and young adult cancer survivors; and (2) predict risk and site of a second tumor within 30 years of the first tumor diagnosis in these age groups. The final RSF model for pediatric, adolescent, and young adult survival has an average Concordance index (C-index) of 92.9%, 94.2%, and 94.4% and average time-dependent area under the receiver operating characteristic curve (AUC) at 30-years since first diagnosis of 90.8%, 93.6%, 96.1% respectively. The final RSF model for pediatric, adolescent, and young adult second malignancy has an average C-index of 86.8%, 85.2%, and 88.6% and average time-dependent AUC at 30-years since first diagnosis of 76.5%, 88.1%, and 99.0% respectively. This study suggests the robustness and potential clinical value of ML models to alleviate physician burden by quickly identifying highest risk individuals.

60 APPLIED LIFE SCIENCES↗

A Systematic Framework for Tuning Open-Source Multifunctional IBR Models To Emulate OEM Black-Box Fault Dynamics

This paper presents a systematic framework to tune a generic IBR EMT model to match with an OEM provided balckbox inverter model based on the fault current responses. The key learnings and findings are summarized as follows: The tunable key parameters include inner control loops and current limiters to align the fault current magnitude, sequence content, and phase trajectories with the OEM models across diverse fault type and locations. The tuned model's fidelity is validated through comparative analysis with an OEM blackbox model, assessing both the fault current response and the responses of multiple relay elements. The results demonstrate the tuned generic model can trigger relay decision logic that is identical or near identical to that of the OEM model, thus generating very good match model for fault studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Restoration Strategy for Active Distribution Systems Considering Endogenous Uncertainty in Cold Load Pickup

Cold load pickup (CLPU) phenomenon is identified as the persistent power inrush upon a sudden load pickup after an outage. Under the active distribution system (ADS) paradigm, where distributed energy resources (DERs) are extensively installed, the decreased outage duration can induce a strong interdependence between CLPU pattern and load pickup decisions. In this paper, we propose a novel modelling technique to tractably capture the decision-dependent uncertainty (DDU) inherent in the CLPU process. Subsequently, a two-stage stochastic decision-dependent service restoration (SDDSR) model is constructed, where first stage searches for the optimal switching sequences to decide step-wise network topology, and the second stage optimizes the detailed generation schedule of DERs as well as the energization of switchable loads. Further, to tackle the computational burdens introduced by mixed-integer recourse, the progressive hedging algorithm (PHA) is utilized to decompose the original model into scenario-wise subproblems that can be solved in parallel. The numerical test on modified IEEE 123-node test feeders has verified the efficiency of our proposed SDDSR model and provided fresh insights into the monetary and secure values of DDU quantification.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Downscaled Earth System Model Data for Resilient Energy System Planning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.

97 MATHEMATICS AND COMPUTING↗

Impact of Control on Availability and Cycling of Residential HVAC in a Real-World Experiment

Demand response is an important emerging part of smart grids and there is a large stream of research from theoretical and modeling perspectives. However, there is relatively little experimental evidence that could help researchers and building operators make informed decisions on best practices for modeling, developing, and deployment of control mechanisms. We contribute to the body of experimental research by providing numerical insights into the role and availability of residential HVAC systems for control. We share the findings on the duration of the cooling cycle, off cycle, and temperature settling time of HVAC systems from data collected from a smart neighborhood located in Atlanta, GA.

cycling↗

Conservation Voltage Reduction (CVR) via Two-Timescale Control in Unbalanced Power Distribution Systems

Voltage control devices are employed in power distribution systems to reduce the power consumption by operating the system closer to the lower acceptable voltage limits; this technique is called conservation voltage reduction (CVR). The different modes of operation for system’s legacy devices (with binary control) and new devices (e.g. smart inverters with continuous control) coupled with variable photovoltaic (PV) generation results in voltage fluctuations which makes it challenging to achieve CVR objective. This paper presents a two-timescale control of feeder’s voltage control devices to achieve CVR that includes (1)a centralized controller operating in a slower time-scale to coordinate voltage control devices across the feeder and (2) local controllers operating in a faster timescale to mitigate voltage fluctuations due to PV variability. The centralized controller utilizes a three-phase optimal power flow model to obtain the decision variables for both legacy devices and smart inverters. The local controllers operate smart inverters to minimize voltage fluctuations and restore nodal voltages to their reference values by adjusting the reactive power support. The proposed approach is validated using the IEEE-123 bus (medium-size) and R3-12.47-2 (large-size) feeders. It is demonstrated that the proposed approach is effective in achieving the CVR objective for unbalanced distribution systems.

optimal control, distributed generation, fluctuati↗

Comparing computational times for simulations when using PBPK model template and stand-alone implementations of PBPK models

Introduction We previously developed a PBPK model template that consists of a single model “superstructure” with equations and logic found in many physiologically based pharmacokinetic (PBPK) models. Using the template, one can implement PBPK models with different combinations of structures and features. Methods To identify factors that influence computational time required for PBPK model simulations, we conducted timing experiments using various implementations of PBPK models for dichloromethane and chloroform, including template and stand-alone implementations, and simulating four different exposure scenarios. For each experiment, we measured the required computational time and evaluated the impacts of including various model features (e.g., number of output variables calculated) and incorporating various design choices (e.g., different methods for estimating blood concentrations). Results We observed that model implementations that treat body weight and dependent quantities as constant (fixed) parameters can result in a 30% time savings compared with options that treat body weight and dependent quantities as time-varying. We also observed that decreasing the number of state variables by 36% in our PBPK model template led to a decrease of 20–35% in computational time. Other factors, such as the number of output variables, the method for implementing conditional statements, and the method for estimating blood concentrations, did not have large impacts on simulation time. In general, simulations with PBPK model template implementations of models required more time than simulations with stand-alone implementations, but the flexibility and (human) time savings in preparing and reviewing a model implemented using the PBPK model template may justify the increases in computational time requirements. Conclusion Our findings concerning how PBPK model design and implementation decisions impact computational speed can benefit anyone seeking to develop, improve, or apply a PBPK model, with or without the PBPK model template.

Bernstein, Amanda S.↗

Reinforcement Learning for Intentional Islanding in Resilient Power Transmission Systems

Intentional islanding is the process of identifying and deliberately decomposing the transmission network to form self-sustained islands from an endangered network during disruptions to improve resilience and security. Most existing intentional islanding models are offline resilience decision tools and hence do not provide outage responses in a timely manner. In this paper, a reinforcement learning (RL) based model for intentional islanding is developed, which offers real-time switching control, online deployability, and adaptability to varying system conditions. The intentional islanding process is formulated as a Markov decision process, where the optimal transmission switching policy is learned using the RL approach. The control policy is learned over an environment that encompasses a Power System Simulator for Engineering (PSS/E) model of the transmission network, facilitated by an interface to the standard openAI Gym framework. The proposed RL-based methodology aims to form stable and self-sustainable islands by ensuring voltage stability while reducing the power mismatch in the formed islands. A proximal policy optimization algorithm is designed, which is suitable for controlling the on/off status of the switches with multi-layer perceptron as value and actor networks. The effectiveness of the proposed framework in the self-recovery of the grid by island formation is applied on the modified IEEE 39-bus test network and validated by dynamic simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The role of information structures in game-theoretic multi-agent learning

Multi-agent learning (MAL) studies how agents learn to behave optimally and adaptively from their experience when interacting with other agents in dynamic environments. The outcome of a MAL process is jointly determined by all agents’ decision-making. Hence, each agent needs to think strategically about others’ sequential moves, when planning future actions. The strategic interactions among agents makes MAL go beyond the direct extension of single-agent learning to multiple agents. With the strategic thinking, each agent aims to build a subjective model of others decision-making using its observations. Such modeling is directly influenced by agents’ perception during the learning process, which is called the information structure of the agent’s learning. As it determines the input to MAL processes, information structures play a significant role in the learning mechanisms of the agents. This review creates a taxonomy of MAL and establishes a unified and systematic way to understand MAL from the perspective of information structures. Here we define three fundamental components of MAL: the information structure (i.e., what the agent can observe), the belief generation (i.e., how the agent forms a belief about others based on the observations), as well as the policy generation (i.e., how the agent generates its policy based on its belief). In addition, this taxonomy enables the classification of a wide range of state-of-the-art algorithms into four categories based on the belief-generation mechanisms of the opponents, including stationary, conjectured, calibrated, and sophisticated opponents. We introduce Value of Information (VoI) as a metric to quantify the impact of different information structures on MAL. Finally, we discuss the strengths and limitations of algorithms from different categories and point to promising avenues of future research.

97 MATHEMATICS AND COMPUTING↗

Closing the Loops on Solar Photovoltaics Modules: An Agent-Based Modeling Approach for the Study of Circular Economy Strategies

Solar photovoltaics (PV) installed capacity have grown exponentially since the early 2000s (average annual growth rate of 50%). With 4,700 GW projected installed capacity by 2050, the volume of PV panels waste is also expected to become substantial. Though renewables are a sine qua non to the establishment of a truly circular economy (CE), the issue arising from their end-of-life management needs to be resolved. The management of PV end-of-life also represent a singular opportunity to create value, from recovered valuable, rare or critical materials (e.g. silver, tellurium, indium). Moreover, the PV case illustrates some of the current barriers to CE; for instance, the need for a common definition of waste (PV are defined as e-waste in the European Union but as general waste in the United States) and potential loss of innovations' advantages (PV average efficiency has continuously grown the past 10 years). In this study, an agent-based modeling (ABM) approach is proposed to simulate PV end-of-life management in the United States. The model explores how the decisions of the various actors involved in handling PV waste affect the quantities of PV that are reused, recycled, or land-filled. In the model, manufacturers, residential, and nonresidential PV owners, installers, and recyclers are represented by agents while governmental policies and regulations are treated as exogenous variables. PV-market data are used to define agents' characteristics (e.g., installed PV capacities or producing costs). Agents' decision rules draw on the literature related to industrial symbiosis (IS) and peoples' waste behaviors as they appear as the most widely used model to implement CE principles at a meso level. Specifically, the concepts of mutual trust between IS actors and knowledge about the IS philosophy are yielded to define the agents' decision process. The primary outputs of the ABM are the costs and volume of waste associated with each end-of-life pathway. Preliminaries results indicate recycling of residential PV is affected by the cost, perceived difficulty of recycling behaviors, and social norms. Moreover, the type of network connecting agents and the initial recycling rate strongly influence results. The model also highlights the crucial role of recycling behavior adoption: in case of early failure of PV, recycled volumes increase by about 40%. This represents an additional 5.7 billion USD from potential recovered silver. Finally, although results for the PV case are presented here, the developed ABM aims at being a general tool for the study of CE strategies and the CE transition. Furthermore, steps of this research include extending the model to encompass circular economy strategies (e.g., design for recycling or lifetime extension) and validating its general architecture from various case studies.

14 SOLAR ENERGY↗

Visualization of Multi-Fidelity Approximations of Stochastic Economic Dispatch

As renewable energy generation deployment increases, the operation of electrical grids becomes more complex. Economic dispatch is part of a grid operator's regular decision process where the amount of energy to generate is determined based on the number of available generators and the actual level of energy demand. Renewable generators are inherently stochastic due to the chaotic nature of weather patterns, and thus, real-time decisions of economic dispatch become increasingly complex. Modeling efforts to assist in these decisions in the highest fidelity typically take hours to days to solve on leadership-class computers; too long for the 5-minute operational time-frame demanded of operators. Alternatively, multi-fidelity approximations can be used to predict generation levels quickly and with sufficient accuracy to be used for real-time operations. We have developed a visualization tool to demonstrate the utility of multi-fidelity approximations by displaying contextual results of economic dispatch approximations, comparisons across fidelity levels of generation levels and possible failures to meet demand, and meta-data on the modeling setup.

interactive visualization↗

Uncertainty Quantification for Capacity Expansion Planning

This report quantifies the uncertainty in output decisions from a Capacity Expansion Planning (CEP) model. The need to understand how uncertainties within CEP models and modeling assumptions affect Quantities of Interest (QoIs) such as expansion and operating costs, as well as expansion decisions remains an ongoing challenge in scientific research and industrial operations. This area of research is particularly important for models which seek to capture how large networks will evolve and operate under increased sources of variable generation, i.e., higher penetration of renewable technologies such as solar and wind generators. Uncertainty quantification (UQ) of CEP models which estimate expansion costs and decisions, and production cost models which estimate operating costs and dispatch decisions, is a key focus of research at NREL. The Regional Energy Deployment System (ReEDS) represents a state-of-the-art CEP model and considers a range of possible grid evolutions in an attempt to identify key drivers, ramifications, and decisions which contribute to better informed investment and policy decisions. However, research to quantify how uncertainties and model assumptions, such as unit commitment (UC), within ReEDS may be affecting its outputs remains challenging due to to size and complexity of the model

24 POWER TRANSMISSION AND DISTRIBUTION↗