Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DECISION MAKING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Decision-Making in Complex Dynamical Systems of Systems With One Opposing Subsystem

Many complex dynamical systems consist of a large number of interacting subsystems that operate harmoniously and make decisions that are designed for the benefit of the entire enterprise. If, in an attempt to disrupt the operation of the entire system, one subsystem gets attacked and is made to operate in a manner that is adversarial with the others, then the entire system suffers, resulting in an adversarial decision-making environment among its subsystems. Such an environment may affect not only the decision-making process of the attacked subsystem but also possibly the other remaining subsystems as well. The disruption caused by the attacked subsystem may cause the remaining subsystems to either coalesce as a unified team making team-based decisions, or disintegrate and act as independent decision-making entities. The decision-making process in these types of complex systems of systems is best analyzed within the general framework of cooperative and non-cooperative game theory. In this paper, we will develop an analysis that provides a theoretical basis for modeling the decision-making process in such complex systems. We show how cooperation among the subsystems can produce Noninferior Nash Strategies (NNS) that are fair and acceptable to all subsystems within the team while at the same time provide the subsystems in the team with the security of the Nash equilibrium against the opposing attacked subsystem. We contrast these strategies with the all Nash Strategies (NS) that would result if the operation of the entire system disintegrated and became adversarial among all subsystems as a result of the attack. An example of a system consisting of three subsystems with one opposing subsystem as a result of an attack is included to illustrate the results.

Talebi, Shahriar↗

Visualization and Decision Making Design Under Uncertainty

Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.

data models↗

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A template of information needs for decision-making about delaying remediation on contaminated lands to protect human health

The contamination legacy of industrialization, militarization, and nuclear arms race poses current or future risks to populations and the environment. Responsible parties and regulators make decisions regarding which sites to clean up, how, how much, and when. This study aimed to provide an information needs template to evaluate and reduce risks to human health when considering whether to initiate or delay remediation. This investigation focused on four aspects of timing and prioritization: 1) management, planning and implementation, 2) source terms, pathways, and exposures, 3) risks and receptors, and 4) external drivers. Within each type, issues were identified and described. Management class included personnel, health and safety data, funding, equipment, and structural integrity. Source term included contaminant sources, pathways, initiating events, and barriers to exposure. Risk included types and exposures to workers and general public. External drivers included regulatory framework, stakeholders, Congressional mandates, and economic and social contexts. Risk may increase over time as contamination spreads, enters aquifers, and reaches receptors, and may decline as radionuclides decay, and plumes dissipate. The overall objective was to provide a template of information that is useful to managers and regulators, and might be used by the public to understand the risks and benefits of re-prioritization cleanup.

Environmental Sciences & Ecology↗

Simulation-Guided Decision-Making for Enhancing Energy Resilience in a Remote Alaskan Community

The increasing frequency and severity of extreme weather events underscore the need to bolster the resilience of energy infrastructure in remote coastal communities exposed to climate hazards. In recent years, considerable effort has been made to harden the grid infrastructure of remote communities through investment in energy storage, advanced metering, renewable generation and energy-efficient loads. However, simulation-based studies are still needed to identify appropriate locations for investment and determine the adequacy of existing infrastructure in supporting new resources. Preparing the required models may often be challenging due to insufficient metering, disparate data sources and workforce limitations. This paper describes modeling efforts undertaken to represent, within a unified co-simulation platform: (a) the electric distribution network and (b) the thermal behavior of a community medical center, in the remote community of Cordova, Alaska. With the help of case-studies, it is shown how the developed simulation platform can help the local utility in making decisions regarding capital investment aimed at enhancing community resilience.

Microgrid, energy storage, resilience↗

Completing the Link between Exposure Science and Toxicology for Improved Environmental Health Decision Making: The Aggregate Exposure Pathway Framework

Driven by major scientific advances in analytical methods, biomonitoring, and computational exposure assessment, and a newly articulated vision for a greater impact in public health, the field of exposure science is undergoing a rapid transition from a field of observation to a field of prediction. Deployment of an organizational and predictive framework for exposure science analogous to the computationally enabled “systems approaches” used in the biological sciences is a necessary step in this evolution. Here we propose the aggregate exposure pathway (AEP) concept as the natural and complementary companion in the exposure sciences to the adverse outcome pathway (AOP) concept in the toxicological sciences. The AEP framework offers an intuitive approach to successful organization of exposure science data within individual units of prediction common to the field, setting the stage for exposure forecasting. Looking farther ahead, we envision direct linkages between aggregate exposure pathway and adverse outcome pathways, completing the source to outcome continuum and setting the stage for more efficient integration of exposure science and toxicity testing information. Together these frameworks form and inform a decision making framework with the flexibility for risk-based, hazard-based or exposure-based decisions.

Teeguarden, Justin G.↗

Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory

This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.

Markov decision process↗

Visualization and Analysis for Near-Real-Time Decision Making in Distributed Workflows

Data driven science is becoming increasingly more common, complex, and is placing tremendous stresses on visualization and analysis frameworks. Data sources producing 10GB per second (and more) are becoming increasingly commonplace in both simulation, sensor and experimental sciences. These data sources, which are often distributed around the world, must be analyzed by teams of scientists that are also distributed. Enabling scientists to view, query and interact with such large volumes of data in near-real-time requires a rich fusion of visualization and analysis techniques, middleware and workflow systems. Here, this paper discusses initial research into visualization and analysis of distributed data workflows that enables scientists to make near-real-time decisions of large volumes of time varying data.

97 MATHEMATICS AND COMPUTING↗

Regulatory Decision-Making Process Using 'Weight of Evidence: An Evidence Integration Approach' by the State of Washington at the Hanford Site - 20163

Performance Assessment and Environmental Impact Statement Modeling, Human and Ecological Risk Assessments are the tools used by the Washington State Department of Ecology (Ecology) to make regulatory decisions for permitting and cleanup. These efforts all inherently have large amounts of uncertainty no matter how many alternative approaches are attempted. Professional feedback from tribal governments, stakeholders, federal and state regulators, the public and independent peer review groups are taken into account in this process of informed decision making. The process also includes full evaluation of the comments and the associated reviews made by the various peer review groups such as the Low -Level Waste Disposal Facility Federal Review Group (DOE order 435.1) and the Nuclear Regulatory Commission (NRC). The evolution of technology has produced quicker and more efficient fate and transport modeling tools with related quantification of uncertainties and their significance. Groundwater and vadose zone models have been expanded across the entire Hanford site. Many of the technical approaches identified in the Washington State Regulations are updated using current knowledge to better understand the complexities of the Hanford Site using the latest state of the art tools for risk assessment and modeling. More emphasis and time are directed on defining uncertainty and then managing the uncertainty. One added tool is to run sensitivity cases based on informed decision making. The weight of evidence approach considers all relevant information in an integrative assessment that takes into account the kinds of evidence available, the quality and quantity, the uncertainty and error associated with each type, and how they fit together. Evidence of integration involves looking at systematic reviews and evaluating their strengths and weaknesses. In conclusion, Ecology, Washington State's lead regulatory agency at the Hanford site, has had to modify its site closure approach compared to the rest of the state. A more holistic approach dealing with the Hanford site as an integrated system has evolved leading to a defensible informed approach for regulatory closure decisions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrated Risk-Informed Decision-Making for an ALMR PRISM

Decision-making is the process of identifying decision alternatives, assessing those alternatives based on predefined metrics, selecting an alternative (i.e., making a decision), and then implementing that alternative. The generation of decisions requires a structured, coherent process, or a decision-making process. The overall objective for this work is that the generalized framework is adopted into an autonomous decision-making framework and tailored to specific requirements for various applications. In this context, automation is the use of computing resources to make decisions and implement a structured decision-making process with limited or no human intervention. The overriding goal of automation is to replace or supplement human decision makers with reconfigurable decision-making modules that can perform a given set of tasks rationally, consistently, and reliably. Risk-informed decision-making requires a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety systems. The probabilistic portion of the decision-making engine of the supervisory control system is based on the control actions associated with an ALMR PRISM. Newly incorporated into the probabilistic models are the prognostic/diagnostic models developed by Pacific Northwest National Laboratory. These allow decisions to incorporate the health of components into the decision–making process. Once the control options are identified and ranked based on the likelihood of success, the supervisory control system transmits the options to the deterministic portion of the platform. The deterministic portion of the decision-making engine uses thermal-hydraulic modeling and components for an advanced liquid-metal reactor Power Reactor Inherently Safe Module. The deterministic multi-attribute decision-making framework uses various sensor data (e.g., reactor outlet temperature, steam generator drum level) and calculates its position within the challenge state, its trajectory, and its margin within the controllable domain using utility functions to evaluate current and projected plant state space for different control decisions. The metrics that are evaluated are based on reactor trip set points. The integration of the deterministic calculations using multi-physics analyses and probabilistic safety calculations allows for the examination and quantification of margin recovery strategies. This also provides validation of the control options identified from the probabilistic assessment. Thus, the thermalhydraulics analyses are used to validate the control options identified from the probabilistic assessment. Future work includes evaluating other possible metrics and computational efficiencies, and developing a user interface to mimic display panels at a modern nuclear power plant.

97 MATHEMATICS AND COMPUTING↗

Development of a First-of-a-Kind Deterministic Decision-Making Tool for Supervisory Control System

Decision-making is the process of identifying and choosing alternatives where each alternative offers a different approach or path to move from a given state or condition to a desired state or condition. The generation of consistent decisions requires that a structured, coherent process be defined, immediately leading to a decision-making framework. The overall objective of the generalized framework is for it to be adopted into an autonomous decision-making framework and tailored to specific requirements for various applications. In this context, automation is the use of computing resources to make decisions and implement a structured decision-making process with limited or no human intervention. The overriding goal of automation is to replace or supplement human decision makers with reconfigurable decision- making modules that can perform a given set of tasks reliably. Risk-informed decision making requires a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety systems. The implementation of the probabilistic portion of the decision-making engine of the proposed supervisory control system was detailed in previous milestone reports. Once the control options are identified and ranked based on the likelihood of success, the supervisory control system transmits the options to the deterministic portion of the platform. The deterministic multi-attribute decision-making framework uses variable sensor data (e.g., outlet temperature) and calculates where it is within the challenge state, its trajectory, and margin within the controllable domain using utility functions to evaluate current and projected plant state space for different control decisions. Metrics to be evaluated include stability, cost, time to complete (action), power level, etc. The integration of deterministic calculations using multi-physics analyses (i.e., neutronics, thermal, and thermal-hydraulics) and probabilistic safety calculations allows for the examination and quantification of margin recovery strategies. This also provides validation of the control options identified from the probabilistic assessment. Thus, the thermal-hydraulics analyses are used to validate the control options identified from the probabilistic assessment. Future work includes evaluating other possible metrics and computational efficiencies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Effects of Gain/Loss Framing in Cyber Defense Decision-Making

Cyber defense requires decision making under uncertainty. Yet this critical area has not been a strong focus of research in judgment and decision-making. Future defense systems, which will rely on software-defined networks and may employ ‘moving target’ defenses, will increasingly automate lower level detection and analysis, but will still require humans in the loop for higher level judgment. We studied the decision making process and outcomes of 17 experienced network defense professionals who worked through a set of realistic network defense scenarios. We manipulated gain versus loss framing in a cyber defense scenario, and found significant effects in one of two focal problems. Defenders that began with a network already in quarantine (gain framing) used a quarantine system more than those that did not (loss framing). We also found some difference in perceived workload and efficacy. Alternate explanations of these findings and implications for network defense are discussed.

cyber security↗

Correlated Trajectory Uncertainty for Adaptive Sequential Decision Making

One of the great challenges with decision making tasks on real world systems is the fact that data is sparse and acquiring additional data is expensive. In these cases, it is often crucial to make a model of the environment to assist in making decisions. At the same time, limited data means that learned models are erroneous, making it just as important to equip the model with good predictive uncertainties. In the context of learning sequential decision making policies, these uncertainties can prove useful for informing which data to collect for the greatest improvement in policy performance \citep{mehta2021experimental, mehta2022exploration} or informing the policy about unsure regions of state and action space to avoid during test time \citep{yu2020mopo}. Additionally, assuming that realistic samples of the environment can be drawn, an adaptable policy can be trained that attempts to make optimal decisions for any given possible instance of the environment \citep{ghosh2022offline, chen2021offline}. In this work, we examine the so-called ``probabilistic neural network'' (PNN) model that is ubiquitous in model-based reinforcement learning (MBRL) works. We argue that while PNN models may have good marginal uncertainties, they form a distribution of non-smooth transition functions. Not only are these samples unrealistic and may hamper adaptability, but we also assert that this leads to poor uncertainty estimates when predicting multiple step trajectory estimates. To address this issue, we propose a simple sampling method that can be implemented on top of pre-existing models.We evaluate our sampling technique on a number of environments, including a realistic nuclear fusion task, and find that, not only do smooth transition function samples produce more calibrated uncertainties, but they also lead to better downstream performance for an adaptive policy.

Offline Reinforcement Learning↗

'A Good Decision Is Based On Information, Not On Numbers' - A Process For National Strategic Decision Making - 17203

Waste management decision making is the process used by waste owners to determine and justify choices in across the lifecycle of a waste (from the manner of generation or retrieval to final disposition). In the UK, waste owners in the nuclear industry are obligated, by their environmental permits and authorisations, to demonstrate the application of robust and well-underpinned decision making processes for waste management. This is captured through the requirement for waste owners to demonstrate the identification and implementation of Best Available Technique (BAT). The National Waste Programme (NWP), led by LLW Repository Ltd, is a UK wide programme which leads the implementation of the UK National Strategy for the management of solid LLW from the nuclear industry [1] and which aims to deliver a self-sustaining culture for optimised management of Low Level Waste (LLW) in the UK. Recognising the requirement on waste owners, the NWP has - in conjunction with appointed contractors - led the development and publication of national strategic optioneering studies (so-called national strategic BAT studies) to support waste owners. Recognising the benefits that this approach to optioneering and strategic decision making could have for other waste producers, this paper provides an overview of the process used for the development of the suite of national strategic BAT assessments for the NWP. It details: the main phases of the process, the key features of each process phase, the benefits of the approach and key learning from its deployment in practice. Note: The legislative regime in England and Wales requires the identification and application of BAT. There is an equivalent regime in Scotland known as Best Practicable Environmental Option (BPEO) and Best Practicable Means (BPM). The requirements are comparable across the two legislative regimes and, for the purposes of simplicity, the term BAT will be utilised in this paper. The approach and outcomes of the national strategic optioneering process described are applicable across the UK. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Paradigm Shift continued: An Application of Structured Decision Making for Sustainable Waste Management - 16486

Structured decision making presents an opportunity for DOE and others engaged in solving complex environmental and waste management problems to find solutions that are stakeholder engaged and cost effective. This approach represents a paradigm shift that was introduced in a series of papers and a panel session at the WM2015 Symposium. The advantages of structured decision making over less formal approaches to decision making include technical defensibility, traceability and transparency. Structured decision making also overcomes the limitations of misapplication of conservatism in modeling, addresses stakeholder concerns and competing objectives directly, and provides a formal method through which internal and external stakeholders are encouraged to collectively and carefully consider all relevant attributes of solving complex problems. The first requirement of this paradigm shift is a realization and recognition that the problems faced are inherently decision problems, and that there is a formal theory of decision analysis that can, and should, be used to support finding the best solutions. Structured decision making is, very simply, formalized common sense. The formalities include: framing the problem; identification of objectives and measures for valuing those objectives; costs or values associated with those objectives; management options or alternatives for taking action that are tied directly to the objectives; and, science-based models to evaluate the options. Decision analysis is used to evaluate objectives and choose management options by balancing probability and consequence. The science-based models are built probabilistically based on expectation and uncertainty, and costs and value judgments are used to fulfill addressing stakeholder concerns. Consequently, this approach avoids misplaced conservatism in science-based modeling and properly places values in the objectives component of a decision model. This approach honestly addresses uncertainty and value judgments and balances these competing components to find the most effective decision. A software framework program called Guided Interactive Statistical Decision Tools (GiSdT - pronounced 'gist') is used to support an application of this paradigm shift towards structured decision making. In this application objectives and management options for a waste disposal problem at the Los Alamos National Laboratory are identified, and features, events and processes are described and defined to form the basis of a conceptual site model. This establishes the decision model structure. Objectives are addressed through the three pillars of sustainability - economic, environmental, and social - and also address regulatory concerns or constraints. Management options include removal of waste to another location and engineering designs for leaving waste in place. Using structured decision making, the relationship between objectives, management options, and the conceptual site model is made clear, and leads to a comprehensive, defensible, transparent and traceable approach to effective decision making. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

On the application of the expected log-likelihood gain to decision making in molecular replacement

Molecular-replacement phasing of macromolecular crystal structures is often fast, but if a molecular-replacement solution is not immediately obtained the crystallographer must judge whether to pursue molecular replacement or to attempt experimental phasing as the quickest path to structure solution. The introduction of the expected log-likelihood gain has given the crystallographer a powerful new tool to aid in making this decision. The eLLG is the log-likelihood gain on intensity expected from a correctly placed model. It is calculated as a sum over the reflections of a function dependent on the fraction of the scattering for which the model accounts, the estimated model coordinate error and the measurement errors in the data. It is shown how the eLLG may be used to answer the question 'can I solve my structure by molecular replacement?'. However, this is only the most obvious of the applications of the eLLG. It is also discussed how the eLLG may be used to determine the search order and minimal data requirements for obtaining a molecular-replacement solution using a given model, and for decision making in fragment-based molecular replacement, single-atom molecular replacement and likelihood-guided model pruning.

59 BASIC BIOLOGICAL SCIENCES↗