Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

The NASA Earth Science Applied Sciences Disasters Program: Making EO Data and Expertise Available through the Disasters Mapping Portal to Inform Decision-Makers throughout the Disaster Cycle

The NASA Earth Science Applied Sciences Disasters Program promotes the use of Earth Observations (EO) to inform disaster risk reduction and resilience throughout the disaster cycle, from local to global scales, by harnessing NASA science and technology capabilities, through engagement with end users to demonstrate the value and impact of EO to support decision-making, and by supporting end users in their use of EO in decision-making while developing relationships to grow as a trusted source of relevant science and useful results. Through the NASA Earth Science Applied Sciences Disasters Program Mapping Portal, an Esri-backed hub of geospatially enabled disaster products, event-based and near-real-time products are hosted to provide end users with analysis-ready data and data services, keeping in mind their expressed EO needs. In this presentation, case studies of past events will be highlighted, showcasing how EO data and services were provided by the Program and utilized by end users during the disaster cycle. Additionally, this presentation will highlight some of the Program’s ongoing collaboration activities to assist end users in understanding and preparing for utilization of EO data from the Mapping Portal to inform their decision-making throughout the disaster cycle. Ongoing efforts to advance the science provided by the Program on the Mapping Portal through new developments and capabilities will be highlighted, and common challenges and data needs end users often encounter when using EO data and our Program’s innovative solutions to these challenges will be addressed. Furthermore, this presentation will touch on the challenges faced and the solutions created by the Mapping Portal team in managing and hosting a plethora of EO data for end users across various disciplines.

Ronan Lucey↗

Mission at Mubasi - A Simulation for Leadership Development

The United States Army is investing in simulations as a way of providing practice for leader decision making. Such simulations, grounded in lessons learned from deployment experienced leaders, place less experienced and more junior leaders in challenging situations they might soon be confronted with. And given increased demands on the Army to become more efficient, while maintaining acceptable levels of mission readiness, simulations offer a cost effective complement to live field training. So too, the design parameters of such a simulation can be made to reinforce specific behavior responses which teach leaders known theory and application of effective (and ineffective) decision making. With this in mind, the Center for Army Leadership (CAL) determined that decision-making was of critical importance. Specifically, the following aspects of decision-making were viewed as particularly important for today's Army leaders: 1) Decision dilemmas, in the form of equally appealing or equally unappealing choices, such that there is no clear "right" or "wrong" choice 2) Making decisions with incomplete or ambiguous information, and 3) Predicting and experiencing second- and third-order consequences of decisions. It is decision making in such a setting or environment that Army leaders are increasingly confronted with given the full spectrum of military operations they must be prepared for. This paper details the approach and development of this decision making simulation.

Cummings, Pau;↗

Decision Insight into Stakeholder Conflict for ERN

Participatory modeling has become an important tool in facilitating resource decision making and dispute resolution. Approaches to modeling that are commonly used in this context often do not adequately account for important human factors. Current techniques provide insights into how certain human activities and variables affect resource outcomes; however, they do not directly simulate the complex variables that shape how, why, and under what conditions different human agents behave in ways that affect resources and human interactions related to them. Current approaches also do not adequately reveal how the effects of individual decisions scale up to have systemic level effects in complex resource systems. This lack of integration prevents the development of more robust models to support decision making and dispute resolution processes. Development of integrated tools is further hampered by the fact that collection of primary data for decision-making modeling is costly and time consuming. This project seeks to develop a new approach to resource modeling that incorporates both technical and behavioral modeling techniques into a single decision-making architecture. The modeling platform is enhanced by use of traditional and advanced processes and tools for expedited data capture. Specific objectives of the project are: (1) Develop a proof of concept for a new technical approach to resource modeling that combines the computational techniques of system dynamics and agent based modeling, (2) Develop an iterative, participatory modeling process supported with traditional and advance data capture techniques that may be utilized to facilitate decision making, dispute resolution, and collaborative learning processes, and (3) Examine potential applications of this technology and process. The development of this decision support architecture included both the engineering of the technology and the development of a participatory method to build and apply the technology. Stakeholder interaction with the model and associated data capture was facilitated through two very different modes of engagement, one a standard interface involving radio buttons, slider bars, graphs and plots, while the other utilized an immersive serious gaming interface. The decision support architecture developed through this project was piloted in the Middle Rio Grande Basin to examine how these tools might be utilized to promote enhanced understanding and decision-making in the context of complex water resource management issues. Potential applications of this architecture and its capacity to lead to enhanced understanding and decision-making was assessed through qualitative interviews with study participants who represented key stakeholders in the basin.

97 MATHEMATICS AND COMPUTING↗

Learning from the Past, Looking to the Future: Modeling Social Unrest in Karachi, Pakistan

Social unrest represents a major challenge for policy makers around the globe, as it can quickly escalate from small scale disturbances to highly public protests, riots and even civil war. This research was motivated by a need to understand social instability and to unpack the comments made during a spring 2013 conference hosted by Pacific Northwest National Laboratory’s Center for Global Security and the U.S. Institute for Peace, where policymakers noted that models considering social instability are often not suitable for decision-making. This analysis shows that existing state level models of instability could be improved in spatial scale to the city level, even without significantly improved data access. Better data would make this analysis more complete and likely improve the quality of the model. Another challenge with incorporating modeling into decision-making is the need to understand uncertainty in a model. Policy makers are frequently tasked with making decisions without a clear outcome, so characterization of uncertainty is critical. This report describes the work and findings of the project. It took place in three phases: a literature review of social stability research, a “hindsight scan” that looked at historical data, and a “foresight scan” looking at future scenarios.

60 APPLIED LIFE SCIENCES↗

Choosing the Best Modeling Platform for Radiological Risk Assessment Models - 20468

Radiological risk assessments, in the form of performance or safety assessments, are often required under regulations or guidance for remediation of contaminated land, decommissioning of contaminated buildings or structures, and radioactive waste disposal. These risk assessments are usually supported by fate and transport models that address decay and ingrowth of radionuclides, as well as their movement through engineered systems and the natural environment. These models are often projected thousands, or more, years into the future, largely because the radioactive species change through decay and ingrowth, and hence the magnitude of the radioactive effect changes with time. There are many computer codes that are available to address this type of modeling. They range from addressing specific pathways or processes such as infiltration of water, groundwater, surface water, air, biota, diffusion and advection of water and gases, to those that try to couple all processes together to evaluate the impact of fate and transport through the entire system to places in space and time to which access is assumed. These different types of codes are sometimes separated with the monikers process-level and systems-level codes, although it is often not clear that this separation does justice to the capabilities of the many codes that are available to evaluate fate and transport of radionuclides. The focus of this paper is the latter group of modeling codes. Several systems level modeling codes exist and are used. There are differences between these codes in terms of utility, flexibility, complexity and cost. The purpose of this paper is to compare a few of these codes in the context of work currently being performed by the International Atomic Energy Agency (IAEA) Modeling and Data for Radiological Impact Assessments (MODARIA) II Working Group 1 (WG1). The MODARIA II WG1's main focus is how stakeholder engaged decision analysis can, or should, be applied to radiological contamination problems so that better, longstanding, sustainable, solutions are reached. However, the WG1 also recognizes the potential impact of the modeling tools that are chosen to address radiological risk, which is often a primary objective of decision making for radiological problems. Other objectives might also be important, such as constraining costs, obtaining financing, minimizing impact on ecosystems, saving cultural resources, saving jobs, farmland, environmental justice, etc., in a full decision analysis for a given radiological contamination problem, but none of these other objectives have the same types of complex modeling needs as minimize radiological dose. Consequently, a further focus of WG1 is to evaluate the potential impacts on decision making of the choice of fate and transport, and risk assessment, modeling codes that are used to support decision making. The WG1 will produce a report at the end of 2020 that will focus on an approach to effective decision making and stakeholder engagement. The report will also consider the role that performance assessment modeling should play in the decision-making process, including the impact of the choice of modeling tools or computer codes on risk-informed decision making. Several sites around the World have been made available by Member States for these model comparisons, and several modeling tools have been considered. However, the focus of this paper is on two of the sites, one in Belgium and one in Ukraine, and on three of the tools: NORMALYSA (NORM And Legacy Site Assessment); GoldSim{sup C}, and AMBER{sup C}. The final report from this working group will also cover other modeling tools, including RESRAD, and PC-Cream{sup R}. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multi-criteria decision analysis for waste management in Saharawi refugee camps

The aim of this paper is to compare different waste management solutions in Saharawi refugee camps (Algeria) and to test the feasibility of a decision-making method developed to be applied in particular conditions in which environmental and social aspects must be considered. It is based on multi criteria analysis, and in particular on the analytic hierarchy process (AHP), a mathematical technique for multi-criteria decision making (Saaty, T.L., 1980. The Analytic Hierarchy Process. McGraw-Hill, New York, USA; Saaty, T.L., 1990. How to Make a Decision: The Analytic Hierarchy Process. European Journal of Operational Research; Saaty, T.L., 1994. Decision Making for Leaders: The Analytic Hierarchy Process in a Complex World. RWS Publications, Pittsburgh, PA), and on participatory approach, focusing on local community's concerns. The research compares four different waste collection and management alternatives: waste collection by using three tipper trucks, disposal and burning in an open area; waste collection by using seven dumpers and disposal in a landfill; waste collection by using seven dumpers and three tipper trucks and disposal in a landfill; waste collection by using three tipper trucks and disposal in a landfill. The results show that the second and the third solutions provide better scenarios for waste management. Furthermore, the discussion of the results points out the multidisciplinarity of the approach, and the equilibrium between social, environmental and technical impacts. This is a very important aspect in a humanitarian and environmental project, confirming the appropriateness of the chosen method.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Nuclear decisionmaking, complexity and emerging and disruptive technologies: A comprehensive assessment

The complex interactions of emerging and disruptive technologies (EDTs) could significantly impact nuclear decision-making, particular in an escalating regional conventional conflict. Such conflicts may present governments with a range of nuclear decisions: whether to introduce a nuclear dimension to a crisis, whether to cross the nuclear threshold through limited nuclear use, how to respond to a limited nuclear attack, whether to expand the scope and intensity of initial limited attacks, and whether to escalate to an all-out nuclear war. At each decision point, EDTs create potential risks as well as rewards. EDTs are likely to influence the context for nuclear decision-making and the choices between different courses of action. EDTs could impact the context of nuclear decision-making by improving or degrading situational assessment, the ability to deliberate, and the ability to manage one’s nuclear forces. EDTs could influence the choice between nuclear restraint or escalation by affecting the perceived strategic benefits, escalatory risks, and operational requirements associated with different courses of action. Even though particular combinations of EDTs could precipitate nuclear use in some scenarios, they could encourage restraint in others. The impact and relevance of the same combinations of EDTs might be different at various nuclear decision points. The availability of specific combinations of EDTs at different stages of a conflict would also vary because of the attrition and one-time-use nature of some capabilities. In later stages of a conflict, the decision maker’s confidence in different combinations of EDTs would depend on their previous experience in using them. While the interactions of EDTs are likely to bring additional complexity to a nuclear decision-making process, EDTs are also not the only source of complexity. Broader strategic, military, operational, legal, moral, and emotional factors are also likely to play an important role. These factors may dominate decision-making in a range of potential cases.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

BioEarth: Envisioning and developing a new regional earth system model to inform natural and agricultural resource management

As managers of agricultural and natural resources are confronted with uncertainties in global change impacts, the complexities associated with the interconnected cycling of nitrogen, carbon, and water present daunting management challenges. Existing models provide detailed information on specific sub-systems (land, air, water, economics, etc). An increasing awareness of the unintended consequences of management decisions resulting from interconnectedness of these sub-systems, however, necessitates coupled regional earth system models (EaSMs). Decision makers’ needs and priorities can be integrated into the model design and development processes to enhance decision-making relevance and "usability" of EaSMs. BioEarth is a current research initiative with a focus on the U.S. Pacific Northwest region that explores the coupling of multiple stand-alone EaSMs to generate usable information for resource decision-making. Direct engagement between model developers and non-academic stakeholders involved in resource and environmental management decisions throughout the model development process is a critical component of this effort. BioEarth utilizes a "bottom-up" approach, upscaling a catchment-scale model to basin and regional scales, as opposed to the "top-down" approach of downscaling global models utilized by most other EaSM efforts. This paper describes the BioEarth initiative and highlights opportunities and challenges associated with coupling multiple stand-alone models to generate usable information for agricultural and natural resource decision-making.

agricultural↗

Risk Assessment Overview

Risk assessment is used in many industries to identify and manage risks. Initially developed for use on aeronautical and nuclear systems, risk assessment has been applied to transportation, chemical, computer, financial, and security systems among others. It is used to gain an understanding of the weaknesses or vulnerabilities in a system so modification can be made to increase operability, efficiency, and safety and to reduce failure and down-time. Risk assessment results are primary inputs to risk-informed decision making; where risk information including uncertainty is used along with other pertinent information to assist management in the decision-making process. Therefore, to be useful, a risk assessment must be directed at specific objectives. As the world embraces the globalization of trade and manufacturing, understanding the associated risk become important to decision making. Applying risk assessment techniques to a global system of development, manufacturing, and transportation can provide insight into how the system can fail, the likelihood of system failure and the consequences of system failure. The risk assessment can identify those elements that contribute most to risk and identify measures to prevent and mitigate failures, disruptions, and damaging outcomes. In addition, risk associated with public and environment impact can be identified. The risk insights gained can be applied to making decisions concerning suitable development and manufacturing locations, supply chains, and transportation strategies. While risk assessment has been mostly applied to mechanical and electrical systems, the concepts and techniques can be applied across other systems and activities. This paper provides a basic overview of the development of a risk assessment.

Prassinos, Peter G.↗

Concepts for Autonomous Operation of Microreactors

Microreactor concepts have seen increasing interest in recent years given their potential use for meeting energy needs in remote and grid-isolated communities. Given the small power outputs of microreactors and the potential for remote siting, there is a need to reduce operational staffing levels to improve their economic viability. A key enabling technology for this purpose is autonomous control that enables autonomous operation of microreactors. While several options for autonomous control exist, the level of human operator involvement in operational decision making needs to be defined as part of the system design process. Once this separation of function is achieved, several options exist for autonomous control ranging from simple automation of some procedures to fully autonomous operational mode decision making and execution.A critical aspect of autonomous decision making is the ability to have as complete an awareness of the system state as possible. In addition to data on temperature, pressure, flow, and neutron flux, measurements of the condition of important components will be necessary. This type of information will allow the autonomous control system to adapt its decision making to any changing conditions within the reactor, thereby not compromising safety while continuing to operate for as long as possible. Several technical advances are needed before widespread use of autonomous control in microreactors. These include sensor and instrumentation technologies that are capable of long term, unattended operation in harsh environments, technologies for inferring the state of the microreactor system or subsystems in an automated fashion, algorithms for predictive decision making that account for the assessed condition of the microreactor subsystems as well as the potential impact on those components of any operational decision, and actuators and control system hardware that are also long-lived in a harsh environment. In addition, given the need to remotely monitor the operations, cybersecurity requirements will likely need to be imposed to ensure secure operations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Modeling Common-Sense Decisions in Artificial Intelligence

A methodology has been conceived for efficient synthesis of dynamical models that simulate common-sense decision- making processes. This methodology is intended to contribute to the design of artificial-intelligence systems that could imitate human common-sense decision making or assist humans in making correct decisions in unanticipated circumstances. This methodology is a product of continuing research on mathematical models of the behaviors of single- and multi-agent systems known in biology, economics, and sociology, ranging from a single-cell organism at one extreme to the whole of human society at the other extreme. Earlier results of this research were reported in several prior NASA Tech Briefs articles, the three most recent and relevant being Characteristics of Dynamics of Intelligent Systems (NPO -21037), NASA Tech Briefs, Vol. 26, No. 12 (December 2002), page 48; Self-Supervised Dynamical Systems (NPO-30634), NASA Tech Briefs, Vol. 27, No. 3 (March 2003), page 72; and Complexity for Survival of Living Systems (NPO- 43302), NASA Tech Briefs, Vol. 33, No. 7 (July 2009), page 62. The methodology involves the concepts reported previously, albeit viewed from a different perspective. One of the main underlying ideas is to extend the application of physical first principles to the behaviors of living systems. Models of motor dynamics are used to simulate the observable behaviors of systems or objects of interest, and models of mental dynamics are used to represent the evolution of the corresponding knowledge bases. For a given system, the knowledge base is modeled in the form of probability distributions and the mental dynamics is represented by models of the evolution of the probability densities or, equivalently, models of flows of information. Autonomy is imparted to the decisionmaking process by feedback from mental to motor dynamics. This feedback replaces unavailable external information by information stored in the internal knowledge base. Representation of the dynamical models in a parameterized form reduces the task of common-sense-based decision making to a solution of the following hetero-associated-memory problem: store a set of m predetermined stochastic processes given by their probability distributions in such a way that when presented with an unexpected change in the form of an input out of the set of M inputs, the coupled motormental dynamics converges to the corresponding one of the m pre-assigned stochastic process, and a sample of this process represents the decision.

Zak, Michail↗

Improving Site-Specific Radiological Performance Assessments - 13431

An improved approach is presented for conducting complete and defensible radiological site-specific performance assessments (PAs) to support radioactive waste disposal decisions. The basic tenets of PA were initiated some thirty years ago, focusing on geologic disposals and evaluating compliance with regulations. Some of these regulations were inherently probabilistic (i.e., addressing uncertainty in a quantitative fashion), such as the containment requirements of the U.S. Environmental Protection Agency's (EPA's) 40 CFR 191, Environmental Radiation Protection Standards for Management and Disposal of Spent Nuclear Fuel, High-Level and Transuranic Radioactive Wastes, Chap. 191.13 [1]. Methods of analysis were developed to meet those requirements, but at their core early PAs used 'conservative' parameter values and modeling approaches. This limited the utility of such PAs to compliance evaluation, and did little to inform decisions about optimizing disposal, closure and long-term monitoring and maintenance, or, in general, maintaining doses 'as low as reasonably achievable' (ALARA). This basic approach to PA development in the United States was employed essentially unchanged through the end of the 20. century, principally by the U.S. Department of Energy (DOE). Performance assessments developed in support of private radioactive waste disposal operations, regulated by the U.S. Nuclear Regulatory Commission (NRC) and its agreement states, were typically not as sophisticated. Discussion of new approaches to PA is timely, since at the time of this writing, the DOE is in the midst of revising its Order 435.1, Radioactive Waste Management [2], and the NRC is revising 10 CFR 61, Licensing Requirements for Land Disposal of Radioactive Waste [3]. Over the previous decade, theoretical developments and improved computational technology have provided the foundation for integrating decision analysis (DA) concepts and objective-focused thinking, plus a Bayesian approach to probabilistic modeling and risk analysis, to guide improvements in PA. This decision-making approach, [4, 5, 6] provides a transparent formal framework for using a value- or objective-focused approach to decision-making. DA, as an analytical means to implement structured decision making, provides a context for both understanding how uncertainty affects decisions and for targeting uncertainty reduction. The proposed DA approach improves defensibility and transparency of decision-making. The DA approach is fully consistent with the need to perform realistic modeling (rather than conservative modeling), including evaluation of site-specific factors. Instead of using generic stylized scenarios for radionuclide fate and transport and for human exposures to radionuclides, site-specific scenarios better represent the advantages and disadvantages of alternative disposal sites or engineered designs, thus clarifying their differences as well as providing a sound basis for evaluation of site performance. The full DA approach to PA is described, from explicitly incorporating societal values through stakeholder involvement to model building. Model building involves scoping by considering features, events, processes, and exposure scenarios (FEPSs), development of a conceptual site model (CSM), translation into numerical models and subsequent computation, and model evaluation. These are implemented in a cycle of uncertainty analysis, sensitivity analysis and value of information analysis so that uncertainty can be reduced until sufficient confidence is gained in the decisions to be made. This includes the traditional focus on hydrogeological processes, but also places emphasis on other FEPSs such as biotically-induced transport and human exposure phenomena. The significance of human exposure scenarios is emphasized by modifying the traditional acronym 'FEPs' to include them, hence 'FEPSs'. The radioactive waste community is also recognizing that disposal sites are to be considered a national (or even global) resource. As such, there is a pressing need to optimize their utility within the constraints of protecting human health and the environment. Failing to do so will result in the need for additional sites or options for storing radioactive waste temporarily, assuming a continued need for radioactive waste disposal. Optimization should be performed using DA, including economic analysis, invoked if necessary through the ALARA process. The economic analysis must recognize the cost of implementation (disposal design, closure, maintenance, etc.), and intra- and inter-generational equity in order to ensure that the best possible radioactive waste management decisions are made for the protection of both current and future generations. In most cases this requires consideration of population or collective risk. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An IAEA Initiative to Provide Effective Stakeholder Support Services for International Decommissioning and Environmental Remediation - 17341

The International Atomic Energy Agency (IAEA) has initiated a collaborative effort to promote stakeholder support activities through a stakeholder engagement advisory program (SEAP) as part of Phase II of the Constraints to Implementing Decommissioning and Environmental Remediation (CIDER II) program. CIDER II is a collaborative project involving a broad range of Member States, large and small, with ongoing and/or planned decommissioning and environmental remediation (D and ER) programs. The intent of this sub-group of CIDER II is to facilitate better sharing of information and knowledge in areas of stakeholder communication, engagement and participation, and a framework for directly using stakeholder input in the decision making process. The goal is to support trust building in D and ER decisions for radioactive contamination and facilities. A main premise of the CIDER II program is that stakeholder acceptance is necessary for successful D and ER decisions to be made. This paper introduces some of the major challenges to implementing such a broad scale of support for stakeholder engagement, and approaches to overcoming those challenges. Major challenges include the need to address D and ER decision making in different countries with their different languages, cultures, religions, management structures, and politics. For example, in some cases it might be important strategically to first garner support from upper levels of social, management or political hierarchies, including for example, approaching community leaders, and allowing those leaders to directly address their community. Other sites might have more success, for example, if stakeholder interaction starts with the community members. A specific project strategy also probably depends on who makes the request for stakeholder support services. Once the CIDER II SEAP gains traction, there will be a need to prioritize requests from Member States for assistance in connection with specific D and ER projects. A prioritization tool will be developed based on stakeholder engaged structured decision making (SDM). The projects in which support will initially be focused will span a wide range of D and ER problems, types of stakeholder groups, and technical issues such as potential risk to human health and the environment. A database management system will also be designed to capture information from the different proposed projects and will be expanded to house implemented projects for future reference. The case study database will be an integral part of a web-based system that also contains technical approaches for stakeholder involvement depending on the situational environment. A community of practice will be formed that will involve technical experts in stakeholder engagement and structured decision making, and informed representatives from Member States. This will address the need for SEAP to build capacity and provide education for solving D and ER problems. The web-based system will include technical tools for use by the projects, such as: identification of stakeholder groups; social network analysis (how stakeholders are connected); case study forms; best practice forms; information sheets; and 4tools that will directly support optimization of stakeholder guided solutions to D and ER problems. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Contested environmental policy infrastructure: Socio-political acceptance of renewable energy, water, and waste facilities

The construction of new infrastructure is hotly contested. This paper presents a comparative study on three environmental policy domains in the Netherlands that all deal with legitimising building and locating infrastructure facilities. Such infrastructure is usually declared essential to environmental policy and claimed to serve sustainability goals. They are considered to serve (proclaimed) public interests, while the adverse impact or risk that mainly concerns environmental values as well is concentrated at a smaller scale, for example in local communities. The social acceptance of environmental policy infrastructure is institutionally determined. The institutional capacity for learning in infrastructure decision-making processes in the following three domains is compared: 1.The implementation of wind power as a renewable energy innovation; 2.The policy on space-water adaptation, with its claim to implement a new style of management replacing the current practice of focusing on control and 'hard' infrastructure; 3.Waste policy with a focus on sound waste management and disposal, claiming a preference for waste minimization (the 'waste management hierarchy'). All three cases show a large variety of social acceptance issues, where the appraisal of the impact of siting the facilities is confronted with the desirability of the policies. In dealing with environmental conflict, the environmental capacity of the Netherlands appears to be low. The policies are frequently hotly contested within the process of infrastructure decision-making. Decision-making on infrastructure is often framed as if consensus about the objectives of environmental policies exists. These claims are not justified, and therefore stimulating the emergence of environmental conflicts that discourage social acceptance of the policies. Authorities are frequently involved in planning infrastructure that conflicts with their officially proclaimed policy objectives. In these circumstances, they are often confronted with local actors who support alternatives that are in fact better in tune with the new policy paradigm.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Decision Science for Machine Learning (DeSciML)

The increasing use of machine learning (ML) models to support high-consequence decision making drives a need to increase the rigor of ML-based decision making. Critical problems ranging from climate change to nonproliferation monitoring rely on machine learning for aspects of their analyses. Likewise, future technologies, such as incorporation of data-driven methods into the stockpile surveillance and predictive failure analysis for weapons components, will all rely on decision-making that incorporates the output of machine learning models. In this project, our main focus was the development of decision scientific methods that combine uncertainty estimates for machine learning predictions, with a domain-specific model of error costs. Other focus areas include uncertainty measurement in ML predictions, designing decision rules using multiobjecive optimization, the value of uncertainty reduction, and decision-tailored uncertainty quantification for probability estimates. By laying foundations for rigorous decision making based on the predictions of machine learning models, these approaches are directly relevant to every national security mission that applies, or will apply, machine learning to data, most of which entail some decision context.

97 MATHEMATICS AND COMPUTING↗

Quantitative Universal Option Prioritizer (QUOP) v1.0.0

Quantitative Universal Option Prioritizer (QUOP) is a three-layer analytical hierarchy process (AHP) based multi-criteria decision-making option evaluation and prioritization tool. Decision-making often entails evaluation of options. Such competing options can either be mutual substitutes or cumulative means to achieve an objective. The options themselves can be methods, tools, technologies, processes, etc. Stakeholders involved in achieving the objective may view each option characteristic differently, depending on their needs and preferences. The QUOP tool enables a streamlined quantitative collaborative process of weighing the opinion of each stakeholder in evaluating the options. The evaluation may also be performed under different scenarios, for instance, various option potential estimates, prices, or end-user demand projections. The QUOP tool can find application in both public and private sectors, as well as on an individual level. The major advantage of using the QUOP decision-making tool is in documenting the quantified stakeholder opinion, therefore the background to each decision made, while simultaneously maintaining high transparency and stakeholder involvement. The tool is particularly suitable for decisions involving a high number of options and option characteristics, that is, aspects of each option that matter to the stakeholders

Grahovac, Milica↗

New approaches for real time decision support systems

NCCOSC RDT&E Division (NRaD) is conducting research into ways of improving decision support systems (DSS) that are used in tactical Navy decision making situations. The research has focused on the incorporation of findings about naturalistic decision-making processes into the design of the DSS. As part of that research, two computer tools were developed that model the two primary naturalistic decision-making strategies used by Navy experts in tactical settings. Current work is exploring how best to incorporate the information produced by those tools into an existing simulation of current Navy decision support systems. This work has implications for any applications involving the need to make decisions under time constraints, based on incomplete or ambiguous data.

Hair, D. Charles↗

ASK Talks with Gary Klein

Gary Klein, PH.D., is chief scientist of Klein Associates, Inc., a company he founded in 1978 to better understand how to improve decision making in individuals and teams. The company has 30 employees working on projects for both government and commercial clients. Dr. Klein is one of the founders of the field of naturalistic decision making. His work on recognitional decision making has been influential for the design of new systems and interfaces, and for the development of decision training programs. He has extended his work on decision making to describe problem detection, opinion generation, sense making, and planning.

Klein, Gary↗