Use of multi attribute decision analysis models to characterize the WMD vulnerabilities of countries to help support global threat reduction actions.
Abstract not provided.
Caskey, Susan A.↗
SEARCH · Engineering Papers
Results for “decision analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Outbreak Detection and Response Country Prioritization Multi-Criteria Decision Analysis Model for Risk of Uncontrolled Outbreak in West Africa.
Abstract not provided.
Wallis, Laurie Dawn↗
A multi-criteria decision analysis-based approach for dispatch of electric microgrids
This paper presents a decision support system (DSS) for multi-objective dispatch of an electric microgrid con-sidering cost of operation, peak load reduction, and emissions. Discrete compromise programming (DCP) is used as the multi-criteria decision analysis (MCDA) technique for providing the decision support to the distribution system operator (DSO) by ranking various alternatives based on preference of the objec-tives. Simulations are performed on a notional electric microgrid based on the IEEE 13-node test feeder and the results are pre-sented with appropriate visualization.
24 POWER TRANSMISSION AND DISTRIBUTION↗
PROACTIVE Focus Area 4: Structured Decision Metrics Analysis (Final Report)
A structured decision metrics analysis was developed as one of the tasks under PROACTIVE’s Focus Area 4 (FA4) and used structured decision metrics for processes, items, and facilities (PIF) to determine the efficacy of an M&V system in meeting treaty goals and technical objectives. The method starts with the functional decomposition of a “treaty” with the M&V system overlaid on it. A Functional Decomposition Rubric (FDR) for each PIF is used to determine a score ranging from 0 (weak) to 4 (strong) for assurance, security, and burden. The individual scores are combined to provide an overall Verification System Score (VSS) which assesses the overall verification system’s suitability given goals; scores for each step of the process are also given. The outcome of the evaluation is to identify needs or modifications to the enterprise model, verification system, or proposed testbed capabilities. VeriScore was used to evaluate FA4’s Spiral 0 exercise; those results are included in this report. The VeriScore and FDR framework can also be used in a non-treaty environment, as any goal/objective/method structure will work, thus expanding its applicability beyond traditional arms control structures.
99 GENERAL AND MISCELLANEOUS↗
Warhead Complexity Analysis Process for Decision and Cost Analysis.
Abstract not provided.
Samberson, Jonell Nicole↗
Hierarchical neural networks for autonomous data analysis and decision making
A neural network based data analysis and decision making system to increase the autonomy of a planetary rover or similar exploratory vehicle is presented. A hierarchical series of neural networks for real time analysis of scientific images is used. The system under development emphasizes analysis of multispectral images by classifier and feature detector neural networks, to provide information on the mineral composition of a scene. A hierarchy of alternating analysis and decision making networks is being developed to allow increasingly fine scale analysis in regions of the image that are potentially important. It is noted that this system will facilitate both the selection of high priorty scientific information for transmission to earth, and the autonomous collection of rocks and soil for sample return.
Eberlein, Susan↗
Stakeholder-Engaged Structured Decision Making for the Los Alamos Legacy Cleanup Mission - 20501
The Los Alamos National Laboratory (LANL) environmental legacy cleanup program requires decisions to be made for environmental remediation, decommissioning and disposal or management of radioactive waste. This legacy cleanup program was established to address groundwater contamination, material disposal areas (MDAs) that have been used to dispose of radioactive and other waste material, and 'aggregate areas' that might produce radioactive or other chemical waste as a result of remediation activities. The LANL site is regulated for environmental concerns under the Resource Conservation and Recovery Act (RCRA). However, some parts of LANL, such as material disposal area G (MDA G), have disposed of radioactive waste under DOE Order 435.1, and are subject to other regulations. For example, decommissioning the remote-handled TRU material stored in 33 shafts at MDA G falls under EPA's 40 CFR 191. Collectively, the regulations are all aimed in the same direction of finding the best solution, either through constructs such as 'as low as reasonably achievable' (ALARA), considering balancing factors as opposed to only cost and human health risk, and, under EPA regulations such as RCRA and NEPA, evaluating impact from all chemicals and both human health and ecological endpoints. Despite the basic goals and objectives of the regulations or their guidance, the main challenge is in their implementation. Arguably perhaps, but really in principle, all of these (and similar) regulations are asking for a decision analysis to be performed. Implementation challenges encountered have included lack of understanding of decision analysis in the industry, lack of effective stakeholder engagement in the decision analysis process, and lack of appreciation of the need to separate value judgments from science, the latter leading to developing conservative, or protective, science-based models. Conservative models lead to poor solutions, lack of effective stakeholder engagement leads to long drawn out protracted approaches to finding a solution (which also might never be found with this approach), and lack of understanding of decision analysis and Bayesian statistics causes poor models to be built, which creates unfortunate situations of 'garbage in, garbage out' becoming the basis for decision making. Stakeholder-engaged structured decision making (SDM) is an approach to solving problems that relies on the theory of decision science to involve stakeholders in the decision-making process. This approach incorporates stakeholder values using a scientifically rigorous methodology that separates value judgments from science in a way that helps avoid the pitfalls of biased, protective, or conservative modeling. This approach has its foundation in Keeney's 1992 treatise on value-focused thinking [1]. Keeney advocated a paradigm shift in decision making based on the idea that the standard way of thinking about decisions is backwards. The standard approach of focusing first on identifying alternatives rather than on articulating values results in a reactive approach with the emphasis on mechanics and fixed choices instead of the core values that have meaning to stakeholders. This paradigm shift effectively engages all stakeholders in the decision-making process while using a values focused thinking approach that can lead to the identification of decision opportunities and the creation of better alternatives. The intent is to be proactive and generate solutions that are related directly to values and objectives as identified by stakeholders. There are, perhaps, two overarching reasons why SDM can be used to benefit LANL's environmental legacy cleanup. Some of LANL's remaining waste management and environmental management problems are challenging and complex (for example, the Cr and RDX plumes, and MDAs) and while the traditional approach has, arguably, worked well for relatively simple risk-based problems, it cannot, or should not, be applied to more complex problems if the most effective and efficient solutions are desired. The second reason is cost. This has perhaps become more critical since publication of the Government Accountability Office (GAO) reports that DoE's environmental liability is considered a high-risk concern for the nation [2]. The focus of SDM is on structuring solutions to decision risk problems by first addressing stakeholder and decision maker values and subsequently developing decision objectives and ways to measure those objectives, preference weighting across objectives, identifying decision alternatives that best achieve those values, and characterizing uncertainty in predictions of the measures. Because a complete decision model is created using SDM, it can be evaluated to find the main elements of the model that drive, or predict, the best solution. This approach creates complete decision models that are transparent, traceable, reproducible and technically defensible. The science behind SDM, or decision analysis, is well founded, yet it is not unusual to see ad hoc approaches to decision making implemented under various environmental regulations that are pertinent to the LANL site, including NEPA, RCRA and DOE Order 435.1. Such ad hoc approaches are often not transparent or traceable, and lack reproducibility and technical defensibility. The LANL legacy cleanup program has embarked on using SDM to address the complex problems that remain. Stakeholder meetings have been held, and a prototype version of the stakeholder value system has been developed. Further meetings are expected in the future to address specific project needs. This is a long-term endeavor considering the complex environmental problems faced by DOE EM in Los Alamos (EM-LA), and careful planning, consideration of stakeholder value systems, and engagement with stakeholders throughout the SDM process is expected to lead to a successful endpoint. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Prediction analysis and management decisions.
Prediction analysis techniques /PAT/ using statistical methods, computers, error analysis, etc, for system weight, performance and other parameter predictions in Apollo program
PROGRAM MANAGEMENT↗
Tools of the Future: How Decision Tree Analysis Will Impact Mission Planning
The universe is infinitely complex; however, the human mind has a finite capacity. The multitude of possible variables, metrics, and procedures in mission planning are far too many to address exhaustively. This is unfortunate because, in general, considering more possibilities leads to more accurate and more powerful results. To compensate, we can get more insightful results by employing our greatest tool, the computer. The power of the computer will be utilized through a technology that considers every possibility, decision tree analysis. Although decision trees have been used in many other fields, this is innovative for space mission planning. Because this is a new strategy, no existing software is able to completely accommodate all of the requirements. This was determined through extensive research and testing of current technologies. It was necessary to create original software, for which a short-term model was finished this summer. The model was built into Microsoft Excel to take advantage of the familiar graphical interface for user input, computation, and viewing output. Macros were written to automate the process of tree construction, optimization, and presentation. The results are useful and promising. If this tool is successfully implemented in mission planning, our reliance on old-fashioned heuristics, an error-prone shortcut for handling complexity, will be reduced. The computer algorithms involved in decision trees will revolutionize mission planning. The planning will be faster and smarter, leading to optimized missions with the potential for more valuable data.
Otterstatter, Matthew R.↗
Renewable Energy Data, Analysis, and Decisions Viewed through a Case Study in Bangladesh: Preprint
Many developing countries around the world have signaled their intention to transition their energy sectors to rely on cleaner sources of electricity generation for a variety of reasons that may include complying with their Nationally Determined Contributions (in support of the Paris Climate Agreement), increasing energy security, or reducing air pollution. Renewable energy resources are increasingly a cost competitive option for new electricity generation; however, nations must consider renewable energy potential if they wish to increase these technologies in their electricity generation mix. Yet, goal setting, policymaking, grid modeling, and investment decisions that will enable renewable energy development all depend on the existence and quality of renewable energy resource data. This paper aims to summarize the relationship between renewable energy data, analysis, and decision making for developing countries seeking to transition their energy sector and to consider Bangladesh as a case study of a country that has worked with development organizations and the National Renewable Energy Laboratory to develop a national inventory of renewable energy resource data to enable critical decision making.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
IAEA Initiatives that Integrate Stakeholders, Models and Decision Making - 18646
The International Atomic Energy Agency (IAEA) has initiated an effort to provide stakeholder support services as part of Phase II of the Constraints to Implementing Decommissioning and Environmental Remediation (CIDER II) programs. The intent of this sub-group of CIDER II is to provide members states support in areas of stakeholder communication, engagement and participation, with the goal of building trust in decommissioning and environmental remediation (D and ER) decisions for radioactive contamination and facilities. IAEA has also initiated a follow-on effort to address Modeling and Data for Radiological Impact Assessments (MODARIA II), which is aimed at enhancing the capabilities of Member States to simulate radionuclide transfer in the environment, and to ensure appropriate levels of protection from ionizing radiation. Working Group 1 of MODARIA II is focused on the integration of modeling and decision analysis. These two groups have complementary and supporting objectives, which provides an opportunity for collaboration and mutual benefit. The technical integrator is the approach of structured decision making, which follows a five-step process that combines stakeholder values with models through a technically defensible decision analysis. Briefly, the steps are: 1. Provide the context and decision context for the problem; 2. Obtain costs, values and concerns from stakeholders, to develop objectives that need to be achieved (e.g., improve human health, minimize costs, increase jobs); 3. Identify options that might achieve the objectives (e.g., cleanup, institutional controls, education); 4. Develop probabilistic models that connect options to objectives so that the objectives can be evaluated collectively (e.g., a fate and transport and risk model to address the objective of reducing human health risk, a cost model to address costs of taking action); and, 5. Model evaluation, including sensitivity analysis, to determine if an action can be taken with sufficient certainty, or if collection of more data is needed to decrease uncertainty before a decision is made. This approach also supports adaptive management as new data are collected. This approach clarifies the roles of stakeholders and subject matter experts in the decision-making process, where stakeholders specify values, and subject matter experts focus on the models that are needed to evaluate the options. It also provides a technically defensible, reproducible, transparent and traceable approach to all of the components necessary to properly solve the types of complex decision problems that plague radioactive waste management, decommissioning and environmental remediation. This paper introduces the major challenges to implementing such a broad scale of decision analysis, and approaches to overcoming those challenges, which include not only the technical challenges, but also the need to develop capacity in a range of skills not usually accommodated in environmental modeling and includes the need for the IAEA to address decision making in different countries, and with different cultures, religions, political affiliations, and languages. This paper explores the potential for IAEA to benefit from both the CIDER II and MODARIA II programs, and hence to develop a fully integrated approach to effective decision making for radioactive waste management and environmental remediation. Note that there are many people involved in these efforts at the IAEA, and credit belongs to those people for the progress that has been made to date. Our intent here is simply to introduce these IAEA programs at the WM2018 Symposium to provide our perspective and some awareness of some of the directions in which IAEA appears to be headed regarding stakeholder engagement, environmental and risk modeling, data science, and decision analysis. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Decision Trees for Analysis of Strategies to Deter Limited Nuclear Use in a Generic Scenario
We assert that analysis of a decision tree model can reveal key insights for deterring limited nuclear use in a conventional conflict. To illustrate the method, we develop a decision analysis model to explore the choices an attacker would make and how they can be influenced by his perceptions of the defender’s capabilities and potential responses. Sensitivity analysis with the model can provide insights into strategies and actions the defender might take in order to influence the choices the attacker would make. This methodology is widely applicable and could provide insight into a variety of scenarios.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
Interpretable boosted-decision-tree analysis for the Majorana Demonstrator
The Majorana Demonstrator is a leading experiment searching for neutrinoless double-beta decay with high purity germanium detectors (HPGe). Machine learning provides a new way to maximize the amount of information provided by these detectors, but the data-driven nature makes it less interpretable compared to traditional analysis. An interpretability study reveals the machine's decision-making logic, allowing us to learn from the machine to feedback to the traditional analysis. In this work, we have presented the first machine learning analysis of the data from the Majorana Demonstrator; this is also the first interpretable machine learning analysis of any germanium detector experiment. Two gradient boosted decision tree models are trained to learn from the data, and a game-theory-based model interpretability study is conducted to understand the origin of the classification power. By learning from data, this analysis recognizes the correlations among reconstruction parameters to further enhance the background rejection performance. By learning from the machine, this analysis reveals the importance of new background categories to reciprocally benefit the standard Majorana analysis. This model is highly compatible with next-generation germanium detector experiments like LEGEND since it can be simultaneously trained on a large number of detectors.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Architecting Space Exploration Campaigns: A Decision-Analytic Approach
This paper shows the benefits of Decision Analysis techniques for campaign design and evaluation. Important concepts of decision analysis are reviewed through the lens of designing a campaign to find exploitable equatorial water on Mars. The method developed herein is general to any search campaign. The paper concludes with a discussion of the challenges and opportunities in applying similar techniques to other types of campaigns.
campaigns↗
Data, Analysis, and Decision Tools for Evaluating the Circular Economy of Plastics
Presentation of analysis tools and methods for evaluating the circular economy of plastics.
analysis tools↗
The Aeronautical Data Link: Decision Framework for Architecture Analysis
A decision analytic approach that develops optimal data link architecture configuration and behavior to meet multiple conflicting objectives of concurrent and different airspace operations functions has previously been developed. The approach, premised on a formal taxonomic classification that correlates data link performance with operations requirements, information requirements, and implementing technologies, provides a coherent methodology for data link architectural analysis from top-down and bottom-up perspectives. This paper follows the previous research by providing more specific approaches for mapping and transitioning between the lower levels of the decision framework. The goal of the architectural analysis methodology is to assess the impact of specific architecture configurations and behaviors on the efficiency, capacity, and safety of operations. This necessarily involves understanding the various capabilities, system level performance issues and performance and interface concepts related to the conceptual purpose of the architecture and to the underlying data link technologies. Efficient and goal-directed data link architectural network configuration is conditioned on quantifying the risks and uncertainties associated with complex structural interface decisions. Deterministic and stochastic optimal design approaches will be discussed that maximize the effectiveness of architectural designs.
Morris, A. Terry↗
A Model-Based Systems Engineering Approach for Effective Decision Support of Modern Energy Systems Depicted with Clean Hydrogen Production
A holistic approach to decision-making in modern energy systems is vital due to their increase in complexity and interconnectedness. However, decision makers often rely on narrowly-focused strategies, such as economic assessments, for energy system strategy selection. The approach in this paper helps considers various factors such as economic viability, technological feasibility, environmental impact, and social acceptance. By integrating these diverse elements, decision makers can identify more economically feasible, sustainable, and resilient energy strategies. While existing focused approaches are valuable since they provide clear metrics of a potential solution (e.g., an economic measure of profitability), they do not offer the much needed system-as-a-whole understanding. This lack of understanding often leads to selecting suboptimal or unfeasible solutions, which is often discovered much later in the process when a change may not be possible. This paper presents a novel evaluation framework to support holistic decision-making in energy systems. The framework is based on a systems thinking approach, applied through systems engineering principles and model-based systems engineering tools, coupled with a multicriteria decision analysis approach. The systems engineering approach guides the development of feasible solutions for novel energy systems, and the multicriteria decision analysis is used for a systematic evaluation of available strategies and objective selection of the best solution. The proposed framework enables holistic, multidisciplinary, and objective evaluations of solutions and strategies for energy systems, clearly demonstrates the pros and cons of available options, and supports knowledge collection and retention to be used for a different scenario or context. The framework is demonstrated in case study evaluation solutions for a novel energy system of clean hydrogen generation.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Renewable Energy Data, Analysis, and Decisions: A Guide for Practitioners
High-quality renewable energy resource data and other geographic information system (GIS) data are essential for the transition to a clean energy economy that prioritizes local resources, improves resiliency, creates jobs, and promotes energy independence. These data are crucial for making informed decisions—ranging from policy and investment decisions to reliable power sector planning. Decisions that are data-driven reflect appropriate ambition, maximize cost-effectiveness, and enable successful implementation of renewable energy investments. This guide is intended to support policymakers and planners, as well as technical experts, consultants, and academics in incorporating improved data and analysis into renewable energy decision-making.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗