Contractor decision making and incentive fee contracts
Contractor decision making and incentive fee contracts in procurement of complex weapons and space systems
WEAPONS INDUSTRY↗
SEARCH · Engineering Papers
Results for “decision making”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Transmission Operator Workflows for Real-Time Reliability Studies: A Review of Control Room Practices and Naturalistic Decision Making
This report provides an overview of real-time reliability study tools and their use by power system operators in the control room environment. After introducing some of the nuances of the control room environment and the differences in perspectives between power system engineers and operators, the roles and responsibilities of key entities involved in RTCA workflows are introduced. These are specifically the transmission system operator (TOP) and reliability coordinator (RC), which are required to run tools such as real-time contingency analysis (RTCA) as part of a real-time reliability assessment every 30 minutes, as dictated by a series of standards issued by the North American Electric Reliability Corporation (NERC). The process by which power systems operators operate the grid is discussed in terms of naturalistic decision making (NDM) and the recognition-primed decision-making (RPD) model. This cognitive model describe how experts working in high-risk, high-stress environments make safety-critical decisions under uncertainty and time pressure. For power system operators, the mental simulations involved in the traditional RPD model are supplemented by physics-based simulations using numerical tools, such as RTCA, to improve situational awareness and effectiveness of control actions. Next, a generic workflow is introduced to describe operator decision making for running RTCA tools and responding to system violations on a pre-contingent basis. The types of analysis performed and control actions chosen by power system operators are described in detail. The overall high-level workflow is then expanded in subsequent sections, with special attention given to high-voltage violations, low-voltage violations, and thermal overloads. Each type of violation is described in detail, with explanations of common causes, impacts on equipment and customers, and mitigation strategies. An additional workflow diagram is provided for each type of violation.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Expert decision-making strategies
A recognition-primed decisions (RPD) model is employed as a framework to investigate crew decision-making processes. The quality of information transfer, a critical component of the team RPD model and an indicator of the team's 'collective consciouness', is measured and analyzed with repect to crew performance. As indicated by the RPD model, timing and patterns of information search transfer were expected to reflect extensive and continual situation assessment, and serial evaluation of alternative states of the world or decision response options.
Mosier, Kathleen L.↗
Understanding Crew Decision-Making in the Presence of Complexity: A Flight Simulation Experiment
Crew decision making and response have long been leading causal and contributing factors associated with aircraft accidents. Further, it is anticipated that future aircraft and operational environments will increase exposure to risks related to these factors if proactive steps are not taken to account for ever-increasing complexity. A flight simulation study was designed to collect data to help in understanding how complexity can, or may, be manifest. More specifically, an experimental apparatus was constructed that allowed for manipulation of information complexity and uncertainty, while also manipulating operational complexity and uncertainty. Through these manipulations, and the aid of experienced airline pilots, several issues have been discovered, related most prominently to the influence of information content, quality, and management. Flight crews were immersed in an environment that included new operational complexities suggested for the future air transportation system as well as new technological complexities (e.g. electronic flight bags, expanded data link services, synthetic and enhanced vision systems, and interval management automation). In addition, a set of off-nominal situations were emulated. These included, for example, adverse weather conditions, traffic deviations, equipment failures, poor data quality, communication errors, and unexpected clearances, or changes to flight plans. Each situation was based on one or more reference events from past accidents or incidents, or on a similar case that had been used in previous developmental tests or studies. Over the course of the study, 10 twopilot airline crews participated, completing over 230 flights. Each flight consisted of an approach beginning at 10,000 ft. Based on the recorded data and pilot and research observations, preliminary results are presented regarding decision-making issues in the presence of the operational and technological complexities encountered during the flights.
Young, Steven D.↗
Using M and S to Improve Human Decision Making and Achieve Effective Problem Solving in an International Environment
In the international arena, decision makers are often swayed away from fact-based analysis by their own individual cultural and political bias. Modeling and Simulation-based training can raise awareness of individual predisposition and improve the quality of decision making by focusing solely on fact vice perception. This improved decision making methodology will support the multinational collaborative efforts of military and civilian leaders to solve challenges more effectively. The intent of this experimental research is to create a framework that allows decision makers to "come to the table" with the latest and most significant facts necessary to determine an appropriate solution for any given contingency.
Christie, Vanessa L.↗
MAGE: Alleviating Uncertainty in Real-Time Decision-Making as a Function of Problem Complexity
In this paper, we discuss a critical aspect of uncertainty in the operation of complex systems, such as the future air traffic: the ability of agents in the system to arrive at satisfactory decisions and the attendant actions as a function of problem complexity. Intuitively, when the problem complexity is manageable, given an appropriate decision problem formulation and solution tools, an agent (computational or human) has no trouble arriving at a solution that yields good outcomes for the agent and the system. Growing problem complexity results in progressively larger computational problems that may yield suboptimal solutions or even be intractable within required time limits or at all. We propose a measurable representation of complexity in terms of problem tractability and quality of solutions. We also propose a computational scheme, MAGE (Monitor, Anticipate, Guide, Evolve), for detecting approaching transitions from efficient decision-making states to inefficient to unsafe ones, so that operations based on decision-making can be reconfigured to forestall unfavorable transitions, returning to efficient modes when complexity diminishes. Maintaining tractable complexity reduces the uncertainty in the outcomes of decision-making. We describe the general scheme, an outline of MAGE applied to managing airspace complexity, and initial examples of investigating the tractability of problem-solving schemes.
complexity management↗
Decision-making in Small Groups - a Simulation Study
Theory of decision making behavior in small groups
DECISION MAKING↗
A systematic decision-making methodology to formalize the selection of degree of realism in screening analysis of probabilistic risk assessment
In the nuclear power domain, Probabilistic Risk Assessment (PRA) is used to inform decision-making for Nuclear Power Plants (NPPs). Recently, there has been an increase in the utilization of modeling and simulation (M&S) to support the estimation of PRA inputs. Risk analysts should carefully select the PRA items that require M&S and their degree of realism (DoR) with consideration of the required resources. To support this selection, this article formulates a systematic decision-making approach for the DoR selection. The DoR selection is made based on two predictive decision-making attributes: the predicted differences in safety risk estimate (ΔSaRi) and the cost of analysis (ΔCAN). This research also develops and quantifies causal models to estimate ΔSaRi and ΔCAN. The causal model-based prediction of ΔSaRi and ΔCAN helps reduce the trial-and-error nature of the DoR selection in the PRA screening analysis and provides insights for DoR selection and the gradual refinements of PRA realism. This approach is demonstrated for a case study on fire PRA of NPPs, where an adequate DoR is selected from two fire models: an engineering correlation and a zone model.
Alkhatib, Sari [Department of Nuclear, Plasma, and↗
Human decision-making in manual control systems
Model to describe human decision making in manual control systems
DECISION MAKING↗
Design, Formalization, and Verification of Decision Making for Intelligent Systems
The development of autonomous systems requires a rigorous process that can guarantee a system’s reliability in critical applications. At its core, an autonomous system bases its behavior on a well-defined decision making system. In this paper, we present a methodological basis for the design, formalization and formal verification of Decision Making systems for autonomous agents. The approach is generally applicable to operational objectives that can be functionally decomposed and subsequently represented as Hierarchical Finite State Machines. As a case study, we present the application of this method to implement a Decision Making model in Simulink. Furthermore, we present how we use NASA’s FRET tool to write requirements in structured natural language and generate formal specifications that can be automatically digested by NASA’s CoCoSim tool. Finally, we present how, by leveraging CoCoSim, we perform formal verification against the Simulink model and present analysis results.
Model-based development↗
Design, Formalization, and Verification of Decision Making for Intelligent Systems
The development of autonomous systems requires a rigorous process that can guarantee a system’s reliability in critical applications. At its core, an autonomous system bases its behavior on a well-defined decision making system. In this paper, we present a methodological basis for the design, formalization and formal verification of Decision Making systems for autonomous agents. The approach is generally applicable to operational objectives that can be functionally decomposed and subsequently represented as Hierarchical Finite State Machines. As a case study, we present the application of this method to implement a Decision Making model in Simulink. Furthermore, we present how we use NASA’s FRET tool to write requirements in structured natural language and generate formal specifications that can be automatically digested by NASA’s CoCoSim tool. Finally, we present how, by leveraging CoCoSim, we perform formal verification against the Simulink model and present analysis results.
Model-based development↗
Real Space Imaging of Field-Driven Decision-Making in Nanomagnetic Galton Boards
A possible spintronic route to hardware implementation for decision-making involves injecting a domain wall into a bifurcated magnetic nanostrip resembling a Y-shaped junction. A decision is made when the domain wall chooses a particular path through the bifurcation. Recently, it was shown that a structure like a nanomagnetic Galton board, which is essentially an array of interconnected Y-shaped junctions, produces outcomes that are stochastic and therefore relevant to artificial neural networks. However, the exact mechanism leading to the robust nature of randomness is unknown. Here, in this study, we directly image the decision-making process in nanomagnetic Galton boards using Lorentz transmission electron microscopy. We identify that the stochasticity in nanomagnetic Galton boards arises as a culmination of (1) the topology of the injected domain wall, (2) dissimilarly sized vertices, and (3) the strength of the applied field. Our results pave the way to a detailed understanding of stochasticity in nanomagnetic networks.
lorentz microscopy↗
Information load, time spent, and risk taking in complex decision making.
Information load, time spent, and risk taking in complex decision making
DECISION MAKING↗
Crew collaboration in space: a naturalistic decision-making perspective
Successful long-duration space missions will depend on the ability of crewmembers to respond promptly and effectively to unanticipated problems that arise under highly stressful conditions. Naturalistic decision making (NDM) exploits the knowledge and experience of decision makers in meaningful work domains, especially complex sociotechnical systems, including aviation and space. Decision making in these ambiguous, dynamic, high-risk environments is a complex task that involves defining the nature of the problem and crafting a response to achieve one's goals. Goal conflicts, time pressures, and uncertain outcomes may further complicate the process. This paper reviews theory and research pertaining to the NDM model and traces some of the implications for space crews and other groups that perform meaningful work in extreme environments. It concludes with specific recommendations for preparing exploration crews to use NDM effectively.
Review, Tutorial↗
Markov Decision Processes for Intelligent, Risk-Informed Asset-Management Decision-Making
Advanced nuclear reactors are a promising option for aiding the world in achieving its net-zero carbon emission goals, however, there are significant challenges to attaining and maintaining economic competitiveness with other sources of electricity. To improve the economic competitiveness of advanced reactor designs, a project was initiated to explore the use of Markov Decision Processes (MDPs) to guide asset-management decision-making during advanced reactor operation. MDPs are a powerful tool for optimizing decision-making in complex environments and their application to advanced reactors can aid in planning maintenance and repair activities to minimize downtime and maximize generation. The described approach expands on previous work regarding the use of MDPs for operational decision-making through the direct incorporation of real-time plant information. The integral MDP analysis includes information from online component diagnostic tools and the plant’s real-time generation risk assessment (GRA) and probabilistic risk assessment (PRA), which evaluate plant risk from both an economic and safety perspective. The result is an asset-management optimization framework that is based on real-time data regarding plant component status and the current best-estimate of plant risk. The paper presents an overview of the theoretical framework to incorporate the different information pathways into an integral MDP analysis, along with example analyses.
Grabaskas, David↗
On Decision-Making Among Multiple Rule-Bases in Fuzzy Control Systems
Intelligent control of complex multi-variable systems can be a challenge for single fuzzy rule-based controllers. This class of problems cam often be managed with less difficulty by distributing intelligent decision-making amongst a collection of rule-bases. Such an approach requires that a mechanism be chosen to ensure goal-oriented interaction between the multiple rule-bases. In this paper, a hierarchical rule-based approach is described. Decision-making mechanisms based on generalized concepts from single-rule-based fuzzy control are described. Finally, the effects of different aggregation operators on multi-rule-base decision-making are examined in a navigation control problem for mobile robots.
Tunstel, Edward↗
Adaptive Allocation of Decision Making Responsibility Between Human and Computer in Multi-Task Situations
A unified formulation of computer-aided, multi-task, decision making is presented. Strategy for the allocation of decision making responsibility between human and computer is developed. The plans of a flight management systems are studied. A model based on the queueing theory was implemented.
Chu, Y. Y.↗
ICADS: A cooperative decision making model with CLIPS experts
A cooperative decision making model is described which is comprised of six concurrently executing domain experts coordinated by a blackboard control expert. The focus application field is architectural design, and the domain experts represent consultants in the area of daylighting, noise control, structural support, cost estimating, space planning, and climate responsiveness. Both the domain experts and the blackboard were implemented as production systems, using an enhanced version of the basic CLIPS package. Acting in unison as an Expert Design Advisor, the domain and control experts react to the evolving design solution progressively developed by the user in a 2-D CAD drawing environment. A Geometry Interpreter maps each drawing action taken by the user to real world objects, such as spaces, walls, windows, and doors. These objects, endowed with geometric and nongeometric attributes, are stored as frames in a semantic network. Object descriptions are derived partly from the geometry of the drawing environment and partly from knowledge bases containing prototypical, generalized information about the building type and site conditions under consideration.
Pohl, Jens↗