Results for “decision model” — Page 21

NASA NTRS1994

A CLIPS-based expert system for the evaluation and selection of robots

This paper describes the development of a prototype expert system for intelligent selection of robots for manufacturing operations. The paper first develops a comprehensive, three-stage process to model the robot selection problem. The decisions involved in this model easily lend themselves to an expert system application. A rule-based system, based on the selection model, is developed using the CLIPS expert system shell. Data about actual robots is used to test the performance of the prototype system. Further extensions to the rule-based system for data handling and interfacing capabilities are suggested.

Nour, Mohamed A.↗

NASA NTRS2004

Error-associated behaviors and error rates for robotic geology

This study explores human error as a function of the decision-making process. One of many models for human decision-making is Rasmussen's decision ladder [9]. The decision ladder identifies the multiple tasks and states of knowledge involved in decision-making. The tasks and states of knowledge can be classified by the level of cognitive effort required to make the decision, leading to the skill, rule, and knowledge taxonomy (Rasmussen, 1987). Skill based decisions require the least cognitive effort and knowledge based decisions require the greatest cognitive effort. Errors can occur at any of the cognitive levels.

error rates↗

NASA NTRS2011

Modeling SEER-SEM Using a Decision Graph : A Knowledge Engineering Approach

No abstract available

software estimates↗

DOE OSTI2024

Transmission Operator Workflows for Real-Time Reliability Studies: A Review of Control Room Practices and Naturalistic Decision Making

This report provides an overview of real-time reliability study tools and their use by power system operators in the control room environment. After introducing some of the nuances of the control room environment and the differences in perspectives between power system engineers and operators, the roles and responsibilities of key entities involved in RTCA workflows are introduced. These are specifically the transmission system operator (TOP) and reliability coordinator (RC), which are required to run tools such as real-time contingency analysis (RTCA) as part of a real-time reliability assessment every 30 minutes, as dictated by a series of standards issued by the North American Electric Reliability Corporation (NERC). The process by which power systems operators operate the grid is discussed in terms of naturalistic decision making (NDM) and the recognition-primed decision-making (RPD) model. This cognitive model describe how experts working in high-risk, high-stress environments make safety-critical decisions under uncertainty and time pressure. For power system operators, the mental simulations involved in the traditional RPD model are supplemented by physics-based simulations using numerical tools, such as RTCA, to improve situational awareness and effectiveness of control actions. Next, a generic workflow is introduced to describe operator decision making for running RTCA tools and responding to system violations on a pre-contingent basis. The types of analysis performed and control actions chosen by power system operators are described in detail. The overall high-level workflow is then expanded in subsequent sections, with special attention given to high-voltage violations, low-voltage violations, and thermal overloads. Each type of violation is described in detail, with explanations of common causes, impacts on equipment and customers, and mitigation strategies. An additional workflow diagram is provided for each type of violation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRSDate not supplied

How to Educate Decision Makers on the Value and Necessity of Modal Testing and Model Correlation: Tips for Young Engineers

Engineers need to effectively communicate the justification and value of their modal testing and model correlation in terminology familiar to decision makers as it relates to the program’s risk tolerance. This communication must relate to the program’s risk tolerance and the metrics used to judge the performance of both the program and individual decision makers. The challenge is the terminologies familiar to engineers and decision makers are quite different and seemingly unrelated. The engineering profession has developed a specific terminology to solve highly technical issues, which are many times themselves unique to very specific engineering problems. It is all too easy for engineers to believe that everyone in their organization, including the decision makers, has an intrinsic understanding of what they do and the value it brings to the program’s success. This is especially true for young engineers who have recently spent the last four plus years in an academic engineering learning environment, which has a highly technical research oriented atmosphere. Effective communication with decision makers is increasingly important as the technical breadth and practical program and project experience level for up and coming decision makers diminishes. It is not unusual for the decision makers to have technical knowledge in a domain different from structural dynamics (e.g., electronics or systems). Competition among satellite manufactures has increased the focus on programmatic cost and ability to deliver on schedule. NASA programs are also seeing more restrictive programmatic cost and schedule constraints, which impact both analysis and testing. It should also be noted that a comprehensive suite of tests are required to verify a satellite’s design capability with some margin. These tests include static strength verification tests, shock, acoustic, and vibration tests (sine and random) of systems, subsystems, and components. Each of these verification tests provide opportunities for model correlation and risk reduction. It is important to recognize dynamic loads/modal test models may not include all of the flight hardware (i.e., harness, coax, waveguides, connectors, etc.) and the previously mentioned tests are still required for qualification/verification of the design. This paper provides tips to young engineers on how to bridge this communications gap, have a better understanding of the environment in which decision makers operate, and assist them to better support successful missions. While this paper primarily focuses on modal testing and model correlation as related to spacecraft missions, the concepts and recommendations presented here are equally applicable to other fields such as aeronautics, automotive, power generation, etc.

Decision Maker↗

NASA NTRSDate not supplied

How to Educate Decision Makers on the Value and Necessity of Modal Testing and Model Correlation: Tips for Young Engineers

Engineers need to effectively communicate the justification and value of their modal testing and model correlation in terminology familiar to decision makers as it relates to the program’s risk tolerance. This communication must relate to the program’s risk tolerance and the metrics used to judge the performance of both the program and individual decision makers. The challenge is the terminologies familiar to engineers and decision makers are quite different and seemingly unrelated. The engineering profession has developed a specific terminology to solve highly technical issues, which are many times themselves unique to very specific engineering problems. It is all too easy for engineers to believe that everyone in their organization, including the decision makers, has an intrinsic understanding of what they do and the value it brings to the program’s success. This is especially true for young engineers who have recently spent the last four plus years in an academic engineering learning environment, which has a highly technical research oriented atmosphere. Effective communication with decision makers is increasingly important as the technical breadth and practical program and project experience level for up and coming decision makers diminishes. It is not unusual for the decision makers to have technical knowledge in a domain different from structural dynamics (e.g., electronics or systems). Competition among satellite manufactures has increased the focus on programmatic cost and ability to deliver on schedule. NASA programs are also seeing more restrictive programmatic cost and schedule constraints, which impact both analysis and testing. It should also be noted that a comprehensive suite of tests are required to verify a satellite’s design capability with some margin. These tests include static strength verification tests, shock, acoustic, and vibration tests (sine and random) of systems, subsystems, and components. Each of these verification tests provide opportunities for model correlation and risk reduction. It is important to recognize dynamic loads/modal test models may not include all of the flight hardware (i.e., harness, coax, waveguides, connectors, etc.) and the previously mentioned tests are still required for qualification/verification of the design. This paper provides tips to young engineers on how to bridge this communications gap, have a better understanding of the environment in which decision makers operate, and assist them to better support successful missions. While this paper primarily focuses on modal testing and model correlation as related to spacecraft missions, the concepts and recommendations presented here are equally applicable to other fields such as aeronautics, automotive, power generation, etc.

Decision Maker↗

NASA NTRS2002

CATS-based Air Traffic Controller Agents

This report describes intelligent agents that function as air traffic controllers. Each agent controls traffic in a single sector in real time; agents controlling traffic in adjoining sectors can coordinate to manage an arrival flow across a given meter fix. The purpose of this research is threefold. First, it seeks to study the design of agents for controlling complex systems. In particular, it investigates agent planning and reactive control functionality in a dynamic environment in which a variety perceptual and decision making skills play a central role. It examines how heuristic rules can be applied to model planning and decision making skills, rather than attempting to apply optimization methods. Thus, the research attempts to develop intelligent agents that provide an approximation of human air traffic controller behavior that, while not based on an explicit cognitive model, does produce task performance consistent with the way human air traffic controllers operate. Second, this research sought to extend previous research on using the Crew Activity Tracking System (CATS) as the basis for intelligent agents. The agents use a high-level model of air traffic controller activities to structure the control task. To execute an activity in the CATS model, according to the current task context, the agents reference a 'skill library' and 'control rules' that in turn execute the pattern recognition, planning, and decision-making required to perform the activity. Applying the skills enables the agents to modify their representation of the current control situation (i.e., the 'flick' or 'picture'). The updated representation supports the next activity in a cycle of action that, taken as a whole, simulates air traffic controller behavior. A third, practical motivation for this research is to use intelligent agents to support evaluation of new air traffic control (ATC) methods to support new Air Traffic Management (ATM) concepts. Current approaches that use large, human-in-the-loop simulations are unquestionably valuable for this purpose, but pose considerable logistical, fiscal, and experimental control problems. First, data analysis is extremely complicated, owing simply to the large number of participants and data sources in such simulations. In addition, experienced human air traffic controllers working adjacent sectors tend to flexibly adapt to the evolving control problem - potentially shifting to other strategies than those under investigation. In addition, their performance is tightly coupled to the control interface, which in the development phase may support some concepts and supporting strategies better than others. A simple shift in strategy by one controller can change the character of a particular traffic scenario dramatically, which makes experimental comparison of ATC performance under different traffic scenarios difficult. Training a given team of controllers on operations under a new ATM concept for a sufficient period of time could avert such difficulties, but instituting an adequate training program is expensive and logistically difficult.

Callantine, Todd J.↗

DOE OSTI2022

The modeling of risk perception in the use of structural health monitoring information for optimal maintenance decisions

This paper proposes an approach to select a maintenance strategy from a predefined set of choices considering the decision maker’s behavioral risk profile. It is assumed that the damage state is characterized by a continuous state parameter probabilistically inferred from observable sensor data. This work applies an engineering application of consequence-based decision-making incorporating the acceptable risk intensity of the decision-maker, i.e., the decision-maker’s (individual or an organization) valuation of the outcome of a decision, using a risk profile model. The utility of a decision-maker is subjective, and this paper considers the fact that different decision-makers mentally assign a different importance factor (the utility) to the seriousness or urgency to take necessary actions with the increasing intensity of structural damage. The approach herein incorporates a layer of human psychology on selecting appropriate maintenance strategies that not only depend on the posterior distribution of unmeasurable damage state but also consider the behavioral risk profile of the decision-maker. Further, the collective decision-making of an organization consisting of many individuals is also investigated. The approach is exemplified in a case study involving life cycle monitoring of a miter gate, part of a lock system enabling navigation of inland waterways.

42 ENGINEERING↗

DOE OSTI2026

AIF for Vis (Active Inference for simulating human interpretation of data visualization) [SWR-26-084]

AIF for Vis contains the Active Inference models and analysis scripts used to study a simple visualization-interpretation task: estimating the average value of two bars in a bar chart. The work is a proof of concept for translating hypothesized cognitive strategies into executable, inspectable process models. We implement two idealized strategies inspired by dual-process accounts of visualization-aided decision making: *Fast model: a compressed, heuristic strategy that estimates the visual midpoint of the two bars and maintains a single belief over their average. *Slow model: a sequential, analytic strategy that estimates the two bar heights separately and maintains them in working memory before computing an average. Both models use a common Active-Inference-inspired framework for sequential perception, belief updating, action selection, and reporting. Their different internal representations produce distinct predicted vulnerabilities: *the Fast model is more susceptible to tick-salience bias; *the Slow model is more susceptible to working-memory decay. The repository includes the model implementations, scripts used for the experiments reported in the paper, precomputed trial-level results, and plotting scripts.

Goldwyn, Harrison [National Laboratory of the Rock↗

DOE OSTI2024

Yet Another Discriminant Analysis (YADA): A Probabilistic Model for Machine Learning Applications

This paper presents a probabilistic model for various machine learning (ML) applications. While deep learning (DL) has produced state-of-the-art results in many domains, DL models are complex and over-parameterized, which leads to high uncertainty about what the model has learned, as well as its decision process. Further, DL models are not probabilistic, making reasoning about their output challenging. In contrast, the proposed model, referred to as Yet Another Discriminate Analysis(YADA), is less complex than other methods, is based on a mathematically rigorous foundation, and can be utilized for a wide variety of ML tasks including classification, explainability, and uncertainty quantification. YADA is thus competitive in most cases with many state-of-the-art DL models. Ideally, a probabilistic model would represent the full joint probability distribution of its features, but doing so is often computationally expensive and intractable. Hence, many probabilistic models assume that the features are either normally distributed, mutually independent, or both, which can severely limit their performance. YADA is an intermediate model that (1) captures the marginal distributions of each variable and the pairwise correlations between variables and (2) explicitly maps features to the space of multivariate Gaussian variables. Numerous mathematical properties of the YADA model can be derived, thereby improving the theoretic underpinnings of ML. Validation of the model can be statistically verified on new or held-out data using native properties of YADA. However, there are some engineering and practical challenges that we enumerate to make YADA more useful.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Operator function modeling: Cognitive task analysis, modeling and intelligent aiding in supervisory control systems

The design, implementation, and empirical evaluation of task-analytic models and intelligent aids for operators in the control of complex dynamic systems, specifically aerospace systems, are studied. Three related activities are included: (1) the models of operator decision making in complex and predominantly automated space systems were used and developed; (2) the Operator Function Model (OFM) was used to represent operator activities; and (3) Operator Function Model Expert System (OFMspert), a stand-alone knowledge-based system was developed, that interacts with a human operator in a manner similar to a human assistant in the control of aerospace systems. OFMspert is an architecture for an operator's assistant that uses the OFM as its system and operator knowledge base and a blackboard paradigm of problem solving to dynamically generate expectations about upcoming operator activities and interpreting actual operator actions. An experiment validated the OFMspert's intent inferencing capability and showed that it inferred the intentions of operators in ways comparable to both a human expert and operators themselves. OFMspert was also augmented with control capabilities. An interface allowed the operator to interact with OFMspert, delegating as much or as little control responsibility as the operator chose. With its design based on the OFM, OFMspert's control capabilities were available at multiple levels of abstraction and allowed the operator a great deal of discretion over the amount and level of delegated control. An experiment showed that overall system performance was comparable for teams consisting of two human operators versus a human operator and OFMspert team.

Mitchell, Christine M.↗

DOE OSTI2023

Quantum logic gate synthesis as a Markov decision process

Reinforcement learning has witnessed recent applications to a variety of tasks in quantum programming. The underlying assumption is that those tasks could be modeled as Markov decision processes (MDPs). Here, we investigate the feasibility of this assumption by exploring its consequences for single-qubit quantum state preparation and gate compilation. By forming discrete MDPs, we solve for the optimal policy exactly through policy iteration. We find optimal paths that correspond to the shortest possible sequence of gates to prepare a state or compile a gate, up to some target accuracy. Our method works in both the absence and presence of noise and compares favorably to other quantum compilation methods, such as the Ross–Selinger algorithm. This work provides theoretical insight into why reinforcement learning may be successfully used to find optimally short gate sequences in quantum programming.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS1984

A Model for the Effectiveness of Aircraft Alerting and Warning Systems

The effectiveness of an alerting system with a single alert was analyzed. The pilot's decision behavior is modeled by the theory of signal detection and therefore accounts for different strengths of cross check information and different pilot criteria. The model includes the effects of the alerting and warning system (CAWS) error rate; the pilot's past experience with the CAWS accuracy; his reliance on the CAWS rather than independent monitoring; missed alerts; and adoption of a minimum error or Neyman-Pearson objective rather than minimum cost objective. It is showwn that for rare events: (1) the expected cost is greatly increased if the pilot ignores the a posteriori information in the existence of an alert; (2) the expected cost is insensitive to CAWS Type 1 errors; and (3) the expected cost is sensitive to CAWS type 2 errors only when the cross check information is ambiguous.

Curry, R. E.↗

DOE OSTI2022

Insights into Methodologies and Operational Details of Resource Adequacy Assessment: A Case Study with Application to a Broader Flexibility Framework

Assessing and maintaining resource adequacy (RA) is a core pillar of power systems. However, recent changes in the physical makeup of these systems and the conditions under which these systems must operate have yielded a renewed interest in the methods, metrics, and assumptions that underpin RA assessments. In this paper, we systematically explore a wide range of RA modeling dimensions, including: the objective function and level of operational detail in the underlying model formulation; the quantity (look-ahead) and quality (accuracy) of data that is available for making operational decisions within those models; and the physical configuration of solar photovoltaics (PV) with battery storage hybrid resources. We apply a set of probabilistic RA tools and production cost modeling tools to a realistic test system based loosely on a future Electric Reliability Council of Texas power system dominated by solar PV resources. Under the assumptions of our system and models, we find that multi-stage probabilistic assessments may provide a more robust evaluation of RA by capturing a wider range of operational and system interactions, but this comes at a computational cost of 1-2 orders of magnitude longer run time depending on the specific configuration. In addition, the information on thermal generator availability impacts RA performance by an order of magnitude more than solar resource forecasts, which is driven by the comparatively larger magnitude of thermal outages than solar forecast errors within our test system. Lastly, the flexibility provided by hybrid and other resources can help reduce system load-shedding event frequencies and enable the system to be more robust to inaccurate forecast information, and alternative hybrid inverter sizes can impact RA levels by 1-2 orders of magnitude. Our results point to the importance of a broader flexibility framework to describe the interaction between (1) flexibility "supply" from both physical resource capabilities and operational constraints considered in the modeling, and (2) flexibility "demand" from forecast errors, thermal generator outages, and other sources of uncertainty, as well as their RA impacts. Results are likely sensitive to the system buildout explored; future work could consider additional system configurations and conditions.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗

NASA NTRS1997

The ASAC Air Carrier Investment Model (Second Generation)

To meet its objective of assisting the U.S. aviation industry with the technological challenges of the future, NASA must identify research areas that have the greatest potential for improving the operation of the air transportation system. To accomplish this, NASA is building an Aviation System Analysis Capability (ASAC). The ASAC differs from previous NASA modeling efforts in that the economic behavior of buyers and sellers in the air transportation and aviation industries is central to its conception. To link the economics of flight with the technology of flight, ASAC requires a parametrically based mode with extensions that link airline operations and investments in aircraft with aircraft characteristics. This model also must provide a mechanism for incorporating air travel demand and profitability factors into the airlines' investment decisions. Finally, the model must be flexible and capable of being incorporated into a wide-ranging suite of economic and technical models that are envisioned for ASAC. We describe a second-generation Air Carrier Investment Model that meets these requirements. The enhanced model incorporates econometric results from the supply and demand curves faced by U.S.-scheduled passenger air carriers. It uses detailed information about their fleets in 1995 to make predictions about future aircraft purchases. It enables analysts with the ability to project revenue passenger-miles flown, airline industry employment, airline operating profit margins, numbers and types of aircraft in the fleet, and changes in aircraft manufacturing employment under various user-defined scenarios.

Wingrove, Earl R., III↗

NASA NTRS1998

The ASAC Air Carrier Investment Model (Third Generation)

To meet its objective of assisting the U.S. aviation industry with the technological challenges of the future, NASA must identify research areas that have the greatest potential for improving the operation of the air transportation system. To accomplish this, NASA is building an Aviation System Analysis Capability (ASAC). The ASAC differs from previous NASA modeling efforts in that the economic behavior of buyers and sellers in the air transportation and aviation industries is central to its conception. To link the economics of flight with the technology of flight, ASAC requires a parametrically based model with extensions that link airline operations and investments in aircraft with aircraft characteristics. This model also must provide a mechanism for incorporating air travel demand and profitability factors into the airlines' investment decisions. Finally, the model must be flexible and capable of being incorporated into a wide-ranging suite of economic and technical models flat are envisioned for ASAC.

Wingrove, Earl R., III↗

NASA NTRS1992

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗

NASA NTRSDate not supplied

Game-Changing Science with SmallSats and Hosted Payloads

This talk outlines the opportunities using space-based remote sensing to collect the basic climate research data that will serve as the foundation of our science, our models, and our predictive capabilities. With SmallSats and hosted payloads to supplement data from our traditional large spacecraft, and with constellations of SmallSats and with hosted payloads, the Science Mission Directorate is able to make new types of observations, such as synchronic temporal and spatial measurements of the same events. Our data enables science-based decision making. Our models and predictions inform and educate our decision makers at every level.

remote sensing↗