Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Human Autonomy Teaming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Single Operator Control of Multiple UAS: A Supervisory Delegation Approach

This presentation will be given as part of the UAS EXCOM Science and Research Panel's (SARP) workshop on multiple UAS controlled by a single operator. Participants were asked to identify public use cases for multiple Unmanned Aircraft Systems (UAS) control and identify research, policy, and technical gaps in those operations. The purpose of this workshop is to brainstorm, categorize, and prioritize those use cases and gaps. Here, I will discuss research performed on this topic when I worked for the Army and on-going work within the division and a NATO working group on Human-Autonomy Teaming.

Unmanned Aircraft Systems (UAS)↗
NASA NTRS2024

Concept, Design, & Implementation of a Remote Vehicle Operations Center for Autonomous Missions

The National Aeronautics and Space Administration is supporting research to develop a prototype remote vehicle operations center at Langley Research Center to explore current and future advanced air mobility operations using small unmanned aerial systems vehicles as surrogates for future, larger-scale passenger carrying vehicles. The prototype facility known as the Remote Operations for Autonomous Missions (ROAM) Unmanned Aerial Systems (UAS) Operations Center is being used to explore different roles and responsibilities of remote operators managing multiple autonomous vehicles, with the goal of exploring human-autonomy teaming concepts that enable m:N operations (i.e., m operators managing N vehicles). ROAM has developed into a world-class research, development, and technology (RD&T) environment that can support both the collection of human factors data and the command and control of remote vehicles in beyond visual line of sight conditions. ROAM provides a key capability to enable full end-to-end hardware- and human-in-the-loop simulation testing, connecting with simulated small-UAS and creating a seamless Live-Virtual-Constructive (LVC) environment. This report describes the development of the ROAM UAS Operations Center from concept through design, culminating in the current implementation at NASA’s Langley Research Center.

CERTAIN↗
NASA NTRS2018

SAM 3.0 Workshop Alliance SV Lab

Nissan is building a Seamless Autonomy Mobility (SAM) which is a cloud-based system of artificial intelligence that manages a fleet of autonomous vehicles. It pairs artificial intelligence with human intelligence in order to create a seamless solution that allows autonomous drive to be viable and marketable. They have created a Mobility Manager function which is a laborer who executed human-in-the-loop functions within SAM system. Nissan invited the HAT Lab to discuss NASA's lessons learned on remote operator support and to participate in a workshop discussion of one of their use cases. This presentation covers some of the HAT Lab's work on a human-autonomy teaming Agent and previous Reduced Crew Operations ground station development.

Human-Autonomy Teaming↗
NASA NTRSDate not supplied

Human Monitoring for Medical Operator Assistance

Measurement of multiple biologic and non-biologic signals can be exploited for the task of monitoring the physiological status of individuals - either as patients during and following illness or injury or as those engaged in operational activities. Assessing physiological status is accomplished by measuring vital signs and wellness measures that support clinical decision-making for physical optimization, illness/injury prevention and treatment, recovery progression, and general delivery of care, or monitoring an operator's moment-to-moment personal "readiness" state. Physiological measures are beneficial for monitoring the medical state of vehicle operators, for example, through the detection of incapacitation in the realm of transportation safety. Measuring physiological signals or control inputs can also be beneficial for monitoring operator state to optimize human-autonomy-teaming performance for safety and efficiency. Similarly, monitoring a health care provider during the performance of medical procedures could provide valuable feedback on optimizing human-robot interactions and human teaming with autonomous systems. In this sense, the provider can be seen as a "Medical Operator" in the same way other "operators" drive, aviate, or control vehicles by performing manual, attention-demanding tasks during safety-critical activities.

Neuroergonomics↗
NASA NTRS2023

A Remote Vehicle Operations Center’s Role in Collecting Human Factors Data

The National Aeronautics and Space Administration is supporting research to develop a prototype remote vehicle operations center at Langley Research Center to explore current and future advanced air mobility operations using small unmanned aerial systems vehicles as surrogates for future, larger-scale passenger carrying vehicles. Data collected within the Remote Operations for Autonomous Missions (ROAM) Unmanned Aerial Systems (UAS) Operations Center will be used to explore different roles and responsibilities of remote operators managing multiple autonomous vehicles, with the goal of exploring human-autonomy teaming concepts that enable m:N operations (i.e., m operators managing N vehicles). ROAM has developed into a world-class research, development, and technology (RD&T) environment that can support both the collection of human factors data and the command and control of remote vehicles in beyond visual line of sight conditions. Presented in this paper is an overview of ROAM, with a focus on the design components that support human factors data collection and a review of initial usability results of the facility.

Human factors↗
NASA NTRS2023

A Remote Vehicle Operations Center’s Role in Collecting Human Factors Data

The National Aeronautics and Space Administration is supporting research to develop a prototype remote vehicle operations center at Langley Research Center to explore current and future advanced air mobility operations using small unmanned aerial systems vehicles as surrogates for future, larger-scale passenger carrying vehicles. Data collected within the Remote Operations for Autonomous Missions (ROAM) Unmanned Aerial Systems (UAS) Operations Center will be used to explore different roles and responsibilities of remote operators managing multiple autonomous vehicles, with the goal of exploring human-autonomy teaming concepts that enable m:N operations (i.e., m operators managing N vehicles). ROAM has developed into a world-class research, development, and technology (RD&T) environment that can support both the collection of human factors data and the command and control of remote vehicles in beyond visual line of sight conditions. Presented in this paper is an overview of ROAM, with a focus on the design components that support human factors data collection and a review of initial usability results of the facility.

Human factors↗
NASA NTRS2018

Crew Resource Management for Automated Teammates (CRM-A)

Crew Resource Management (CRM) is the application of human factors knowledge and skills to ensure that teams make effective use of all resources. This includes ensuring that pilots bring in opinions of other teammates and utilize their unique capabilities. CRM was originally developed 40 years ago in response to a number of airline accidents in which the crew was found to be at fault. The goal was to improve teamwork among airline cockpit crews. The notion of "team" was later expanded to include cabin crew and ground resources. CRM has also been adopted by other industries, most notably medicine. Automation research now finds itself faced with similar issues to those faced by aviation 40 years ago: how to create a more robust system by making full use of both the automation and its human operators. With advances in machine intelligence, processing speed and cheap and plentiful memory, automation has advanced to the point that it can and should be treated as a teammate to fully take advantage of its capabilities and contributions to the system. This area of research is known as Human-Autonomy Teaming (HAT). Research on HAT has identified reusable patterns that can be applied in a wide range of applications. These patterns include features such as bi-directional communication and working agreements. This paper will explore the synergies between CRM and HAT. We believe that HAT research has much to learn from CRM and that there are benefits to expanding CRM to cover automation.

Crew Resource Management↗
NASA NTRS2017

Beyond Point Design: General Pattern to Specific Implementations

We have previously laid out a general framework for Human-Autonomy Teaming (HAT) and described how we applied this framework to a specific aeronautic task. In this presentation we demonstrate the applicability of these same principles to two familiar areas, photography and driving directions, focusing on bi-directional communication. We argue that good HAT requires communication of situation variables including operator goals and preferences and threats to meeting them, options including rationale, projected outcomes and confidence, and delegation.

human factors↗
NASA NTRSDate not supplied

HAT m:N Cognitive Task Analysis (CTA)

This Cognitive Task Analysis (CTA) study was designed to understand the capability of the m:N Tactical Operator (TO) interfaces developed by the Human-Autonomy Teaming Laboratory at NASA Ames to support operators responsible for simplified pilot operations of 100 independently operated small UAS (sUAS) in a constrained geographic area. The m:N sUAS TO interface includes a central Tactical Situation Display (TSD) digital map with moving icons reflecting the sUAS location and planned flight route. The interface also has two side panels. The left panel includes a tabular list of UAS assets and mission tasking, a list of recently viewed assets, and a list of events and alerts. The right panel includes a tabular list of UAS assets and their associated telemetry, text-based chat communication window, and a tabbed checklist window. This CTA was adapted from the incident-based applied cognitive task analysis (Militello & Hutton, 1998) and included demographics questions, scenario-based simulations, a task diagram and knowledge audit methods. In addition to examining the support provided by this m:N sUAS TO interface, this CTA study, conducted with aviation subject matter experts in analogous roles to the future tactical operator, was designed to illuminate and project likely cognitive requirements of the tactical operator. Interviewees participated in two scenario-based simulations using the m:N sUAS TO interfaces. In the first simulation, the interviewees supervised 12 sUAS operating in downtown San Diego, California transiting to and from a central sUAS Hive, restaurant locations, and customer drop off locations. Interviewees were asked to react to a UAS Volume Reservation (UVR) event with a two-phase impact on food delivery operations. In the second scenario, the interviewees supervised 100 sUAS operating in the same airspace and with the same mission. Interviewees used the interfaces to recognize and react to two sUAS air vehicle problems. After each scenario, we asked the interviewees a semi-structured list of questions to elicit their reflections about using the interfaces. Interviewees were confident in their ability to respond to two off-nominal situations in each simulation. Interviewees felt that, given high levels of automation on the sUAS, they would be able to manage the events without requiring additional support or handing off the sUAS to a colleague or supervisor in both the n=12 or n=100 sUAS settings. In the n=12 sUAS condition, interviewees used the center map to understand the asset location and progress along with mission tasking. An additional display window, Asset Telemetry, helped interviewees understand battery state and sUAS altitude. When the number of sUAS increased, interviewees altered their behavior. Rather than maintaining awareness of individual assets, interviewees appeared to become more reactive, managing exceptions. Interviewees reported that they spent less time looking at the nominal aircraft, and focused their attention primarily on the off-nominal aircraft. In addition, in the second simulation with n=100 sUAS, interviewees reported that they relied more on the side panels (Mission Timeline and Asset Telemetry) to gather information.

human-autonomy teaming↗
NASA NTRSDate not supplied

Hazard Perception & Avoidance (HPA): Part Task 1 - Results Outbrief

n April 2022, the Human Autonomy Teaming Lab (NASA Ames Research Center) conducted a manned, human-in-the-loop (HITL) simulation. This part task HITL began the lab’s Hazard Perception and Avoidance (HPA) technical work under NASA’s Advanced Air Mobility (AAM), Automated Flight and Contingency Management (AFCM) Sub-Project. The goals were to assess levels of automation for manned, electric vertical takeoff and landing (eVTOL) aircraft. This simulation tested manual and automated Resolution Advisory (RA) responses and return-to-course (RTC) maneuvers for the first version of the Airborne Collision Avoidance System’s (ACAS) rotary-wing (Xr) variant. This was conducted on a fixed-based simulator designed to fly eVTOL aircraft while maneuvering for intruding traffic. Variables for this study included levels of autonomy (i.e., manual and automated) as well as the types of alerts at the onset of conflicts (i.e., Corrective and RA). The data collected included response times, losses of well clear, and maneuver sizes and durations as well as subjective ratings like acceptability, and perceived workload. Additional details and future anticipations are also discussed.

air taxis↗
NASA NTRS2017

What Machines Need to Learn to Support Human Problem-Solving

In the development of intelligent systems that interact with humans, there is often confusion between how the system functions with respect to the humans it interacts with and how it interfaces with those humans. The former is a much deeper challenge than the latter it requires a system-level understanding of evolving human roles as well as an understanding of what humans need to know (and when) in order to perform their tasks. This talk will focus on some of the challenges in getting this right as well as on the type of research and development that results in successful human-autonomy teaming. Brief Bio: Dr. Alonso Vera is Chief of the Human Systems Integration Division at NASA Ames Research Center. His expertise is in human-computer interaction, information systems, artificial intelligence, and computational human performance modeling. He has led the design, development and deployment of mission software systems across NASA robotic and human space flight missions, including Mars Exploration Rovers, Phoenix Mars Lander, ISS, Constellation, and Exploration Systems. Dr. Vera received a Bachelor of Science with First Class Honors from McGill University in 1985 and a Ph.D. from Cornell University in 1991. He went on to a Post-Doctoral Fellowship in the School of Computer Science at Carnegie Mellon University from 1990-93.

intelligent systems↗
NASA NTRSDate not supplied

Assured Vehicle Automation 1 Sim - Results Outbrief

In early 2022, the Human Autonomy Teaming Lab (NASA Ames Research Center) conducted a manned, human-in-the-loop (HITL) simulation. This part-task HITL began the lab’s Hazard Perception and Avoidance (HPA) technical work under NASA’s Advanced Air Mobility (AAM), Automated Flight and Contingency Management (AFCM) Sub-Project. The results of that sim guided the objectives of the current study, which were to examine pilots’ use of the Airborne Collision Avoidance System (ACAS) rotorcraft variant (Xr) v2 in multiple phases of flight with two separate Xr Modes, fully leverage Xr v2 features (e.g., use radar altimeter data to inform low altitude Resolution Advisory [RA] behavior, utilize the ability to designate “terminal-area intruders,” and display airspeed-based Detect and Avoid [DAA] guidance), emulate a “Traffic Advisory” (TA), and present Xr in a higher-fidelity environment. Therefore, this study was conducted in the Vertical Motion Simulator, and the variables included Phase of Flight (En-route, Hover, and Approach) as well as ACAS Xr Mode (TA/RA and DAA). The data collected included response times, losses of well clear, and maneuver sizes and durations as well as subjective ratings like acceptability and usability. Additional details and future anticipations are also discussed.

air taxis↗
NASA NTRSDate not supplied

Hazard Perception & Avoidance (HPA), Assured Vehicle Automation 1 Simulation (AVA-1h) Results Outbrief

In late 2022, the Human Autonomy Teaming Lab (NASA Ames Research Center) conducted a manned, human-in-the-loop (HITL) simulation. This HITL was the lab’s second Hazard Perception and Avoidance (HPA) technical work under NASA’s Advanced Air Mobility (AAM), Automated Flight and Contingency Management (AFCM) Sub-Project. The goals were to assess detect and avoid technology for manned, electric vertical takeoff and landing (eVTOL) aircraft. This simulation tested Resolution Advisory (RA) responses and return-to-course (RTC) maneuvers for the second version of the Airborne Collision Avoidance System’s (ACAS) rotary-wing (Xr) variant. This was conducted at the center's Vertical Motion Simulator (VMS), on a motion-based platform, and was configured to fly eVTOL aircraft while maneuvering for intruding traffic. Variables for this study included ACAS Xr modes (i.e., TA/RA and DAA) and phases of flight (i.e., Cruise, Hover, and Approach). The data collected included response times, losses of well clear, and pilots' noncompliances to alerts and guidance as well as subjective ratings like acceptability and perceived workload. Additional details and future anticipations are also discussed.

ACAS Xr↗
NASA NTRSDate not supplied

ACAS Xr Part Task Sim, Preliminary Experiment Design

In early 2022, the Human Autonomy Teaming Lab (NASA Ames Research Center) will conduct a manned, human-in-the-loop (HITL) simulation. This part task HITL will begin the lab’s Hazard Perception and Avoidance (HPA) technical work under NASA’s Advanced Air Mobility (AAM), Automated Flight and Contingency Management (AFCM) Sub-Project. The goals will be to assess levels of automation for manned, electric vertical takeoff and landing (eVTOL) aircraft. This simulation will test manual and automated Resolution Advisory (RA) responses and return-to-course (RTC) maneuvers for the first version of the Airborne Collision Avoidance System’s (ACAS) rotary-wing (Xr) variant. This will be conducted on a fixed-based simulator designed to fly eVTOL aircraft while maneuvering for intruding traffic. Variables for this study include levels of autonomy (i.e., manual and automated) as well as the types of alerts at the onset of conflicts (i.e., Corrective and RA). The data collected will include response times, losses of well clear, and maneuver sizes and durations as well as subjective ratings like acceptability, perceived workload, and meaningful human control. Additional details and future anticipations are also discussed.

air taxis↗
NASA NTRSDate not supplied

HAT m:N Activity Overview

Since 2020, researchers from the Human Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center have conducted human-in-the-loop (HITL) simulation research to study a new control paradigm for operations involving multiple remotely piloted aircraft systems (RPAS). Colloquially referred to as "m:N," this paradigm is characterized by multiple operators collaboratively controlling multiple vehicles between them. The m:N name expresses a ratio whereby m is the number of operators and N is the number of vehicles shared between them. In this presentation, HAT Lab researchers provide a high-level overview of the m:N studies that have been performed to-date. These include a study of the m:N concept of operations (CONOPS) and the attending roles and responsibilities ("ConOps/R&R Sim"), a study focused on contingency management involving dynamic, inter-operator transfers of vehicles ("Handoff Sim"), and a study examining the effects of pilot-ATC communication systems on workload ("UAM Comms Sim"). A selection of key results are provided. The presentation concludes with a brief discussion of planned research into m:N operations.

m:N↗
DOE OSTI2024

Exploring the role of judgement and shared situation awareness when working with AI recommender systems

Abstract AI-advised Decision Making is a form of human-autonomy teaming in which an AI recommender system suggests a solution to a human operator, who is responsible for the final decision. This work seeks to examine the importance of judgement and shared situation awareness between humans and automated agents when interacting together in the form of a recommender systems. We propose manipulating both human judgement and shared situation awareness by providing the human decision maker with relevant information that the automated agent (AI), in the form of a recommender system, uses to generate possible courses of action. This paper presents the results of a two-phase between-subjects study in which participants and a recommender system jointly make a high-stakes decision. We varied the amount of relevant information the participant had, the assessment technique of the proposed solution, and the reliability of the recommender system. Findings indicate that this technique of supporting the human’s judgement and establishing a shared situation awareness is effective in (1) boosting the human decision maker’s situation awareness and task performance, (2) calibrating their trust in AI teammates, and (3) reducing overreliance on an AI partner. Additionally, participants were able to pinpoint the limitations and boundaries of the AI partner’s capabilities. They were able to discern situations where the AI’s recommendations could be trusted versus instances when they should not rely on the AI’s advice. This work proposes and validates a way to provide model-agnostic transparency into recommender systems that can support the human decision maker and lead to improved team performance.

Srivastava, Divya↗
NASA NTRS2018

Adaptive Problem Solving and Mitigation

This presentation examines how problem solving was done on the NEEMO 22 Mission and whether human autonomy teaming would be able to assist in the type of troubleshooting that was conducted by Mission Control.

human autonomy↗
NASA NTRS2017

Concepts for the Design of Human-Autonomy Systems

Over the last two years a number of workshops or similar meetings have been held under the auspice of NASA Ames Research Center that, although dealing with different primary foci, considered at some level the cross-cutting topic of humans-autonomous systems and the partnership between them. This publication presents findings from the reports of these meetings as they inform the process of designing autonomous systems to work in conjunction with humans. Some workshops were highly relevant to this question, others less so. Drawing from conclusions in these reports, this publication presents, at a high level, a summary of issues that could usefully be considered in the design process of automated systems working with human agents. Although differing in emphases, reports from the several workshops reflect many similar beliefs regarding human-autonomy teaming (HAT). Conclusions can be viewed as generally applicable to various aviation venues—air, ground, and air-ground interactions. The objective of the workshops was primarily to identify issues, concerns, and research needs associated with evolving human-autonomy systems—not in providing solutions. The analysis herewithin is generally limited to the findings in the workshop reports. And, since there was often commonality in findings among the several reports, no attempt is made to ascribe particular findings or observations to particular reports.

autonomy↗