Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cognitive Communication”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. NASA’s current concept of the future of lunar communication, LunaNet [1], outlines a complex network of networks. Challenges such as scalability, interoperability and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. The application of machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study three main areas a means to further develop cognitive networking capabilities: networking and flight software development, analysis of wireless data for modeling and simulation, and development of algorithms for a multi-agent system.

Cognitive Networking↗

Beyond game effectiveness. Part II, a qualitative study of multi-role experiential learning

The present paper is the second in a series published at I/ITSEC that seeks to explain the efficacy of multi-role experiential learning employed to create engaging game-based training methods transitioned to the U.S. Army, U.S. Army Special Forces, Civil Affairs, and Psychological Operations teams. The first publication (I/ITSEC 2009) summarized findings from a quantitative study that investigated experiential learning in the multi-player, PC-based game module transitioned to PEO-STRI, DARWARS Ambush! NK (non-kinetic). The 2009 publication reported that participants of multi-role (Player and Reflective Observer/Evaluator) game-based training reported statistically significant learning and engagement. Additionally when the means of the two groups (Player and Reflective Observer/Evaluator) were compared, they were not statistically significantly different from each other. That is to say that both playing as well as observing/evaluating were engaging learning modalities. The Observer/Evaluator role was designed to provide an opportunity for real-time reflection and meta-cognitive learning during game play. Results indicated that this role was an engaging way to learn about communication, that participants learned something about cultural awareness, and that the skills they learned were helpful in problem solving and decision-making. The present paper seeks to continue to understand what and how users of non-kinetic game-based missions learn by revisiting the 2009 quantitative study with further investigation such as stochastic player performance analysis using latent semantic analyses and graph visualizations. The results are applicable to First-Person game-based learning systems designed to enhance trainee intercultural communication, interpersonal skills, and adaptive thinking. In the full paper, we discuss results obtained from data collected from 78 research participants of diverse backgrounds who trained by engaging in tasks directly, as well as observing and evaluating peer performance in real-time. The goal is two-fold. One is to quantify and visualize detailed player performance data coming from game play transcription to give further understanding to the results in the 2009 I/ITSEC paper. The second is to develop a set of technologies from this quantification and visualization approach into a generalized application tool to be used to aid in future games’ development of player/learner models and game adaptation algorithms. Specifically, this paper addresses questions such as, “Are there significant differences in one's experience when an experiential learning task is observed first, and then performed by the same individual?” “Are there significant differences among groups participating in different roles in non-kinetic engagement training, especially when one role requires more active participation that the other?” “What is the impact of behavior modeling on learning in games?” In answering these questions the present paper reinforces the 2009 empirical study conclusion that contrary to current trends in military game development, experiential learning is enhanced by innovative training approaches designed to facilitate trainee mastery of reflective observation and abstract conceptualization as much as performance-based skills.

59 BASIC BIOLOGICAL SCIENCES↗

Research Initiatives and Preliminary Results In Automation Design In Airspace Management in Free Flight

The NASA and the FAA have entered into a joint venture to explore, define, design and implement a new airspace management operating concept. The fundamental premise of that concept is that technologies and procedures need to be developed for flight deck and ground operations to improve the efficiency, the predictability, the flexibility and the safety of airspace management and operations. To that end NASA Ames has undertaken an initial development and exploration of "key concepts" in the free flight airspace management technology development. Human Factors issues in automation aiding design, coupled aiding systems between air and ground, communication protocols in distributed decision making, and analytic techniques for definition of concepts of airspace density and operator cognitive load have been undertaken. This paper reports the progress of these efforts, which are not intended to definitively solve the many evolving issues of design for future ATM systems, but to provide preliminary results to chart the parameters of performance and the topology of the analytic effort required. The preliminary research in provision of cockpit display of traffic information, dynamic density definition, distributed decision making, situation awareness models and human performance models is discussed as they focus on the theme of "design requirements".

Corker, Kevin↗

Physiological and Cognitive Exploration Simulation: Assessments of Physiology and Cognition in Hybrid Environment: A Novel Approach to Optimize the Future of Spacewalk Simulations

As NASA plans to return to the Moon in the 2020's, with missions to Mars in the 2030's, extravehicular activities (EVAs)must be optimized due to the inherent 4-22 minute communication latency from Earth to Mars. Certain control functions previously executed by Mission Control must now be performed by astronauts, leading to a new operational paradigm or the future of mission operations. Consequently, future mission explorations will be more physically and cognitively demanding on both EV and IV personnel.

Ulman, H.↗

The Effects of Blood Glucose Levels on Cognitive Performance: A Review of the Literature

The purpose of this review paper is to discuss the research literature on the effects of blood glucose levels on executive and non-executive functions in humans. The review begins with a brief description of blood glucose, how it has been studied, previous syntheses of prior studies, and basic results regarding the role of blood glucose on cognitive functioning. The following sections describe work that investigated the effect of blood glucose on both non-executive and executive functions (e.g., sensory processing, psychomotor functioning, attention, vigilance, memory, language and communication, judgement and decision-making, and complex task performance). Within each section, summaries of the findings and challenges to the literature are included. Measurement conversions of blood glucose levels, blood glucose values, and associated symptoms are depicted. References to the types of tests used to investigate blood glucose and cognitive performance are provided. For more detailed descriptions of references within (and in addition to) this paper, an annotated bibliography is also provided. Several moderator variables including individual differences and contextual variables related to the effects of blood glucose levels on performance (e.g., age, gender, time of day, familiarity with the task and symptom awareness, expectancy effects, dose dependent effects, time dependent effects, task specific effects, rising and falling blood glucose levels, and speed and/or accuracy trade-offs) are addressed later in the paper. Some suggestions for future experimental methodologies are also made.

Feldman, Jolene↗

The Role of a Multidimensional Concept of Trust in the Performance of Global Virtual Teams

This paper focuses on the concept of trust as an important ingredient of effective global virtual team performance. Definitions of trust and virtual teams are presented. The concept of trust is developed from its unilateral application (trust, absence of trust) to a multidimensional concept including cognitive and affective components. The special challenges of a virtual team are then discussed with particular emphasis on how a multidimensional concept of trust impacts these challenges. Propositions suggesting the multidimensional concept of trust moderates the negative impacts of distance, cross cultural and organizational differences, the effects of electronically mediated communication, reluctance to share information and a lack of hi story/future on the performance of virtual teams are stated. The paper concludes with recommendations and a set of techniques to build both cognitive and affective trust in virtual teams.

Bodensteiner, Nan Muir↗

Ubiquitous Wireless Smart Sensing and Control

Need new technologies to reliably and safely have humans interact within sensored environments (integrated user interfaces, physical and cognitive augmentation, training, and human-systems integration tools). Areas of focus include: radio frequency identification (RFID), motion tracking, wireless communication, wearable computing, adaptive training and decision support systems, and tele-operations. The challenge is developing effective, low cost/mass/volume/power integrated monitoring systems to assess and control system, environmental, and operator health; and accurately determining and controlling the physical, chemical, and biological environments of the areas and associated environmental control systems.

Wagner, Raymond↗

Ubiquitous Wireless Smart Sensing and Control. Pumps and Pipes JSC: Uniquely Houston

Need new technologies to reliably and safely have humans interact within sensored environments (integrated user interfaces, physical and cognitive augmentation, training, and human-systems integration tools).Areas of focus include: radio frequency identification (RFID), motion tracking, wireless communication, wearable computing, adaptive training and decision support systems, and tele-operations. The challenge is developing effective, low cost/mass/volume/power integrated monitoring systems to assess and control system, environmental, and operator health; and accurately determining and controlling the physical, chemical, and biological environments of the areas and associated environmental control systems.

Wagner, Raymond↗

Developing a Hybrid Space Suit Simulator as a Research Tool for Assessing Extravehicular Activity Relevant Workload

Suited testing time is limited and hard to come by, expensive, and requires a whole team to operate and monitor the suit; however, pressurized spacesuits are not always necessary for initial developmental efforts or assessment of informatics. The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a Hybrid Space Suit Simulator (HS3) to support characterization of human performance during planetary surface exploration analogs. The primary goal of HS3 is to create a low cost, modular, and unpressurized suit simulator for use as a research tool which provides relevant physical and cognitive workload approximations with EVA-like immersion during planetary extravehicular activity (EVA) simulations. HS3 consists of a soft suit, communication, thermal control, gloves, boots, helmet, and integrated bioinformatics/sensors. The modular design of HS3 allows it to be modified to support test objectives as needed. HS3 enables H-3PO and NASA to complete critical human health and performance testing to address open risks and knowledge gaps in a timely, repeatable, and controlled manner. Four engineering runs were completed with HS3 as a baseline for capability. General workload was assessed while traversing on a passive treadmill and conducting geology tasks. Liquid cooling temperature, suit temperature, and metabolic rates were collected during one extended three-hour engineering run. For the duration of the engineering run the suit temperature was 26.6 ± 1.58 °C while suit humidity was 53.7 ± 5.11 %. Helmet temperature was higher than suit temperature at 27.8 ± 1.58 °C. Helmet humidity was lower than average suit humidity at 50.12 ± 11.3 °C. The liquid cooling temperature remained stable at 22.4 ± 1.62 °C. Resting metabolic rate was 597 ± 88 BTU/hr while metabolic rate increased during traverse tasks at 1500 ± 319 BTU/hr and geology tasks at 921 ± 129 BTU/hr. Following the engineering runs, a characterization study will be conducted. The subjects will perform EVA-like scenarios in both a shirtsleeve only and donned HS3, consisting of EVA task circuit focused on traversing, geological rock sampling, and task board manipulation. The characterization study will provide data capability for implementing HS3 in analog EVA testing environments.

Monica Hew↗

Preliminary Design of an 'Autonomous Medical Response Agent' Interface Prototype for Long Duration Spaceflight

Major challenges for astronauts in future long-duration exploration missions (LDEMs) will be that crewmembers are not expected to be medical professionals, may be under high workload and stress, are facing physiological challenges caused by spaceflight, and will have limited, delayed voice communications with medical support from Earth. An autonomous medical response agent (AMRA) is envisioned to help astronauts address medical complaints, develop a differential diagnosis, and guide self-treatment until a healthy state is restored. AMRA develops a process of personalized diagnosis and treatment through a Bayesian predictive control system that recommends therapeutic control actions including diagnostic tests and treatments to crewmembers (Menon, 2020). The Human Computer Interaction (HCI) lab from NASA Ames Research Center’s Human Systems Integration Division (Code TH) has collaborated with Nahlia Inc in human-centered design augmentation research for AMRA. The project, titled Design of ‘Autonomous Medical Response Agent Interface Prototype for Long Duration Spaceflight, has been funded by the Translational Research Institute for Space Health (TRISH) and introduces an interactive user-interface prototype that guides astronauts through self-diagnosis, treatment, and rehabilitation while communicating with remote specialists in ground support (most notably a patient’s flight surgeon). Our project develops the interaction design for the crewmember using AMRA through user research, iterative design, and usability testing to evaluate the user interface and workflow designed. The interface design deliverable for this project, titled AMRA Aggregate Information Display (AMRA AID) is an integrated information display system for comprehensive autonomous medical guidance, diagnosis, and treatment of in-flight medical conditions experienced by crewmembers. AMRA AID demonstrates how we might ensure crew autonomy, increase the crew’s medical capabilities, and decrease cognitive burden within a front-end user interface. AMRA AID refrains from relying on input from ground or mission control for self-treatment of medical issues—though ground awareness and communication with ground is maintained as a means of ensuring trust between mission control and crew. AMRA AID demonstrates how the crew’s on-board medical system might integrate with information from vehicle monitoring and crew schedule, without assuming causal relationships. AMRA AID’s comprehensive view enables efficient information access for both crew and ground support, reducing cognitive burden in the event of an unplanned or emergency medical incident and enabling informed analytical decisions to be made based on both crew and vehicle health. Human-centered design augmentation advanced within the prototype included: enhanced workflow and treatment guidance for two medical scenarios for a non-specialist user base with various levels of medical training, interaction design which considered speech (conversational user interface) elements and on-screen interactions to be developed in future iterations of the project, communication design and functional requirements relevant to self-care versus caring for another astronaut, as well as user testing of the prototype with an international space medical community. This project arrives at critical findings regarding usability needs, communication requirements, and integrated information requirements for a future technology interface functioning to increase confidence between ground support and LDEM crewmembers.

TRISH↗

SHAPA: An interactive software tool for protocol analysis applied to aircrew communications and workload

As modern transport environments become increasingly complex, issues such as crew communication, interaction with automation, and workload management have become crucial. Much research is being focused on holistic aspects of social and cognitive behavior, such as the strategies used to handle workload, the flow of information, the scheduling of tasks, the verbal and non-verbal interactions between crew members. Traditional laboratory performance measures no longer sufficiently meet the needs of researchers addressing these issues. However observational techniques are better equipped to capture the type of data needed and to build models of the requisite level of sophistication. Presented here is SHAPA, an interactive software tool for performing both verbal and non-verbal protocol analysis. It has been developed with the idea of affording the researchers the closest possible degree of engagement with protocol data. The researcher can configure SHAPA to encode protocols using any theoretical framework or encoding vocabulary that is desired. SHAPA allows protocol analysis to be performed at any level of analysis, and it supplies a wide variety of tools for data aggregation, manipulation. The output generated by SHAPA can be used alone or in combination with other performance variables to get a rich picture of the influences on sequences of verbal or nonverbal behavior.

James, Jeffrey M.↗

Man-Machine Interaction Design and Analysis System (MIDAS): Memory Representation and Procedural Implications for Airborne Communication Modalities

The Man-Machine Interaction Design and Analysis System (MIDAS) has been under development for the past ten years through a joint US Army and NASA cooperative agreement. MIDAS represents multiple human operators and selected perceptual, cognitive, and physical functions of those operators as they interact with simulated systems. MIDAS has been used as an integrated predictive framework for the investigation of human/machine systems, particularly in situations with high demands on the operators. Specific examples include: nuclear power plant crew simulation, military helicopter flight crew response, and police force emergency dispatch. In recent applications to airborne systems development, MIDAS has demonstrated an ability to predict flight crew decision-making and procedural behavior when interacting with automated flight management systems and Air Traffic Control. In this paper we describe two enhancements to MIDAS. The first involves the addition of working memory in the form of an articulatory buffer for verbal communication protocols and a visuo-spatial buffer for communications via digital datalink. The second enhancement is a representation of multiple operators working as a team. This enhanced model was used to predict the performance of human flight crews and their level of compliance with commercial aviation communication procedures. We show how the data produced by MIDAS compares with flight crew performance data from full mission simulations. Finally, we discuss the use of these features to study communications issues connected with aircraft-based separation assurance.

Corker, Kevin M.↗

VISION: a modular AI assistant for natural human-instrument interaction at scientific user facilities

Scientific user facilities, such as synchrotron beamlines, are equipped with a wide array of hardware and software tools that require a codebase for human-computer-interaction. This often necessitates developers to be involved to establish connection between users/researchers and the complex instrumentation. The advent of generative AI presents an opportunity to bridge this knowledge gap, enabling seamless communication and efficient experimental workflows. Here we present a modular architecture for the Virtual Scientific Companion by assembling multiple AI-enabled cognitive blocks that each scaffolds large language models (LLMs) for a specialized task. With VISION, we performed LLM-based operation on the beamline workstation with low latency and demonstrated the first voice-controlled experiment at an x-ray scattering beamline. The modular and scalable architecture allows for easy adaptation to new instruments and capabilities. Development on natural language-based scientific experimentation is a building block for an impending future where a science exocortex—a synthetic extension to the cognition of scientists—may radically transform scientific practice and discovery.

36 MATERIALS SCIENCE↗

Training - Behavioral and motivational solutions?

Psychological factors which govern interpersonal activities in the cockpit are examined. It is suggested that crew members should be selected based on personality characteristics required for the position and that training does not cause long lasting personality changes, it only teaches and improves task performance skills. The effects of mindlessness as defined by Langer (1978) and the attribution theory of Jones and Nisbett (1971) on flight deck communications and cockpit management are described. The needs for a new system of training crew members, with emphasis on strategies that induce cognitive processes and awareness, and for field investigations of pilots are discussed.

Helmreich, Robert L.↗

The Current State and Future of the Former Central Nervous System Risk Managed by Space Radiation Element Part of NASA’s Human Research Program

Historically, the Space Radiation Element, as part of the NASA Human Research Program, was responsible for the scientific strategy and funding of research focused on characterizing and mitigating the effects of space radiation exposure on the central nervous system (CNS). During the past few years, there have been two major changes that have affected the management of the science associated with the CNS risk. The first major change was the integration of several related risks: CNS (C), behavioral medicine (B), and sensorimotor (S) to be managed as an integrated effort called CBS. CBS was formed to accelerate research on combined spaceflight stressors, specifically space radiation, microgravity, isolation, and confinement. CBS was managed by Human Factors and Behavioral Performance (HFBP) with support and inputs from Space Radiation as well as Human Health Countermeasures. Secondly, and more recently, the CNS risk was absorbed by the behavioral medicine risk currently also held by HFPB. As a result, the gaps associated with CNS were removed and aspects of them are represented in the BMED gaps (link). However, due to recent changes in element leadership, budget, and timeline, extensive restructuring of CBS is in progress. In addition, in an effort to harmonize datasets to be used in modeling efforts, an Animal Standardization TIM was held in June 2021 to standardize the type of behavioral and cognitive tasks as well as experimental set-ups used in animal models of future funded research. This presentation is an effort to communicate with the radiation research community concerning the strategy, management, and future of the former central nervous system risk and the role of the Space Radiation Element.

Janice A Zawaski↗

Hazard alerting and situational awareness in advanced air transport cockpits

Advances in avionics and display technology have significantly changed the cockpit environment in current 'glass cockpit' aircraft. Recent developments in display technology, on-board processing, data storage, and datalinked communications are likely to further alter the environment in second and third generation 'glass cockpit' aircraft. The interaction of advanced cockpit technology with human cognitive performance has been a major area of activity within the MIT Aeronautical Systems Laboratory. This paper presents an overview of the MIT Advanced Cockpit Simulation Facility. Several recent research projects are briefly reviewed and the most important results are summarized.

Hansman, R. John↗

Developing a Hybrid Spacesuit Simulator as a Research Tool for Assessing Extravehicular Activity Relevant Workload

Conducting human tests in a pressurized spacesuit is limited by availability, cost, and manpower; however, pressurized spacesuits are not always needed depending on the objectives of testing, including the development and testing of new informatics capabilities. The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA is developing a Hybrid Spacesuit Simulator (HS3) to support testing and characterization of human performance during analog planetary exploration extravehicular activities (EVAs). The goal of HS3 is to create a low-cost, modular, and unpressurized spacesuit simulator as a research tool that provides relevant physical and cognitive workload approximations with EVA-like immersion. HS3 consists of a soft outer suit, thermal control, gloves, boots, helmet, and integrated bioinformatics and communications. Baseline HS3 assessments were performed during 3-hour EVA simulations in two different subjects (DEMO1 and DEMO2) that included traverses at variable resistances and geological sampling activities. Liquid cooling garment (LCG) temperature, mean skin temperature, heart rate, motion capture, and metabolic rate were collected during each 3-hour simulated EVA. During DEMO1 and DEMO2, baseline metabolic rates at rest were 836 ± 327 BTU/hr and 869 ± 207 BTU/hr and increased to 2124 ± 548 BTU/hr and 2269 ± 559 BTU/hr, respectively, during 500m traverse. Average inlet LCG temperatures were 29.57 ± 6.62 °C and 25.63 ± 6.48 °C for DEMO1 and DEMO2 with increased outlet LCG temperatures of 33.53 ± 6.62 °C and 29.21 ± 4.79 °C, respectively. Overall, HS3 will enable future studies to characterize EVA tasks, human performance, and test future EVA capabilities in analog test environments without the need for pressurized suited environments.

Monica Hew↗

Developing A Hybrid Spacesuit Simulator as A Research Tool for Assessing Extravehicular Activity Relevant Workload

Conducting human tests in a pressurized spacesuit is limited by availability, cost, and manpower; however, pressurized spacesuits are not always needed depending on the objectives of testing, including the development and testing of new informatics capabilities. The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA is developing a Hybrid Spacesuit Simulator (HS3) to support testing and characterization of human performance during analog planetary exploration extravehicular activities (EVAs). The goal of HS3 is to create a low-cost, modular, and unpressurized spacesuit simulator as a research tool that provides relevant physical and cognitive workload approximations with EVA-like immersion. HS3 consists of a soft outer suit, thermal control, gloves, boots, helmet, and integrated bioinformatics and communications. Baseline HS3 assessments were performed during 3-hour EVA simulations in two different subjects (DEMO1 and DEMO2) that included traverses at variable resistances and geological sampling activities. Liquid cooling garment (LCG) temperature, mean skin temperature, heart rate, motion capture, and metabolic rate were collected during each 3-hour simulated EVA. During DEMO1 and DEMO2, baseline metabolic rates at rest were 836 ± 327 BTU/hr and 869 ± 207 BTU/hr and increased to 2124 ± 548 BTU/hr and 2269 ± 559 BTU/hr, respectively, during 500m traverse. Average inlet LCG temperatures were 29.57 ± 6.62 °C and 25.63 ± 6.48 °C for DEMO1 and DEMO2 with increased outlet LCG temperatures of 33.53 ± 6.62 °C and 29.21 ± 4.79 °C, respectively. Overall, HS3 will enable future studies to characterize EVA tasks, human performance, and test future EVA capabilities in analog test environments without the need for pressurized suited environments.

Suit simulator↗