Results for “Human Performance Improvement” — Page 3

NASA NTRS2012

Variable Vector Countermeasure Suit (V2Suit) for Space Habitation and Exploration

The "Variable Vector Countermeasure Suit (V2Suit) for Space Habitation and Exploration" is a visionary system concept that will revolutionize space missions by providing a platform for integrating sensors and actuators with daily astronaut intravehicular activities to improve human health and performance. The V2Suit uses control moment gyroscopes (CMGs) within a miniaturized module placed on body segments to provide a "viscous resistance" during movements and a countermeasure to the sensorimotor and musculoskeletal adaptation performance decrements that manifest themselves while living and working in microgravity and during gravitational transitions during long-duration spaceflight, including post-flight recovery and rehabilitation. Through an integrated design, system initialization, and control systems approach the V2Suit is capable of generating this "viscous resistance" along an arbitrarily specified direction of "down." When movements are made, for example, parallel to that "down" direction a resistance is applied, and when the movement is perpendicular to that direction no resistance is applied. The V2Suit proposes to be a countermeasure to this spaceflight-related adaptation and de-conditioning and the unique sensorimotor characteristics associated with living and working in 0-G, which are critical for future long-duration space missions.This NIAC Phase I project focused on detailing several aspects of the V2Suit concept, including human-system integration, system architecture, computer aided design (CAD) modeling, and closed-loop simulation and analysis. In addition, early-stage breadboard prototyping of several aspects of the V2Suit system modules enabled characterization of expected performance and identified areas for further research and development to enable operational implementation of the V2Suit. In particular, potential challenges with integration of commercial-off-the-shelf components were identified. The key enabler for operational use and adoption of the V2Suit is a low-profile body worn form factor that does not interfere with normal, everyday movements and interfaces adequately with the body as to provide the generated gyroscopic torque for the perceptions of movement with a "viscous resistance." These aspects were investigated through mockups using a life-size mannequin, and through body attachment mechanisms on the breadboard prototype. Through the evaluation and investigation of commercially-available components, as well as an identification of desirable form factors, CAD models of the V2Suit modules were developed. These models included all of the required elements and spin motors, flywheel masses, gimbal motors, slip rings, inertial measurement units, motor controllers, and the required mounting brackets/hardware and cabling. The configuration and orientation of the control moment gyroscopes (CMGs) was specified according to results from the modeling, simulation and analysis. Two revisions of the CAD model were investigated through closed-loop simulation of the CMGs, and their ability to generate a resultant reaction force during movement and null undesirable torques due to changes in the direction of the angular momentum vector as a result of the normal body movements.

space missions↗

NASA NTRS2009

Lunar Human Research Requirements (LHRR)

Biomedical research will be conducted during transit and on the surface of the Moon to prepare for extended stays on the Moon and to prepare for the exploration of Mars. The objective of the Human Research Program (HRP) is to preserve the health and enhance performance of astronaut explorers. Specific objectives of the HRP include developing the knowledge, capabilities, and necessary countermeasures and technologies in support of human space exploration; focusing on mitigating the highest risks to crew health and performance; and defining and improving human spaceflight medical, environmental, behavioral, and human factors standards. This document contains a detailed description of the resource accommodations, interfaces, and environments to be provided by the Constellation Program (CxP) to support the HRP research in transit and on the lunar surface. Covered, specifically, are the requirements for mass and volume transport; crew availability; ground operations, baseline data collection, and payload processing; power, and data. Volumes and mass are given for transport of conditioned samples only. They do not account for the engineering solution that the Constellation Program will implement (refrigerator/freezer volume/mass). This document does not account for requirements on the Orion vehicle for transportation to and from the International Space Station (ISS). The ISS Program has supplied requirements for this mission.

Denkins, Pamela↗

NASA NTRS2010

Relating Linear and Volumetric Variables Through Body Scanning to Improve Human Interfaces in Space

Designing space suits and vehicles for the diverse human population present unique challenges for the methods of traditional anthropometry. Space suits are bulky and allow the operator to shift position within the suit and inhibit the ability to identify body landmarks. Limited suit sizing options also cause variability in fit and performance between similarly sized individuals. Space vehicles are restrictive in volume in both the fit and the ability to collect data. NASA's Anthropometric and Biomechanics Facility (ABF) has utilized 3D scanning to shift from traditional linear anthropometry to explore and examine volumetric capabilities to provide anthropometric solutions for design. Overall, the key goals are to improve the human-system performance and develop new processes to aid in the design and evaluation of space systems. Four case studies are presented that illustrate the shift from purely linear analyses to an augmented volumetric toolset to predict and analyze the human within the space suit and vehicle. The first case study involves the calculation of maximal head volume to estimate total free volume in the helmet for proper air exchange. Traditional linear measurements resulted in an inaccurate representation of the head shape, yet limited data exists for the determination of a large head volume. Steps were first taken to identify and classify a maximum head volume and the resulting comparisons to the estimate are presented in this paper. This study illustrates the gap between linear components of anthropometry and the need for overall volume metrics in order to provide solutions. A second case study examines the overlay of the space suit scans and components onto scanned individuals to quantify fit and clearance to aid in sizing the suit to the individual. Restrictions in space suit size availability present unique challenges to optimally fit the individual within a limited sizing range while maintaining performance. Quantification of the clearance and fit between similarly sized individuals is critical in providing a greater understanding of the human body's function within the suit. The third case study presented in this paper explores the development of a conformal seat pan using scanning techniques, and details the challenges of volumetric analyses that were overcome in order to develop a universal seat pan that can be utilized across the entire user population. The final case study explores expanding volumetric capabilities through generation of boundary manikins. Boundary manikins are representative individuals from the population of interest that represent the extremes of the population spectrum. The ABF developed a technique to take three-dimensional scans of individuals and manipulate the scans to reflect the boundary manikins' anthropometry. In essence, this process generates a representative three-dimensional scan of an individual from anthropometry, using another individual's scanned image. The results from this process can be used in design process modeling and initial suit sizing work as a three dimensional, realistic example of individuals from the population, maintaining the variability between and correlation to the relevant dimensions of interest.

Margerum, Sarah E.↗

NASA NTRS2014

Human-Robot Interaction Directed Research Project

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces and command modalities affect the human's ability to perform tasks accurately, efficiently, and effectively when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. This DRP concentrates on three areas associated with interfaces and command modalities in HRI which are applicable to NASA robot systems: 1) Video Overlays, 2) Camera Views, and 3) Command Modalities. The first study focused on video overlays that investigated how Augmented Reality (AR) symbology can be added to the human-robot interface to improve teleoperation performance. Three types of AR symbology were explored in this study, command guidance (CG), situation guidance (SG), and both (SCG). CG symbology gives operators explicit instructions on what commands to input, whereas SG symbology gives operators implicit cues so that operators can infer the input commands. The combination of CG and SG provided operators with explicit and implicit cues allowing the operator to choose which symbology to utilize. The objective of the study was to understand how AR symbology affects the human operator's ability to align a robot arm to a target using a flight stick and the ability to allocate attention between the symbology and external views of the world. The study evaluated the effects type of symbology (CG and SG) has on operator tasks performance and attention allocation during teleoperation of a robot arm. The second study expanded on the first study by evaluating the effects of the type of navigational guidance (CG and SG) on operator task performance and attention allocation during teleoperation of a robot arm through uplinked commands. Although this study complements the first study on navigational guidance with hand controllers, it is a separate investigation due to the distinction in intended operators (i.e., crewmembers versus ground-operators). A third study looked at superimposed and integrated overlays for teleoperation of a mobile robot using a hand controller. When AR is superimposed on the external world, it appears to be fixed onto the display and internal to the operators' workstation. Unlike superimposed overlays, integrated overlays often appear as three-dimensional objects and move as if part of the external world. Studies conducted in the aviation domain show that integrated overlays can improve situation awareness and reduce the amount of deviation from the optimal path. The purpose of the study was to investigate whether these results apply to HRI tasks, such as navigation with a mobile robot. HRP GAPS This HRI research contributes to closure of HRP gaps by providing information on how display and control characteristics - those related to guidance, feedback, and command modalities - affect operator performance. The overarching goals are to improve interface usability, reduce operator error, and develop candidate guidelines to design effective human-robot interfaces.

Sandor, Aniko↗

NASA NTRS2003

National Aeronautics and Space Administration Biological and Physical Research Enterprise Strategy

As the 21st century begins, NASA's new Vision and Mission focuses the Agency's Enterprises toward exploration and discovery.The Biological and Physical Research Enterprise has a unique and enabling role in support of the Agency's Vision and Mission. Our strategic research seeks innovations and solutions to enable the extension of life into deep space safely and productively. Our fundamental research, as well as our research partnerships with industry and other agencies, allow new knowledge and tech- nologies to bring improvements to life on Earth. Our interdisciplinary research in the unique laboratory of microgravity addresses opportunities and challenges on our home planet as well as in space environments. The Enterprise maintains a key role in encouraging and engaging the next generation of explorers from primary school through the grad- uate level via our direct student participation in space research.The Biological and Physical Research Enterprise encompasses three themes. The biological sciences research theme investigates ways to support a safe human presence in space. This theme addresses the definition and control of physiological and psychological risks from the space environment, including radiation,reduced gravity, and isolation. The biological sciences research theme is also responsible for the develop- ment of human support systems technology as well as fundamental biological research spanning topics from genomics to ecologies. The physical sciences research theme supports research that takes advantage of the space environment to expand our understanding of the fundamental laws of nature. This theme also supports applied physical sciences research to improve safety and performance of humans in space. The research partnerships and flight support theme establishes policies and allocates space resources to encourage and develop entrepreneurial partners access to space research.Working together across research disciplines, the Biological and Physical Research Enterprise is performing vital research and technology development to extend the reach of human space flight.

Source record↗

DOE OSTI2021

Human-automated vehicle interactions

This dissertation is proposed to answer the question: how can the interactions between human and automated vehicles be used to improve the overall performance of automated driving technology? Multiple different modules in automated vehicles such as the perception, motion plan and motion control modules can potentially be benefitted from human-automated vehicle interactions. For perception module, the self-correction of faulty sensors can be achieved using human demonstration data. For motion plan and motion control modules, the performance of the low-level motion controller can be improved with the help of human demonstration, and the behavior of the motion planner can be improved using human intervention data during automated driving. Moreover, a better model for a human driver could improve the overall efficiency and comfort of vehicles in connected mixed traffic. In this dissertation, the technical research toward these goals has been completed and has resulted in several peer-reviewed publications. Optimization methods and model predictive control are used extensively to improve energy efficiency while maintaining safe and comfort driving. An inverse model predictive control (IMPC) method has been developed and it has been proven to be effective in modeling the motion of human driven vehicles. The proposed method has demonstrated its benefits in both connected automated highway driving and the bilateral adaptation of human driver and automated driving controller in human-in-the loop simulations. The proposed future research seeks to broaden the application of IMPC by considering a more comprehensive cost function design and applying it to more complex driving situations.

Guo, Longxiang↗

DOE OSTI2021

HUMAN-AUTOMATED VEHICLE INTERACTIONS

This dissertation is proposed to answer the question: how can the interactions between human and automated vehicles be used to improve the overall performance of automated driving technology? Multiple different modules in automated vehicles such as the perception, motion plan and motion control modules can potentially be benefitted from human-automated vehicle interactions. For perception module, the self-correction of faulty sensors can be achieved using human demonstration data. For motion plan and motion control modules, the performance of the low-level motion controller can be improved with the help of human demonstration, and the behavior of the motion planner can be improved using human intervention data during automated driving. Moreover, a better model for a human driver could improve the overall efficiency and comfort of vehicles in connected mixed traffic. In this dissertation, the technical research toward these goals has been completed and has resulted in several peer-reviewed publications. Optimization methods and model predictive control are used extensively to improve energy efficiency while maintaining safe and comfort driving. An inverse model predictive control (IMPC) method has been developed and it has been proven to be effective in modeling the motion of human driven vehicles. The proposed method has demonstrated its benefits in both connected automated highway driving and the bilateral adaptation of human driver and automated driving controller in human-in-the loop simulations. The proposed future research seeks to broaden the application of IMPC by considering a more comprehensive cost function design and applying it to more complex driving situations.

Guo, Longxiang↗

NASA NTRS1984

Dynamical relations for left ventricular ejection - Flow rate, momentum, force and impulse

An investigation was carried out to quantitatively evaluate left ventricular volume flow rate, momentum, force and impulse derived from application of conservation principles for mass and momentum of blood within the ventricle during the ejection phase. An automated digital image processing system was developed and applied to left ventricular angiograms which are computer processed and analyzed frame by frame to determine the dynamical relations by numerical methods. The initial experience with force and impulse has indicated that neither quantity seemed to be a sensitive indicator of coronary artery disease as evaluated by qualitative angiography for the particular patient group studied. Utilization of the dynamical relations in evaluating human left ventricular performance requires improved means of measurement and interpretation of clinical studies.

Back, L. H.↗

NASA NTRS2012

Human Systems Integration in Practice: Constellation Lessons Learned

NASA's Constellation program provided a unique testbed for Human Systems Integration (HSI) as a fundamental element of the Systems Engineering process. Constellation was the first major program to have HSI mandated by NASA's Human Rating document. Proper HSI is critical to the success of any project that relies on humans to function as operators, maintainers, or controllers of a system. HSI improves mission, system and human performance, significantly reduces lifecycle costs, lowers risk and minimizes re-design. Successful HSI begins with sufficient project schedule dedicated to the generation of human systems requirements, but is by no means solely a requirements management process. A top-down systems engineering process that recognizes throughout the organization, human factors as a technical discipline equal to traditional engineering disciplines with authority for the overall system. This partners with a bottoms-up mechanism for human-centered design and technical issue resolution. The Constellation Human Systems Integration Group (HSIG) was a part of the Systems Engineering and Integration (SE&I) organization within the program office, and existed alongside similar groups such as Flight Performance, Environments & Constraints, and Integrated Loads, Structures and Mechanisms. While the HSIG successfully managed, via influence leadership, a down-and-in Community of Practice to facilitate technical integration and issue resolution, it lacked parallel top-down authority to drive integrated design. This presentation will discuss how HSI was applied to Constellation, the lessons learned and best practices it revealed, and recommendations to future NASA program and project managers. This presentation will discuss how Human Systems Integration (HSI) was applied to NASA's Constellation program, the lessons learned and best practices it revealed, and recommendations to future NASA program and project managers on how to accomplish this critical function.

Zumbado, Jennifer Rochlis↗

DOE OSTI2025

Bridging the Gap Between Modern UX Design and Particle Accelerator Control Room Interfaces

Accelerator control systems often represent relatively complex and safety-sensitive human-machine interfaces within process control industries. These systems are technically robust and reflect the cumulative integration of solutions built and adapted across decades. One of the regular, unfortunate casualties of provisional accelerator control system updates is their human-system interfaces (HSIs) which often lag behind modern usability and design standards. An additional challenge is that although there is a multitude of established human factors (HF), and user experience (UX) principles for everyday digital applications, there are very few (if any) established principles for complex and safety-critical applications for an accelerator. This paper argues for the importance of established HF and UX principles (herein referred to as human-centered design principles) into the development of accelerator HSIs, emphasizing the need for clarity, consistency, responsiveness, and cognitive accessibility. Drawing from HF/UX best practices and human-centered design, this paper discusses how these approaches can enhance operator performance, reduce human error, and improve accelerator personnel collaboration. Case studies from Accelerator Control Operations Research Network (ACORN) at Fermilab are explored to demonstrate how interfaces built with human-centered design principles can scale with system complexity while remaining intuitive and efficient for diverse user roles including operators, machine experts, and engineers. By bridging the gap between traditional control system design and modern human-centered design methods, this paper provides a roadmap for evolving accelerator HSIs into more usable, maintainable, and effective tools.

Hill, Rachael [Idaho Natl. Lab.]↗

NASA NTRS1997

Wings: A New Paradigm in Human-Centered Design

Many aircraft accidents/incidents investigations cite crew error as a causal factor (Boeing Commercial Airplane Group 1996). Human factors experts suggest that crew error has many underlying causes and should be the start of an accident investigation and not the end. One of those causes, the flight deck design, is correctable. If a flight deck design does not accommodate the human's unique abilities and deficits, crew error may simply be the manifestation of this mismatch. Pilots repeatedly report that they are "behind the aircraft" , i.e., they do not know what the automated aircraft is doing or how the aircraft is doing it until after the fact. Billings (1991) promotes the concept of "human-centered automation"; calling on designers to allocate appropriate control and information to the human. However, there is much ambiguity regarding what it mean's to be human-centered. What often are labeled as "human-centered designs" are actually designs where a human factors expert has been involved in the design process or designs where tests have shown that humans can operate them. While such designs may be excellent, they do not represent designs that are systematically produced according to some set of prescribed methods and procedures. This paper describes a design concept, called Wings, that offers a clearer definition for human-centered design. This new design concept is radically different from current design processes in that the design begins with the human and uses the human body as a metaphor for designing the aircraft. This is not because the human is the most important part of the aircraft (certainly the aircraft would be useless without lift and thrust), but because he is the least understood, the least programmable, and one of the more critical elements. The Wings design concept has three properties: a reversal in the design process, from aerodynamics-, structures-, and propulsion-centered to truly human-centered; a design metaphor that guides function allocation and control and display design; and a deliberate distinction between two fundamental functions of design, to complement and to interpret human performance. The complementary function extends the human's capabilities beyond his or her current limitations - this includes sensing, computation, memory, physical force, and human decision making styles and skills. The interpretive (or hermeneutic, Hollnagel 1991) function translates information, functionality, and commands between the human and the aircraft. The Wings design concept allows the human to remain aware of the aircraft through natural interpretation. It also affords great improvements in system performance by maximizing the human's natural abilities and complementing the human's skills in a natural way. This paper will discuss the Wings design concept by describing the reversal in the traditional design process, the function allocation strategy of Wings, and the functions of complementing and interpreting the human.

Schutte, Paul C.↗

NASA NTRS2011

Haptic-Multimodal Flight Control System Update

The rapidly advancing capabilities of autonomous aircraft suggest a future where many of the responsibilities of today s pilot transition to the vehicle, transforming the pilot s job into something akin to driving a car or simply being a passenger. Notionally, this transition will reduce the specialized skills, training, and attention required of the human user while improving safety and performance. However, our experience with highly automated aircraft highlights many challenges to this transition including: lack of automation resilience; adverse human-automation interaction under stress; and the difficulty of developing certification standards and methods of compliance for complex systems performing critical functions traditionally performed by the pilot (e.g., sense and avoid vs. see and avoid). Recognizing these opportunities and realities, researchers at NASA Langley are developing a haptic-multimodal flight control (HFC) system concept that can serve as a bridge between today s state of the art aircraft that are highly automated but have little autonomy and can only be operated safely by highly trained experts (i.e., pilots) to a future in which non-experts (e.g., drivers) can safely and reliably use autonomous aircraft to perform a variety of missions. This paper reviews the motivation and theoretical basis of the HFC system, describes its current state of development, and presents results from two pilot-in-the-loop simulation studies. These preliminary studies suggest the HFC reshapes human-automation interaction in a way well-suited to revolutionary ease-of-use.

Goodrich, Kenneth H.↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2010

Integration of MSFC Usability Lab with Usability Testing

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

Cheng, Yiwei↗

NASA NTRS2014

Human-Robot Interaction Directed Research Project

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces and command modalities affect the human's ability to perform tasks accurately, efficiently, and effectively when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. This DRP concentrates on three areas associated with interfaces and command modalities in HRI which are applicable to NASA robot systems: 1) Video Overlays, 2) Camera Views, and 3) Command Modalities. The first study focused on video overlays that investigated how Augmented Reality (AR) symbology can be added to the human-robot interface to improve teleoperation performance. Three types of AR symbology were explored in this study, command guidance (CG), situation guidance (SG), and both (SCG). CG symbology gives operators explicit instructions on what commands to input, whereas SG symbology gives operators implicit cues so that operators can infer the input commands. The combination of CG and SG provided operators with explicit and implicit cues allowing the operator to choose which symbology to utilize. The objective of the study was to understand how AR symbology affects the human operator's ability to align a robot arm to a target using a flight stick and the ability to allocate attention between the symbology and external views of the world. The study evaluated the effects type of symbology (CG and SG) has on operator tasks performance and attention allocation during teleoperation of a robot arm. The second study expanded on the first study by evaluating the effects of the type of navigational guidance (CG and SG) on operator task performance and attention allocation during teleoperation of a robot arm through uplinked commands. Although this study complements the first study on navigational guidance with hand controllers, it is a separate investigation due to the distinction in intended operators (i.e., crewmembers versus ground-operators). A third study looked at superimposed and integrated overlays for teleoperation of a mobile robot using a hand controller. When AR is superimposed on the external world, it appears to be fixed onto the display and internal to the operators' workstation. Unlike superimposed overlays, integrated overlays often appear as three-dimensional objects and move as if part of the external world. Studies conducted in the aviation domain show that integrated overlays can improve situation awareness and reduce the amount of deviation from the optimal path. The purpose of the study was to investigate whether these results apply to HRI tasks, such as navigation with a mobile robot.

Sandor, Aniko↗

NASA NTRS2026

Machine Learning for Predicting Team Functioning in HERA Missions

Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.

Shrivatsa Mishra↗

DOE OSTI2020

A method to fuse multiphysics waveforms and improve predictive explosion detection: theory, experiment and performance

Natural and human-made sources of transient energy often emit multiple geophysical signatures that include mechanical and electromagnetic waveforms. We present a constructive method to fuse and evaluate statistics that we derive from such multiphysics waveforms that improves our capability to detect small, near-ground explosions over similar methods that consume single signature waveforms. Our method advances Fisher's Combined Probability Test (Fisher's Method) to operate under both hypotheses of a binary test on noisy data and provide researchers with the density functions required to forecast the ability of Fisher's Method to screen fused explosion signatures from noise. We apply this method against 12 d, multisignature explosion and noise records to show (1) that a fused multiphysics waveform statistic that combines radio, acoustic and seismic waveform data can identify explosions roughly 0.8 magnitude units lower than an acoustic emission, STA/LTA detector for the same detection probability and (2) that we can quantitatively predict how this fused, multiphysics statistic performs with Fisher's Method. Our work thereby offers a baseline method for predictive waveform fusion that supports multiphenomenological explosion monitoring (multiPEM) and is applicable to any binary testing problem in observational geophysics.

58 GEOSCIENCES↗

NASA NTRS2016

Biomechanical Modeling of the Deadlift Exercise to Improve the Efficacy of Resistive Exercise Microgravity Countermeasures

During long-duration spaceflight missions, astronauts exposure to microgravity without adequate countermeasures can result in losses of muscular strength and endurance, as well as loss of bone mass. As a countermeasure to this challenge, astronauts engage in resistive exercise during spaceflight to maintain their musculoskeletal function. The Hybrid Ultimate Lifting Kit (HULK) has been designed as a prototype exercise device for an exploration-class vehicle; the HULK features a much smaller footprint than previous devices such as the Advanced Resistive Exercise Device (ARED) on the International Space Station (ISS), which makes the HULK suitable for extended spaceflight missions in vehicles with limited volume. As current ISS exercise countermeasure equipment represents an improvement over previous generations of such devices, the ARED is being employed as a benchmark of functional performance. This project involves the development of a biomechanical model of the deadlift exercise, and is novel in that it is the first exercise analyzed in this context to include the upper limbs in the loading path, in contrast to the squat, single-leg squat, and heel raise exercises also being modeled by our team. OpenSim software is employed to develop these biomechanical models of humans performing resistive exercises to assess and improve the new exercise device designs. Analyses include determining differences in joint and muscle forces when using different loading strategies with the device, comparing and contrasting with the ARED benchmark, and determining whether the loading is sufficient to maintain musculoskeletal health. During data collection, the number of repetitions, load, cadence, stance, and grip width are controlled in order to facilitate comparisons between loading configurations. To date, data have been collected for two human subjects performing the deadlift exercise on the HULK device using two different loading conditions. Recorded data include motion capture, electromyography (EMG), ground reaction forces, device load cell data, photos and videos, and anthropometric data. Work is ongoing to perform biomechanical analyses including inverse kinematics and inverse dynamics to compare different versions of the deadlift model in order to determine which provides an appropriate level of detail to study this exercise. This work is supported by the National Space Biomedical Research Institute through NCC 9-58.

physical exercise↗