SEARCH · Engineering Papers

Results for “unobtrusive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2017

Collaborative Data Publication Utilizing the Open Data Repository's (ODR) Data Publisher

Introduction: For small communities in diverse fields such as astrobiology, publishing and sharing data can be a difficult challenge. While large, homogenous fields often have repositories and existing data standards, small groups of independent researchers have few options for publishing standards and data that can be utilized within their community. In conjunction with teams at NASA Ames and the University of Arizona, the Open Data Repository's (ODR) Data Publisher has been conducting ongoing pilots to assess the needs of diverse research groups and to develop software to allow them to publish and share their data collaboratively. Objectives: The ODR's Data Publisher aims to provide an easy-to-use and implement software tool that will allow researchers to create and publish database templates and related data. The end product will facilitate both human-readable interfaces (web-based with embedded images, files, and charts) and machine-readable interfaces utilizing semantic standards. Characteristics: The Data Publisher software runs on the standard LAMP (Linux, Apache, MySQL, PHP) stack to provide the widest server base available. The software is based on Symfony (www.symfony.com) which provides a robust framework for creating extensible, object-oriented software in PHP. The software interface consists of a template designer where individual or master database templates can be created. A master database template can be shared by many researchers to provide a common metadata standard that will set a compatibility standard for all derivative databases. Individual researchers can then extend their instance of the template with custom fields, file storage, or visualizations that may be unique to their studies. This allows groups to create compatible databases for data discovery and sharing purposes while still providing the flexibility needed to meet the needs of scientists in rapidly evolving areas of research. Research: As part of this effort, a number of ongoing pilot and test projects are currently in progress. The Astrobiology Habitable Environments Database Working Group is developing a shared database standard using the ODR's Data Publisher and has a number of example databases where astrobiology data are shared. Soon these databases will be integrated via the template-based standard. Work with this group helps determine what data researchers in these diverse fields need to share and archive. Additionally, this pilot helps determine what standards are viable for sharing these types of data from internally developed standards to existing open standards such as the Dublin Core (http://dublincore.org) and Darwin Core (http://rs.twdg.org) metadata standards. Further studies are ongoing with the University of Arizona Department of Geosciences where a number of mineralogy databases are being constructed within the ODR Data Publisher system. Conclusions: Through the ongoing pilots and discussions with individual researchers and small research teams, a definition of the tools desired by these groups is coming into focus. As the software development moves forward, the goal is to meet the publication and collaboration needs of these scientists in an unobtrusive and functional way.

easy to use and implement software tool↗

NASA NTRS2017

Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users

Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.

in-flight monitoring↗

NASA NTRS2018

Evaluation of Crew-Centric Onboard Mission Operations Planning and Execution Tool: Year 2

Currently, mission planning for the International Space Station (ISS) is largely affected by ground operators in mission control. The task of creating a week-long mission plan for ISS crew takes dozens of people multiple days to complete, and is often created far in advance of its execution. As such, re-planning or adapting to changing real-time constraints or emergent issues is similarly taxing. As we design for future mission operations concepts to other planets or areas with limited connectivity to Earth, more of these ground-based tasks will need to be handled autonomously by the crew onboard.There is a need for a highly usable (including low training time) tool that enables efficient self-scheduling and execution within a single package. The ISS Program has identified Playbook as a potential option. It already has high crew acceptance as a plan viewer from previous analogs and can now support a crew self-scheduling assessment on ISS or on another mission. The goals of this work, a collaboration between the Human Research Program and the ISS Program, are to inform the design of systems for more autonomous crew operations and provide a platform for research on crew autonomy for future deep space missions. Our second year of the research effort have included new insights on the crew self-scheduling sessions performed by the crew through use on the HERA (Human Exploration Research Analog) and NEEMO (NASA Extreme Environment Mission Operations) analogs. Use on the NEEMO analog involved two self-scheduling strategies where the crew planned and executed two days of EVAs (Extra-Vehicular Activities). On HERA year two represented the first HERA campaign where we were able to perform research tasks. This involved selected flexible activities that the crew could schedule, mock timelines where the crew completed more complex planning exercises, usability evaluation of the crew self-scheduling features, and more insights into the limit of plan complexity that the crew could effectively self-schedule. In parallel we have added in new features and functionality in the Playbook tool based off of our insights from crew self-scheduling in the NASA analogs. In particular this year we have added in the ability for the crew to add, edit, and remove their own activities in the Playbook tool, expanding the type of planning and re-planning possible in the tool and opening up the ability for more free form plan creation. The ability to group and manipulate groups of activities from the plan task list was also added, allowing crew members to add predefined sets of activities onto their mission timeline. In addition we also added a way for crew members to roll back changes in their plan, in order to allow an undo like capability. These features expand and complement the initial self-scheduling features added in year one with the goal of making crew autonomous planning more efficient. As part of this work we have also finished developing the first version of our Playbook Data Analysis Tool, a research tool built to interpret and analyze the unobtrusively collected data obtained during the NASA analog missions through Playbook. This data which includes user click interaction as well as plan change information, through the Playbook Data Analysis Tool, allows us to playback this information as if a video camera was mounted over the crewmember's tablet. While the primary purpose of this tool is to allow usability analysis of crew self-scheduling sessions used on the NASA analog, since the data collected is structured, the tool can automatically derive metrics that would be traditionally tedious to achieve without manual analysis of video playback. We will demonstrate and discuss the ability for future derived metrics to be added to the tool. In addition to the current data and results gathered in year two we will also discuss the preparation and goals of our International Space Station (ISS) onboard technology demonstration with Playbook. This technology demonstration will be preformed as part of the CAST payload starting in late 2016.

onboard planning↗

NASA NTRS2016

R2U2 in Space: System and Software Health Management for Small Satellites

In order for small but complex systems like rovers, SmallSats, or Unmanned Aircraft (UAS) to operate autonomously, they must have a real-time solution for assessing their own system health. System and Software Health Management (SHM) enables better detection of faulty sensors and software problems, and enables better fault management including mitigation of unpredicted fault scenarios in the absence of a human on-board. In recent work, we have developed a Responsive, Realizable, Unobtrusive Unit (R2U2) for on-board SHM of autonomous UAS and demonstrated its ability to detect faults during flight time. These faults, from sensor failures, to software problems, to malicious security attacks, can present as transient temporal faults that even humans are challenged to find. An R2U2 congfiuration is a modular combination of multiple types of temporal logic runtime observers with fault-specic Bayesian Nets and sensor filters. R2U2 reasons about both on-board hardware and software components; R2U2 itself can be instantiated as an independent FPGA (Field-Programmable Gate Array)-based conguration or as a software component running independently from other software on-board. Small satellites, such as CubeSats, also require on-board SHM and failure mitigation, as limited telemetry bandwidth does not allow the transmission of the entire system state for ground-based health management. However, the autonomous operation of satellites brings a set of challenges different from UAS, including the effects of radiation on non-rad-hard, low-cost components, and the harsher environment of space. We surmise that a new extension of R2U2 could be adapted to help better detect, for example, radiation errors in cheaper COTS (Commercial Off the Shelf) (not rad-hard) components often used in small space systems. Since small satellites often operate in coordination, we will also examine new ways of distributed monitoring of their communication and cooperation and real-time detection of off-nominal situations utilizing multiple satellites. This talk will discuss preliminary work and ideas for building on terrestrial success of system and software health management for the harsher, and differently challenging, environment of space.

Runtime Verification & Validation↗

NASA NTRS2018

On-Board Battery Monitoring and Prognostics for Electric-Propulsion Aircraft

The reliability of the propulsion system of an aircraft is paramount for the aircraft safety and hence the aircraft health must be monitored continuously. In contrast to fuel- operated aircraft, electric battery-operated propulsion system poses specific problems, such as, the remaining battery power does not linearly decrease and cannot be measured directly. In this paper, we describe a combined monitoring and prognostics architecture that can continuously monitor all components of the electric propulsion system with respect to safety and performance properties as well as state of charge and rest of useful life for the battery. Our system combines a detailed electrochemical battery model for Li-ion batteries with a powerful prognostics engine based upon an Unscented Kalman Filter with the R2U2 monitoring device, which provides efficient observers for metric temporal logic and Bayesian reasoning. R2U2 is a real-time, realizable, responsive, unobtrusive unit, which continuously monitors sensor readings, outputs of the prognostics engine, as well as the ight software status for safety, performance, and security properties. We illustrate our architecture with two case studies, one reporting actual ight tests with an X8+ octocopter and the other a software-in-the-loop simulation with an unmanned Edge 540 electric aircraft model.

Kulkarni, Chetan↗

NASA NTRS2019

Software and System Health Management with R2U2

R2U2 (Realizable, Responsive, Unobtrusive Unit) is a hardware-supported tool and framework for the real-time system and software health management of cyber-physical systems. R2U2 continuously monitors properties about safety, performance, and security of the vehicle and can perform diagnostic reasoning. Efficient observers for past-time and future-time Metric Temporal Logic, reasoners for Bayesian Networks, and model-based prognostics algorithms are major components of R2U2. Their combination makes it possible to design powerful models for system runtime monitoring, diagnostics, software health management, prognostics, and security monitoring. The R2U2 monitoring engine is designed for minimal runtime overhead and is available as Simulink block or as a software component for integration into the flight software stack, and enables R2U2 to monitor complex cyber-physical systems without any instrumentation of the flight software. In this presentation, we give an overview of R2U2 architecture and reasoning algorithms, present its features, and give a life demo of the tool.

Schumann, Johann↗

NASA NTRS2020

Preparing for Human Missions to Mars: The role of ISS and Artemis as Analogs for Research and Technology Testing

The hazards of spaceflight to the human system are present in in varying degrees on different spaceflight platforms: altered gravity, isolation and confinement, distance from Earth, radiation, and hostile closed environments. A strategic view of the fidelity of hazards experienced on different platforms can shape the testing plans for human research and technology demonstration related to crew health and performance. Working across the international partnership, the International Space Station (ISS) is planning periods of modified operations to improve the fidelity of Mars simulations. To understand transit durations as an independent variable, a series of 1-year, 6-month and 30-45 day missions are being planned on ISS. Standard measurements across ISS missions of different durations, lunar missions and ground analogs offers the opportunity to distinguish different hazards and their effects in the context of the relevance to future mission concepts. The ISS partnership is planning for additional test cases that are aligned with Mars mission plans. (1) Evaluating crew performance capabilities when transitioning to gravity after long durations in microgravity representative of a Mars transit. (2) Simulating crew medical care under Mars-like autonomous operations. (3) Identification and testing of operations under communications delay and autonomy expected for Mars missions and the linked effects on behavioral health and performance of the crew. Artemis missions serve as a valuable analogs for Mars surface operations, with partial gravity and deep space radiation hazards, but with crewmembers that are probably more physically capable than their counterparts would be after a Mars transit. Getting unobtrusive data from early Artemis missions, and knowledge gained from operational experience as Artemis operations develop can improve engineering design, medical requirements and countermeasures, and ultimately ensure mission success on Mars. Linking Mars architectures with the plans and capabilities for ISS and Artemis allows us to plan to most operationally relevant tests of crew health and performance on current spaceflight missions to inform planning for future missions to Mars. By using human spaceflight platforms as well as ground simulation in an integrated way, the international community can improve exploration readiness, develop countermeasures and reduce risks of future human space missions.

International Space Station↗

NASA NTRSDate not supplied

Monitoring Human Performance on Future Deep Space Missions Abstract

NASA and the commercial spacecraft community are working diligently to put the first woman on the moon in the 2024 timeframe. At the same time, NASA researchers are thinking about how to solve the even larger challenges that future deep space missions will bring. Space travel itself is difficult, but astronauts on deep space missions will face obstacles and unknowns never before experienced. In addition to the altered gravity and hostile/closed environment of a spacecraft, deep space crews will face increased radiation, isolation, and distance from Earth. During Extravehicular Activity (EVA, or “spacewalk”) operations, crew will experience increased physical and cognitive workload due to extended types, frequencies and durations of tasks performed on exploration missions in partial gravity environments. All of these stressors will impact crew physical and mental health and performance in difficult-to-anticipate ways. Crew autonomy may be one of the biggest challenges faced. Communication delays and blackouts will occur, and in those situations, the crew may not have access to the Mission Control Center (MCC). They may be forced to be solely dependent on each other and the available information onboard to stay alive, healthy, and achieve the mission. The only conceivable way to meet the challenges of Earth independence is to enable the crew to monitor their own health and performance -- preferably unobtrusively as they perform their duties. Technologies and techniques must be developed to aid the crew in these assessments. A deep space mission is expected to have relatively short periods of high cognitive demand, stress, and fatigue, alongside potentially long periods of cognitive underload during the transit, where boredom, loneliness, and depression can set in. Both ends of this spectrum are dangerous. Crew must be made aware when their task performance drops significantly, when their cognitive workload is too high, when they have lost situation awareness, or when they are too stressed or too fatigued to perform well. They must be able to identify these risks, and then mitigate them with countermeasures available onboard. A number of self-monitoring technologies are presently being explored by NASA to advance crew state determination capabilities. These range from real-time, physiological workload and situation awareness assessments, to crew health measurements determining physical and mental fitness for duty, to task performance metrics such as suit resource expenditures. For EVA tasks during surface exploration missions, biomedical information such as metabolic rate may be provided to crewmembers for situational awareness related to task performance efficiency. In addition, translation distances, hydration, nutrition, inspired CO2 exposure and other consumables usage rates may be useful input metrics for modeling individualized performance during tasks to inform crew or provide estimates of work efficiency. Oculomotor metrics such as gaze dwell time, pupilometry, and eye tracking collected in advanced helmet mounted displays could potentially be used to characterize crew situation awareness. This paper highlights some of these projects, and provides broader discussion about the need for advanced monitoring and smart technologies, as NASA takes the leap into the next generation of space exploration.

Kritina Holden↗

NASA NTRS2018

Application Software Cybersecurity Scanning

Scanning software applications for cybersecurity vulnerabilities is a crucial step is assessing the overall health of the application, but how can this kind of scan be performed to give development teams the information they need to make informed design decisions? Two pilot cybersecurity scans were conducted in an attempt to answer this question. A scanning team composed of various subject matter experts was established and worked closely with the development team to perform these scans and capture metrics throughout the process. These interactions and metrics indicate that these scans can be performed in an unobtrusive way and still provide valuable information to development teams regarding the health of their application. This work is not definitive in nature but serves as a foundation for future work.

Barner, Lyle↗

NASA NTRSDate not supplied

Supporting Crew Medical Decisions on Deep Space Missions: A Real-Time Performance Monitoring

Crewed missions into deep space will require astronauts to respond autonomously to safety- and time-critical anomalies. These and other potential issues will require the continuous monitoring and recognition of potentially subtle, but complex, anomalous data patterns. NASA continues to investigate real-time metrics for Extravehicular Operations1 and for providing feedback to improve performance2. Since it is unknown how long-term exposure to deep space will affect crew health, continuous monitoring of clinical and subclinical status is warranted. NASA is characterizing crew medical decision-support needs and identifying the recommended requirements of a Clinical Decision Support System (CDSS) within the Exploration Medical Capability Element (ExMC) of the Human Research Program3. Early detection, and continuous monitoring, of performance may provide an effective prognostic capability for assessing crew health state, and the identified requirements could be provided for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. There is evidence to suggest that automatic, unobtrusive collection of keystroke features, such as alphanumeric key latencies, backspaces or typing rhythm, could be a valuable performance screening tool. Keystroke features show significant differences between control subjects and patients with overt clinical illness, such as multiple sclerosis4 and Parkinson’s disease5, as well as behavioral health and performance issues, such as mild cognitive impairment6 and depression7. This work is exploring a capability for the assessment of early task performance decline in crew as they perform daily activities. Timestamped keyboard entries are continuously collected and stored. Nominal keystroke interactions are compared to those obtained after exposure to spaceflight stressors, e.g., fatigue, to determine the methods sensitivity. This work will pave the way toward an objective detection tool that may be deployed in a spaceflight setting.

clinical↗

NASA NTRSDate not supplied

Runtime Monitoring with R2U2 for Aircraft Systems with Neural Networks

R2U2 (Realizable, Responsive, Unobtrusive Unit) is a hardware-supported tool and framework for real-time system monitoring and software health management of cyber-physical systems. During system operation, R2U2 continuously monitors properties about safety, performance, and security of the vehicle and its vital components and can perform diagnostic reasoning. Efficient observers for past-time and future-time Metric Temporal Logic, fast reasoners for Bayesian Networks, and model-based prognostics algorithms are key components of R2U2 and designed for minimal computational footprint. R2U2 has been implemented in software supporting ROS, NASA's cFS/cFE, and Simulink and as an FPGA configuration. The synergistic combination of monitors and observers in R2U2 makes it possible to design powerful models for system runtime monitoring, diagnostics, software health management, prognostics, and security monitoring. In this presentation, I will give a detailed overview of the R2U2 architecture and its features and will discuss the application of R2U2 for safety-monitoring of a neural-network based autonomous centerline tracking system (ACT) for autonomous aircraft.

Runtime Monitoring↗

NASA NTRSDate not supplied

Teams in Space: Knowledge Gained, but More to Explore

NASA’s Human Research Program oversees the Team Risk (i.e., Risk of Performance and Behavioral Health Decrements due to Inadequate Cooperation, Coordination, Communication and Psychosocial Adaptation within a Team). Research in this area informs all aspects of an astronaut’s career, from hiring to training to mission support, and works to address new challenges related to lunar and Mars missions. NASA’s astronaut selection process creates an astronaut corps of highly qualified, team-oriented individuals, which allows mission planners much flexibility in composing small crews for specific missions. These crews are further developed and supported through extensive training, including team skills training, and countermeasures available to the crew throughout the mission. However, in the high consequence environment of long-duration missions, team composition is complex and is not a one-time concern to be addressed pre-mission. Team factors such as team cohesion, dyadic relationships, and shared team cognition are likely to change dynamically in response to each interaction and event experienced by the individuals and the team as a whole. Thus, monitoring and optimizing team composition at a more micro level (e.g., per task) is one way to support team functioning and performance. Spaceflight teams research also includes the multi-team system of Mission Control and coordination between space-to-ground, adding another avenue in which risk might be introduced, particularly under exploration missions that experience significant communication delays. Spaceflight teams research has recently experienced a concentrated flurry of analog research over the past decade, shedding light on the many unique challenges and potential solutions to mitigate the team risk in long-duration exploration missions. However, questions still remain about how to, for example, create unobtrusive operational measures and how to advance interdisciplinary teams research and countermeasure development. We present an overview of the challenges facing teams in space, our current knowledge, and the next steps for research and spaceflight operations.

Lauren Blackwell Landon↗

NASA NTRSDate not supplied

Toward an IMU-based Space Suit Motion Capture System

Spacesuits are complex engineering systems that sustain human health and enable performance outside of Earth-like environments. These systems must support human mobility and physical workload demands while minimizing injury risk during extravehicular activity (EVA). Future EVA on the lunar surface during the Artemis program is expected to be more frequent and require higher physical workloads than previous EVAs during the ISS, Shuttle, or Apollo programs. Hence it is important to optimize future as well as current spacesuits to be efficient and comfortable for the success of space and planetary missions. To enable this, an efficient method is needed to test these spacesuits on the ground.When testing spacesuits in ground environments, it is often necessary to understand the kinematics of the suit to validate the design against relevant requirements or characterize the physical workload necessary to operate the suit. This is a challenging task for traditional optical motion capture (OMC) approaches: suit-mounted OMC markers are easily occluded by the subject or environment and may become detached during testing. Controlling lighting and reflectivity of objects in the motion capture volume is also difficult. Fixed-position OMC cameras also constrain testing to a small and contrived laboratory environment, disallowing kinematics capture in field environments.One promising alternative is the use of suit-mounted inertial measurement units (IMUs). These sensors are small, unobtrusive, and portable, but come at the cost of increased sensor noise and complexity of the software and mathematics to analyze the collected data. To this end, engineers at NASA are developing the Augmented Suit Inverse Kinematics (ASIK) system, a complete motion capture methodand inverse kinematics solver which relies solely on a network of wireless IMUs attached to the major kinematic segments of the spacesuit. The ASIK modeling language allows for the simple inclusion of probabilistic priors such as suit size and shape or IMU positions and rotations. Furthermore, to increase accuracy and reduce operational overhead to use this motion capture approach, the developed inverse kinematics solver exploits so-called self-calibratingalgorithmic techniques, which reduce the need for precise alignment of the sensors on the segments or scripted functional calibration procedures. The ASIK system was tested in a 7-subject pilot study. Each subject donned NASA’s new prototype exploration spacesuit in the Active Response Gravity Offload System (ARGOS) facility at the NASA Johnson Space Center. The subjects were outfitted with a set of 14 APDM (Portland, OR, USA) Opal IMUs, 12 of which were used in the ASIK model to estimate lower body and trunk kinematics. The subjects were also outfitted with a set of reflective OMC markers and traditional OMC data was collected and processed. Presented results will include characterization of ASIK-derived suit joint angles accuracy against an optical motion capture datum. Discussion of these results, as well as discussion of system calibration and nuances of mathematical observability, will be included.If successful, IMU-based motion capture will enable testing and validation of spacesuits more frequently, with less overhead, in more extreme environments. Future work will apply these techniques to common spacesuit testing tasks, such as gait, mobility, and balance assessment, physical workload characterization, and ergonomics evaluations.

Timothy Mcgrath↗

NASA NTRSDate not supplied

Runtime Monitoring for Unmanned Aerospace Systems with Neural Network Components

AI components (e.g., Deep Neural Networks) are increasingly used in unmanned Aerospace systems for safety-relevant applications. Rigorous Verification and Validation methods for such components are still in their infancy and thus, monitoring of the AI's behavior during runtime is essential. In this paper, we will present a runtime-monitoring architecture, which combines the advanced statistical analysis framework SYSAI (System Analysis using Statistical AI) with temporal and probabilistic runtime monitoring carried out by R2U2 (Realizable, Responsive, and Unobtrusive Unit). Learned statistical models of complex systems with AI components are produced by the SYSAI framework and provide detailed information to enable the R2U2 runtime monitor to efficiently perform advanced safety and performance checks in nominal and off-nominal conditions. We will present initial results of our tool set and architecture on a case study, a DNN-based autonomous centerline tracking system (ACT).

Yuning He↗

NASA NTRS2022

Preparing the Mars Relay Network for the Arrival of the Perseverance Rover at Mars

The Perseverance rover represents NASA’s latest achievement in Mars exploration. Landing successfully on 18 Feb 2021, the rover’s transmitted data during its entry, descent, and landing (EDL) were captured by the Mars Reconnaissance Orbiter (MRO) and the Mars Atmosphere and Volatile Evolution (MAVEN) orbiter. This data, broadcast in near-realtime to the world, allowed everyone to share in the excitement (and “terror”) of the day. The images returned thereafter included the first images of the new landing site, video of the landing itself taken from a variety of vantage points, and eventually the historic images of the first powered flight on another planet. Behind the scenes, the return of that data to Earth was accomplished via Mars orbiters operated by NASA and ESA, using three different ground tracking networks. Considered together, this Mars Relay Network (MRN) enabled the successful, timely, and unobtrusive return of the rover’s data. This paper describes the preparations taken by the participants of the MRN in anticipation of the arrival of Perseverance at Mars. These were not only focused on successfully acquiring the rover’s critical event telemetry during its EDL, but also on readying the network to return the rover’s data on an ongoing basis as it pursued its mission objectives. Included is a brief description of the MRN, which represents a highly successful international collaboration and continues as critical infrastructure for NASA’s and ESA’s ongoing Mars exploration. Also summarized are the activities performed prior to EDL, including landing site reconnaissance and mission test and training activities; those activities performed on EDL day, especially the recording, return, and processing of the rover’s critical event telemetry; and those activities that are now being performed on an ongoing basis during the rover’s surface operations, including an outline of the planning processes that enable relay services. Finally, a description of the performance of the network to-date on behalf of the Perseverance rover is given, summarizing the success of the network to provide support to both it and other spacecraft on the surface of Mars.

Srnka, Evan↗

NASA NTRSDate not supplied

The Development and Application of Cognitive Performance Assessment for Exploration Class Mission EVAs

The objectives of our research are to: 1) Define cognitive performance requirements for future Lunar and Mars mission EVAs, 2) Characterize cognitive performance in subjects conducting simulated EVAs in analog studies, and 3) Develop and test unobtrusive EVA cognitive performance metrics. Our long-term goal is to develop exploration class cognitive performance monitoring capabilities for EVA and to provide data that can inform EVA planning for Lunar and Mars missions.

S R Anderson↗

NASA NTRSDate not supplied

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE)

NASA is planning to return to the Moon in the mid-2020s as a stepping stone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support. The software used in APACHE was created by the JSC Engineering Directorate, in partnership with Buendea, powered by a custom Unreal Engine 5 (UE5.3, Epic Games) project. APACHE currently utilizes the HTC Vive Pro Eye in a wireless configuration for VR simulations. There are two virtual environments that subjects can explore within APACHE, a Lunar and Martian surface. The virtual Lunar surface was created from LIDAR data of the Lunar South Pole to create roughly 16 sq km of explorable terrain. The virtual Martian surface contains roughly 400 sq km of explorable terrain derived from Mars Reconnaissance Orbiter LIDAR data of the Jezero Crater. The immersion and related cognitive burdens of conducting a planetary EVA is simulated through a series of EVA-relevant tasks performed in the VR environment, using these high-fidelity visual representations. Additionally, APACHE includes biosensor driven informatics, such as real-time heart rate monitoring and/or derived values from model simulations, for active monitoring by the EV crew and added cognitive demand. A “Wizard of Oz” control panel enables test operators to activate contingency events such as simulated spacesuit malfunctions, loss of communications, and/or limited visibility. Embedded performance measures such as accuracy, completeness, and execution time have been developed for various exploration tasks to objectively quantify crew performance during an EVA and compare impacts to performance when different environmental stressors, both physical and cognitive, are added to or removed from the simulation. Additionally, validated cognitive and operational performance measures such as the Digit Symbol Substitution Task have been recreated and embedded in VR for direct and relatively unobtrusive measurement of motor perception. The APACHE environment currently supports multiple research studies at NASA. Examples include the CHAPEA project, a series of simulated year-long missions on Mars by a 4-person crew; and the CO2 Contingency Walk Back Study, an investigation of elevated CO2 exposure on crew performance during a contingency EVA scenario. APACHE also provides a test environment to support the development of the Crew State and Risk Model, which is a collection of individualized, mathematical models of crew physical and cognitive state; and the Personalized EVA Informatics and Decision Support system, an operational tool for flight controllers, and eventually a self-reliant Martian crew, to make biomedically-informed decisions in real-time to optimize the EVA planning and execution with respect to crew health and performance. Some technical challenges associated with developing the APACHE environment, as well as current limitations, include VR limitless natural walking with a hybrid spacesuit simulator, optimizing performance for wireless PC VR streaming while maintaining a high degree of visual fidelity, and the integration of various physiological (metabolic masks) and psychometric (eye tracking) sensors with the VR headset.

Human Performance↗

NASA NTRS2026

Machine Learning for Predicting Team Functioning in HERA Missions

Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.

Shrivatsa Mishra↗