Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Human Performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Towards a Measure of Situation Awareness for Space Mission Schedulers

The success of space flight missions relies on support provided to astronauts through specialist knowledge of ground-based personnel. One of the many essential tasks that ground personnel provide is the scheduling of flight crew daily activities. Future long duration exploration missions will require astronauts to assume planning and scheduling responsibilities in order to facilitate increased autonomy from ground support. Although situation awareness is critical to the scheduling task, a sufficient measure for this domain has not been developed. This paper documents the approach and process by which the authors developed a framework for measuring situation awareness in space mission schedulers and presents the measure applications’ initial results.

human factors in spaceflight↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology and Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical work load during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2) were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alex Baughman↗

Trajectory Specification Applied to Terminal Airspace

Despite major efforts to automate air traffic control (ATC), it is still performed by humans today. The complexity and safety-criticality of ATC makes it very difficult to safely automate, but it must be automated to increase airspace capacity (the density of traffic that can be safely managed) and airport throughput (the number of arrivals and departures that an airport can safely handle in a given period of time) beyond what is possible with human controllers. This paper presents the Trajectory Specification (TS) concept, which can help to safely automate ATC. TS is a method of specifying aircraft trajectories such that the position at any given time in flight is restricted to a precisely defined bounding space, removing all ambiguity as to where the flight is allowed to be. The bounding space or volume is determined by tolerances relative to a reference trajectory (position as a function of time). The tolerances are dynamic and are based on the aircraft navigation capabilities and the traffic situation. The tolerances can be a piecewise linear function of time or distance along the route, allowing the tolerances to vary as needed, typically increasing with time for departures and decreasing for arrivals. A Trajectory Specification Language (TSL) is proposed for communicating trajectories from aircraft to ATC as requests and from ATC to aircraft as assignments. The TS concept requires a new generation of airborne Flight Management Systems (FMS) that understand the TSL and can fly the assigned trajectories, but this paper focuses on the ATC functions and the prototype ATC algorithms and software that were developed to test the TS concept. Assuming conformance, TS can guarantee safe separation for an arbitrary length of time even in the event of an ATC system or communication outage. It can help to achieve the high level of safety and reliability needed for ATC automation, and it can also reduce the reliance on ATC backup systems for tactical conflict detection and resolution during normal operation. TS can be applied to any controlled airspace, including enroute, terminal, and urban airspace, but this paper presents algorithms and software for arrival spacing and conflict detection and resolution in the terminal airspace serving a major airport. In a fast-time simulation of a full day of traffic in a major terminal airspace, all conflicts were resolved in near real time, demonstrating the computational feasibility and the preliminary operational feasibility of the TS concept. This paper is a compilation of previous papers, and it adds significant information that was omitted from those papers due to length limitations. It also updates some of the results of those earlier papers due to algorithm refinements and corrections of minor software errors.

air traffic control, trajectory↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology And Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical workload during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2)were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alexander J Baughman↗

Helmet-Mounted Display Technology for Eva Training in NASA's Neutral Buoyancy Lab

Currently, during extravehicular activity (EVA) on the International Space Station (ISS), astronauts are in constant communication with mission control; however, this paradigm will significantly change during future NASA exploration missions due to limited and time-delayed communications. As exploration missions will thereby require an increase in crew autonomy, it is hypothesized that heads-up display (HUD) technology can supplement communications with mission control. Before introducing novel display technology to EVA operations, it must first be demonstrated and evaluated in an EVA training environment. The UC Davis Center for Spaceflight Research, in collaboration with NASA Johnson Space Center’s Human Physiology, Performance, Protection, and Operations (H-3PO) Lab has developed a low-cost and rapid development helmet-mounted display (HMD) for EVA training at NASA’s Neutral Buoyancy Lab (NBL). The first two phases of HMD testing (Phase I and II) at the NBL focused on technology and capability development and demonstration. Crew member feedback was obtained that evaluated aspects of HMD including its user satisfaction, visibility, readability, and usefulness. Overall, feedback indicated HMD was readable, un-obtrusive, and the available display modes had potential to be useful and enhance EVA training. HMD display modes currently available include: real-time biofeedback (metabolic rate), phase elapsed time (PET), ability to set timers, task procedural aids (e.g. Pistol Grip Tool settings) and custom messages. The goal for Phase III, which is currently underway, is to evaluate the effects that access to bioinformatics through HMD has on astronaut training and performance at the NBL. For this phase of testing, crewmembers will be asked to perform a go/no-go task while wearing HMD throughout the NBL run to characterize crew member state of situational awareness with respect to HMD. This information could be used to inform how best to display relatively important or supplemental, but not critical, data in the future.

Heads up display↗

Toward Monitoring and Predicting Cognitive Resilience

"Toward Monitoring and Predicting Cognitive Resilience" for IWS 2023 session DS04, Monitoring Cognitive Resilience. Definitions and characterizations of Cognitive Resilience are presented, along with other considerations for monitoring and predicting it in the context of space radiation and other stressors. This session will feature “lightning-style" talks focused on how HRP research could be used in conjunction with work from interagency partnerships to monitor or predict cognitive resilience for astronauts followed by facilitated panel discussion focused on key questions.

cognition↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

reinforcement learning↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

A Pilot Project for Quantifying the Effect of Medical Provider Knowledge, Skills, and Abilities on Outcomes for Spaceflight Using a Probabilistic Risk Assessment Tool

In order to enable the future of long-duration deep space exploration we must confront the uncertainty in medical risk. Limitations of communication, resupply, and evacuation in deep space will require a high degree of crew autonomy and accurate risk assessment will be critical to ensure adequate crew training and medical system design. To address this, NASA’s Human Research Program Exploration Medical Capability Element has developed the Informing Mission Planning via Analysis of Complex Tradespaces Tool (IMPACT). IMPACT is a suite of tools that can provide evidence-based, data-driven trade space assessments between available medical resources in the mass- and volume-constrained environment of a deep space exploration vehicle. In the current model, medical conditions either can or cannot be treated based on the availability of medical system resources and equipment. However, medical outcomes often depend just as much on the knowledge, skills, and abilities (KSA) of the provider operating the system. This paper presents a method for modeling and quantifying the effect of medical officer KSA on medically relevant mission risk outcomes during spaceflight.

capabilities↗

Oculometric Detection and Characterization of Sub-Clinical Visual/Visuomotor Impairment

It has long been known that qualitative abnormalities in eye movements can be used to diagnose overt brain pathologies (Diefendorf & Dodge, 1908; Fox & Holmes, 1926; Leigh & Zee, 2015). Here, we will examine the use of a set of quantitative measures of the human behavioral response (oculometrics) in a 5-minute radial ocular tracking task (Krukowski & Stone, 2005) with sufficient temporal, spatial, and directional uncertainty to minimize the contribution of a priori prediction or anticipation, and to emphasize the use of a posteriori visual processing of the stimulus trajectory (Liston & Stone, 2014). The derived oculometrics provide a largely independent, reliable set of metrics that are sensitive enough to detect mild sub-clinical impairment across a range of possible neural loci (Stone et al., 2019) with the pattern of impairment across the set providing specificity as to its nature (Tyson et al., 2023). We will review our earlier findings where oculometrics have been used to detect mild impairment due to traumatic brain injury, sleep loss, and low-dose alcohol (Liston et al., 2017; Stone et al., 2019; Tyson et al., 2021). We will also report on a recent clinical study of asymptomatic patients at risk of retinal pathology (Leung et al., 2022) and show that oculometrics can detect and characterize substantive loss of visual function in the absence of clinical indicators of pathology. We conclude that oculometric testing could be used as a routine non-invasive ophthalmological or neurological tool to aid in the early detection and diagnosis of neural injury, toxicity, or disease.

eye movements↗

Oculometric Biomarkers of Visuomotor Deficits in Clinically Asymptomatic Patients With Systemic Lupus Erythematosus Undergoing Long-Term Hydroxychloroquine Treatment

Introduction: This study examines a set of oculomotor measurements, or “oculometric” biomarkers, as potential early indicators of visual and visuomotor deficits due to retinal toxicity in asymptomatic Systemic Lupus Erythematosus (SLE) patients on long-term hydroxychloroquine (HCQ) treatment. The aim is to identify subclinical functional impairments that are otherwise undetectable by standard clinical tests and to link them to structural retinal changes. Methods: We measured oculomotor responses in a cohort of SLE patients on chronic HCQ therapy using a previously established behavioral task and analysis technique. We also examined the relationship between oculometrics, OCT measures of retinal thickness, and standard clinical perimetry measures of visual function in our patient group using Bivariate Pearson Correlation and a Linear Mixed-Effects Model (LMM). Results: Significant visual and visuomotor deficits were found in 12 asymptomatic SLE patients on long-term HCQ therapy compared to a cohort of 17 age-matched healthy controls. Notably, six oculometrics were significantly different. The median initial pursuit acceleration was 22%, steady-state pursuit gain 16%, proportion smooth 7%, and target speed responsiveness 31% lower, while catch-up saccade amplitude was 46% and fixation error 46% larger. Excluding the two patients with diagnosed mild toxicity, four oculometrics, all but fixation error and proportion smooth, remained significantly impaired compared to controls. Across our population of 12 patients (24 retinae), we found that pursuit latency, initial acceleration, steady-state gain, and fixation error were linearly related to retinal thickness even when age was accounted for, while standard measures of clinical function (Mean Deviation and Pattern Standard Deviation) were not. Discussion: Our data show that specific oculometrics are sensitive early biomarkers of functional deficits in SLE patients on HCQ that could be harnessed to assist in the early detection of HCQ-induced retinal toxicity and other visual pathologies, potentially providing early diagnostic value beyond standard visual field and OCT evaluations.

eye movements↗

Contextualizing Air Traffic Management Conversations using Natural Language Understanding

Efficient management of air traffic and mitigation of delays depend on extracting actionable information from unstructured data, such as dialogues from the Federal Aviation Administration’s (FAA’s) Air Traffic Control System Command Center (ATCSCC) telecons. This study presents a pipeline utilizing Natural Language Processing (NLP) methods for Intent Classification (IC) and Slot Filling (SF) to identify and extract Traffic Management Initiatives (TMIs) from aviation-specific dialogues. We leveraged DeBERTa, a pre-trained transformer model, and fine-tuned it to the nuances of the aviation domain. Despite challenges posed by annotation complexities, the IC model achieved promising results with a weighted average F1-score of 0.81. Our results are close to those of human annotators, which demonstrates the model’s strong alignment with human-level performance. The SF model also showed strong performance, achieving a weighted F1-score of 0.97, which demonstrates its effectiveness in accurately predicting key slots. Our analysis revealed limitations in handling less frequent intents and slot labels due to data sparsity, motivating future efforts to adopt joint IC-SF modeling and data augmentation strategies. This research highlights the potential of domain-specific NLP to streamline decision-making in the aviation industry and improve the management of TMIs.

Air Traffic Control Management↗