Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cognitive task analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Exploring Cognitive States: Methods for Detecting Physiological Temporal Fingerprints

Cognitive state detection and its relationship to observable physiologically telemetry has been utilized for many human-machine and human-cybernetic applications. This paper aims at understanding and addressing if there are unique psychophysiological patterns over time, a ”physiological temporal fingerprint”, that is associated with specific cognitive states. This preliminary work involves commercial airline pilots completing experimental benchmark task inductions of three cognitive states: 1) Channelized Attention (CA); 2) High Workload (HW); and 3) Low Workload (LW). We approach this objective by modeling these "fingerprints" through the use of Hidden Markov Models and Entropy analysis to evaluate if the transitions over time are complex or rhythmic/predictable by nature. Our results indicate that cognitive states do have unique complexity of physiological sequences that are statistically different from other cognitive states. More specifically, CA has a significantly higher temporal psychophysiological complexity than HW and LW in EEG and ECG telemetry signals. With regards to respiration telemetry, CA has a lower temporal psychophysiological complexity than HW and LW. Through our preliminary work, addressing this unique underpinning can inform whether these underlying dynamics can be utilized to understand how humans transition between cognitive states and for improved detection of cognitive states.

Napoli, Nicholas J.↗
NASA NTRS2002

Examining the Pilot and Controller Performance Data When in a Free Flight with Weather Phenomenon

The present study investigated effects of weather related factors on the performance of pilots under free flight. A weather scenario was defined by a combination of precipitation factors (light rain, moderate rain, and heavy rain or snow), visibility (1,4,8 miles), wind conditions (light, medium, or heavy), cloud ceiling (800ft. below, 1800ft above, and 4000ft horizontal). The performance of the aircraft self-separation was evaluated in terms of detection accuracy and detection times for student- and commercial (expert) pilots. Overall, the results obtained from a behavioral analysis showed that in general, the ability to recognize intruder aircraft conflict incidents, followed by the ability to acquire the spatial location of the intruder aircraft relative to ownership aircraft were judged to be the major cognitive tasks as perceived by the participants during self-separation. Further, the participants rarely used cockpit display of traffic information (CDTI) during conflict management related to aircraft separation, but used CDTI highly during decision-making tasks. In all weather scenarios, there were remarkable differences between expert and student pilots in detection times. In summary, weather scenarios were observed to affect intruder aircraft detection performance accuracies. There was interaction effects between weather Scenario-1 and Scenario-2 for climbing task data generated by both expert- and student- pilots at high traffic density. Scenario-3 weather condition provided an opportunity for poor detection accuracy as well as detection time increase. This may be attributed to low visibility. The intruder aircraft detection times were not affected by the weather conditions during climbing and descending tasks. The decision of pilots to fly into certain weather condition was dependent in part on the warning distance to the location of the weather. When pilots were warned of the weather conditions, they were more likely to fly their aircraft into it, but mostly when the warning was not close to the weather location.

Nituen, Celestine A.↗
NASA NTRS1988

Estimating the cost of mental loading in a bimodal divided-attention task: Combining reaction time, heart-rate variability and signal-detection theory

Multiple approaches are necessary for understanding and measuring workload. In particular, physiological systems identifiable by employing cardiac measures are related to cognitive systems. One issue of debate in measuring cardiac output is the grain of analysis used in recording and summarizing data. Various experiments are reviewed, the majority of which were directed at supporting or contradicting Lacey's intake-rejection hypothesis. Two of the experiments observed heart rate in operational environments and found virtually no changes associated with mental load. The major problems facing researchers using heart rate variability, or sinus arrhthmia, as a dependent measure have been associated with valid and sensitive scoring and preventing contamination of observed results by influences unrelated to cognition. Spectral analysis of heart rate variability offers two useful procedures: analysis from the time domain and analysis from the frequency domain. Most recently, data have been collected in a divided attention experiment, the performance measures and cardiac measures of which are detailed.

Casper, Patricia A.↗
NASA NTRS1975

The analysis of the pilot's cognitive and decision processes

Articles are presented on pilot performance in zero-visibility precision approach, failure detection by pilots during automatic landing, experiments in pilot decision-making during simulated low visibility approaches, a multinomial maximum likelihood program, and a random search algorithm for laboratory computers. Other topics discussed include detection of system failures in multi-axis tasks and changes in pilot workload during an instrument landing.

Curry, R. E.↗
NASA NTRS1979

The effects of context on multidimensional spatial cognitive models

Spatial cognitive models obtained by multidimensional scaling represent cognitive structure by defining alternatives as points in a coordinate space based on relevant dimensions such that interstimulus dissimilarities perceived by the individual correspond to distances between the respective alternatives. The dependence of spatial models on the context of the judgments required of the individual was investigated. Context, which is defined as a perceptual interpretation and cognitive understanding of a judgment situation, was analyzed and classified with respect to five characteristics: physical environment, social environment, task definition, individual perspective, and temporal setting. Four experiments designed to produce changes in the characteristics of context and to test the effects of these changes upon individual cognitive spaces are described with focus on experiment design, objectives, statistical analysis, results, and conclusions. The hypothesis is advanced that an individual can be characterized as having a master cognitive space for a set of alternatives. When the context changes, the individual appears to change the dimension weights to give a new spatial configuration. Factor analysis was used in the interpretation and labeling of cognitive space dimensions.

Dupnick, E. G.↗
DOE OSTI2025

EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK

This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗
NASA NTRS1997

Superimposition, symbology, visual attention, and the head-up display

In two experiments we examined a number of related factors postulated to influence head-up display (HUD) performance. We addressed the benefit of reduced scanning and the cost of increasing the number of elements in the visual field by comparing a superimposed HUD with an identical display in a head-down position in varying visibility conditions. We explored the extent to which the characteristics of HUD symbology support a division of attention by contrasting conformal symbology (which links elements of the display image to elements of the far domain) with traditional instrument landing system (ILS) symbology. Together the two experiments provide strong evidence that minimizing scanning between flight instruments and the far domain contributes substantially to the observed HUD performance advantage. Experiment 1 provides little evidence for a performance cost attributable to visual clutter. In Experiment 2 the pattern of differences in lateral tracking error between conformal and traditional ILS symbology supports the hypothesis that, to the extent that the symbology forms an object with the far domain, attention may be divided between the superimposed image and its counterpart in the far domain.

Attention↗
NASA NTRS1991

An analysis of Space Shuttle countdown activities: Preliminaries to a computational model of the NASA Test Director

Before all systems are go just prior to the launch of a space shuttle, thousands of operations and tests have been performed to ensure that all shuttle and support subsystems are operational and ready for launch. These steps, which range from activating the orbiter's flight computers to removing the launch pad from the itinerary of the NASA tour buses, are carried out by launch team members at various locations and with highly specialized fields of expertise. The liability for coordinating these diverse activities rests with the NASA Test Director (NTD) at NASA-Kennedy. The behavior is being studied of the NTD with the goal of building a detailed computational model of that behavior; the results of that analysis to date are given. The NTD's performance is described in detail, as a team member who must coordinate a complex task through efficient audio communication, as well as an individual taking notes and consulting manuals. A model of the routine cognitive skill used by the NTD to follow the launch countdown procedure manual was implemented using the Soar cognitive architecture. Several examples are given of how such a model could aid in evaluating proposed computer support systems.

John, Bonnie E.↗
NASA NTRS1997

Using APEX to Model Anticipated Human Error: Analysis of a GPS Navigational Aid

The interface development process can be dramatically improved by predicting design facilitated human error at an early stage in the design process. The approach we advocate is to SIMULATE the behavior of a human agent carrying out tasks with a well-specified user interface, ANALYZE the simulation for instances of human error, and then REFINE the interface or protocol to minimize predicted error. This approach, incorporated into the APEX modeling architecture, differs from past approaches to human simulation in Its emphasis on error rather than e.g. learning rate or speed of response. The APEX model consists of two major components: (1) a powerful action selection component capable of simulating behavior in complex, multiple-task environments; and (2) a resource architecture which constrains cognitive, perceptual, and motor capabilities to within empirically demonstrated limits. The model mimics human errors arising from interactions between limited human resources and elements of the computer interface whose design falls to anticipate those limits. We analyze the design of a hand-held Global Positioning System (GPS) device used for radical and navigational decisions in small yacht recalls. The analysis demonstrates how human system modeling can be an effective design aid, helping to accelerate the process of refining a product (or procedure).

VanSelst, Mark↗
NASA NTRSDate not supplied

IMPACT 1.0—Task Impairment: A Novel Approach for Assessing Impairment during Exploration-Class Missions

Exploration-class and International Space Station (ISS) missions have significantly different levels of associated medical risk for crewmembers. The Integrated Medical Model (IMM), the probabilistic risk assessment tool used for ISS medical trade-space analyses, uses a Functional Impairment (FI) metric to determine quality time lost should a crewmember be afflicted with a medical condition. While IMM-based FI has been successful for ISS operations, it has limitations when applied to exploration-class missions. As the National Aeronautics and Space Administration (NASA) looks ahead to Gateway, Artemis, and Martian missions, a novel, dynamic, and mission-appropriate impairment paradigm is necessary for accurate contingency planning. This paradigm, Task Impairment (TI), fulfills that need by utilizing mission-specific tasks. TI will allow future capability for a loss of mission metric, previously not available with IMM. TI serves as a replacement metric for FI within IMPACT, the next-generation trade-space analysis tool suite created to replace the IMM. IMPACT significantly increases the fidelity of probabilistic risk assessment for exploration-class missions. The Human Exploration of Mars Preliminary List of Crew Tasks (MTL, a source of 1100+ exploration-class mission-specific tasks for crewmembers) was used to calculate TI. Using the Task List, 18 individual Human System Categories were identified as being required to perform each task (e.g., Cardiopulmonary, Cognitive, etc.). Each of the 1200+ tasks were mapped to the Human System categories listed in the Task List. The total number of tasks in each category were tallied to determine how many tasks required each Human System. Lastly, each of the 120 medical conditions from the IMPACT condition list were mapped to the Human System categories to complete the TI calculation. NASA subject matter experts across five medical specialties established consensus for the mapping of each condition. The resulting total tasks impaired by each condition were used to calculate discrete TI values. This process was repeated for each of the four severity/resource utilization variants of each condition, and for each of the three phases of clinical care. Through this process, discrete TI values were calculated for each of the 120 IMPACT medical conditions and their variants. The Task Impairment metric provides higher fidelity, dynamic utility, and quicker analysis of medical impairment compared to the previous Functional Impairment metric used for the Integrated Medical Model. TI will be used for higher fidelity medical impairment analysis and contingency planning during Lunar, Martian, and other long-term exploration-class missions.

William L Fernandez↗
NASA NTRSDate not supplied

The Cognition Battery: Developing a Normative Database for Spaceflight and Examining the Impact of Prolonged Isolation and Confinement on Cognitive Performance

INTRODUCTION: Astronauts on future long duration space exploration will be required to execute complex tasks in which even minor errors could have devastating consequences. Intact cognition is critical to maintain exceptional performance standards and it is possible that variability even at the highest ends of the performance spectrum will impact operational tasks. Exposure to spaceflight hazards could compromise cognitive performance, and decrements have been documented under conditions of altered gravity and radiation exposure. The cognitive impacts of prolonged isolation and confinement remain relatively unknown. Traditional neuropsychological assessments cannot support earth independent monitoring, do not have normative comparisons for high functioning individuals, and most are not sensitive enough to detect small performance decrements. The Cognition Battery was developed to address these limitations but currently lacks comprehensive normative data. In this project, we aimed to 1) develop a preliminary normative database for astronauts and astronaut surrogates using the Cognition Battery, and 2) characterize differences in cognitive performance after short and long duration analog missions. PARTICIPANTS & METHODS: We assessed baseline cognitive performance by administering the Cognition Battery to 97 astronaut and astronaut surrogates recruited to approximate astronaut demographics (mean age: 39.38, SD=7.62; 35.1% female; 91.7% advanced degrees). For aim 1, we calculated speed and accuracy outcomes for each subtest and summarized the data with descriptive statistics. We examined the relationship between age and performance with Pearsons’s correlations and the relationship between gender and performance with independent samples t-tests. A subset of individuals on short duration (n=48; mean age: 38.18, SD=7.14; 37.5% female; 91.7% advanced degrees) missions of 45 days and long duration (n=34; mean age: 42.12, SD=8.39; 38.2% female; 94.1% advanced degrees) missions ranging from 4-8 months were administered the Cognition Battery during and after their respective missions. For aim 2, we accounted for practice effects using published corrections, and z-transformed post-mission scores using the full sample’s baseline scores. One-way analysis of covariance tests determined the main effect of analog duration on post-mission performance, after accounting for age and gender. The False Discovery Rate method was applied to adjust for multiple comparisons. RESULTS: In the full normative sample, older age was associated with slower reaction times on a processing speed task (r=.39, p=.02), and men were more accurate on processing speed (t=-2.19, p=.03) and faster on sustained attention (t=2.02, p=.049) and risk-taking tasks (t=2.49, p=.02). We observed a main effect of duration on performance on tasks of visual memory (f(1)=5.62, p=.04), processing speed (f(1)=5.48, p=.03), and sensorimotor functioning (f(1)=39.52, p < .001), such that slower performance was observed after long duration missions relative to short. Only sensorimotor functioning was significant after adjustments for multiple comparisons (adjusted p<.001). DISCUSSION: The full sample represents the largest dataset of cognitive performance assessed by the Cognition Battery available and can be used for further research in spaceflight and high-performance populations. Relationships between performance and key demographic variables suggest future research that include age and gender stratification is needed. Our results also show minimal changes in cognitive performance between longer and shorter periods of isolation and confinement.

S I Dev↗
NASA NTRS1985

Feasibility study for ergonomic analysis and design of future helicopter cockpit systems

The Army's light scout-attack helicopters (LHXs), planned for deployment in the 1990's, will fly nap-of-the-earth (NOE) missions in high threat environments, often under poor visibility and adverse atmospheric conditions, and probably with a one man crew. A procedure for the analysis of pilot workload that will identify and explicate the main characteristics of those LHX mission components holding overload potential is described. A principled, in-depth, explication of the cognitive demans of LHX piloting is essential to any effective effort to address the human factors issues. A task-analytic procedure that will yield the detail and organizstion needed to achieve these goals is examined.

Hawkins, H. L.↗
NASA NTRS1995

CaseMIDAS - A reactive planning architecture for the man-machine integration design and analysis system

MIDAS is a set of tools which allow a designer to specify the physical and functional characteristics of a complex system such as an aircraft cockpit, and analyze the system with regard to human performance. MIDAS allows for a number of static analyses such as military standard reach and fit analysis, display legibility analysis, and vision polars. It also supports dynamic simulation of mission segments with 3d visualization. MIDAS development has incorporated several models of human planning behavior. The CaseMIDAS effort has been to provide a simplified and unified approach to modeling task selection behavior. Except for highly practiced, routine procedures, a human operator exhibits a cognitive effort while determining what step to take next in the accomplishment of mission tasks. Current versions of MIDAS do not model this effort in a consistent and inclusive manner. CaseMIDAS also attempts to address this issue. The CaseMIDAS project has yielded an easy to use software module for case creation and execution which is integrated with existing MIDAS simulation components.

Pease, R. Adam↗
NASA NTRS2003

A dynamic model of stress and sustained attention

This paper examines the effects of stress on sustained attention. With recognition of the task itself as the major source of cognitive stress, a dynamic model is presented that addresses the effects of stress on vigilance and, potentially, a wide variety of attention performance tasks.

Review↗
NASA NTRS2003

Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component

The present study examined the effects of an electroencephalographic- (EEG-) based system for adaptive automation on tracking performance and workload. In addition, event-related potentials (ERPs) to a secondary task were derived to determine whether they would provide an additional degree of workload specificity. Participants were run in an adaptive automation condition, in which the system switched between manual and automatic task modes based on the value of each individual's own EEG engagement index; a yoked control condition; or another control group, in which task mode switches followed a random pattern. Adaptive automation improved performance and resulted in lower levels of workload. Further, the P300 component of the ERP paralleled the sensitivity to task demands of the performance and subjective measures across conditions. These results indicate that it is possible to improve performance with a psychophysiological adaptive automation system and that ERPs may provide an alternative means for distinguishing among levels of cognitive task demand in such systems. Actual or potential applications of this research include improved methods for assessing operator workload and performance.

Task Performance and Analysis↗
NASA NTRS1981

The cognitive demands of second order manual control: Applications of the event related brain potential

Three experiments are described in which tracking difficulty is varied in the presence of a covert tone discrimination task. Event related brain potentials (ERPs) elicited by the tones are employed as an index of the resource demands of tracking. The ERP measure reflected the control order variation, and this variable was thereby assumed to compete for perceptual/central processing resources. A fine-grained analysis of the results suggested that the primary demands of second order tracking involve the central processing operations of maintaining a more complex internal model of the dynamic system, rather than the perceptual demands of higher derivative perception. Experiment 3 varied tracking bandwidth in random input tracking, and the ERP was unaffected. Bandwidth was then inferred to compete for response-related processing resources that are independent of the ERP.

Wickens, C.↗
NASA NTRS1993

The use of analytical models in human-computer interface design

Recently, a large number of human-computer interface (HCI) researchers have investigated building analytical models of the user, which are often implemented as computer models. These models simulate the cognitive processes and task knowledge of the user in ways that allow a researcher or designer to estimate various aspects of an interface's usability, such as when user errors are likely to occur. This information can lead to design improvements. Analytical models can supplement design guidelines by providing designers rigorous ways of analyzing the information-processing requirements of specific tasks (i.e., task analysis). These models offer the potential of improving early designs and replacing some of the early phases of usability testing, thus reducing the cost of interface design. This paper describes some of the many analytical models that are currently being developed and evaluates the usefulness of analytical models for human-computer interface design. This paper will focus on computational, analytical models, such as the GOMS model, rather than less formal, verbal models, because the more exact predictions and task descriptions of computational models may be useful to designers. The paper also discusses some of the practical requirements for using analytical models in complex design organizations such as NASA.

Gugerty, Leo↗